2024-05-04T02:06:37.890 INFO:root:teuthology version: 0.0.1.dev271+g1ae7ad8 2024-05-04T02:06:37.890 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --owner scheduled_pdonnell@teuthology --name pdonnell-2024-05-03_22:48:16-fs-wip-pdonnell-testing-20240503.163550-debug-distro-default-smithi --archive /home/teuthworker/archive/pdonnell-2024-05-03_22:48:16-fs-wip-pdonnell-testing-20240503.163550-debug-distro-default-smithi/7688562 --description fs/verify/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug pg_health session_timeout} ranks/1 tasks/dbench validater/valgrind} -- /home/teuthworker/archive/pdonnell-2024-05-03_22:48:16-fs-wip-pdonnell-testing-20240503.163550-debug-distro-default-smithi/7688562/orig.config.yaml 2024-05-04T02:06:37.933 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-04T02:06:38.015 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-05-03_22:48:16-fs-wip-pdonnell-testing-20240503.163550-debug-distro-default-smithi/7688562 branch: wip-pdonnell-testing-20240503.163550-debug description: fs/verify/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug pg_health session_timeout} ranks/1 tasks/dbench validater/valgrind} email: pdonnell@redhat.com first_in_suite: false job_id: '7688562' kernel: kdb: 1 sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: pdonnell-2024-05-03_22:48:16-fs-wip-pdonnell-testing-20240503.163550-debug-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20240503.163550-debug ceph: cephfs: session_timeout: 300 conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mds beacon grace: 60 mds heartbeat grace: 60 osd heartbeat grace: 60 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds valgrind exit: true mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon osd crush smoke test: false osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd fast shutdown: false osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow request - SLOW_OPS - MON_DOWN sha1: bd4e00a39d766328b458e4c953f4d722fed96a31 valgrind: mds: - --tool=memcheck mon: - --tool=memcheck - --leak-check=full - --show-reachable=yes watchdog: daemon_restart: normal ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: valgrind: - --tool=memcheck - --leak-check=full - --show-reachable=yes install: ceph: debuginfo: true flavor: default sha1: bd4e00a39d766328b458e4c953f4d722fed96a31 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240503.163550-debug sha1: bd4e00a39d766328b458e4c953f4d722fed96a31 owner: scheduled_pdonnell@teuthology priority: 65 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 1842 sha1: bd4e00a39d766328b458e4c953f4d722fed96a31 sleep_before_teardown: 0 subset: 478/512 suite: fs suite_branch: wip-pdonnell-testing-20240503.163550-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_bd4e00a39d766328b458e4c953f4d722fed96a31/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: bd4e00a39d766328b458e4c953f4d722fed96a31 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi001.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF55OzKoge4QPDEevlgqCVMWMfvVHUB6+YFlVwku1bhkaEPttZJuylFH6nbpUiYo12d6qxlh2cPV0SIkepABmM8= smithi107.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA4xcPEYtr1bBomnLSjGJy+NHsxQ/PBA8j2oF1uVarAT/doN9ZyECMmCs4L6LkrOhYyKr8RcP+DZji6rC9n6C6c= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - workunit: clients: all: - suites/dbench.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 1ae7ad82388e92a475afff437d49054826c019a1 timestamp: 2024-05-03_22:48:16 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-05-04T02:06:38.016 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_bd4e00a39d766328b458e4c953f4d722fed96a31/qa; will attempt to use it 2024-05-04T02:06:38.016 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_bd4e00a39d766328b458e4c953f4d722fed96a31/qa/tasks 2024-05-04T02:06:38.016 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-04T02:06:38.018 INFO:teuthology.task.internal:Checking packages... 2024-05-04T02:06:38.041 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'bd4e00a39d766328b458e4c953f4d722fed96a31' 2024-05-04T02:06:38.041 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-04T02:06:38.041 INFO:teuthology.packaging:ref: None 2024-05-04T02:06:38.041 INFO:teuthology.packaging:tag: None 2024-05-04T02:06:38.041 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240503.163550-debug 2024-05-04T02:06:38.041 INFO:teuthology.packaging:sha1: bd4e00a39d766328b458e4c953f4d722fed96a31 2024-05-04T02:06:38.041 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20240503.163550-debug 2024-05-04T02:06:38.264 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3522.gbd4e00a3 2024-05-04T02:06:38.265 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-04T02:06:38.272 INFO:teuthology.task.internal:no buildpackages task found 2024-05-04T02:06:38.272 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-04T02:06:38.291 INFO:teuthology.task.internal:Saving configuration 2024-05-04T02:06:38.308 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-04T02:06:38.340 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-04T02:06:38.363 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi001.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-03_22:48:16-fs-wip-pdonnell-testing-20240503.163550-debug-distro-default-smithi/7688562', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-04 02:01:30.066948', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF55OzKoge4QPDEevlgqCVMWMfvVHUB6+YFlVwku1bhkaEPttZJuylFH6nbpUiYo12d6qxlh2cPV0SIkepABmM8='} 2024-05-04T02:06:38.387 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi107.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-03_22:48:16-fs-wip-pdonnell-testing-20240503.163550-debug-distro-default-smithi/7688562', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-04 02:01:30.068616', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA4xcPEYtr1bBomnLSjGJy+NHsxQ/PBA8j2oF1uVarAT/doN9ZyECMmCs4L6LkrOhYyKr8RcP+DZji6rC9n6C6c='} 2024-05-04T02:06:38.387 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-04T02:06:38.393 INFO:teuthology.task.internal:roles: ubuntu@smithi001.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-05-04T02:06:38.394 INFO:teuthology.task.internal:roles: ubuntu@smithi107.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-05-04T02:06:38.394 INFO:teuthology.run_tasks:Running task console_log... 2024-05-04T02:06:38.462 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f4c05429f70>, signals=[15]) 2024-05-04T02:06:38.462 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-04T02:06:38.468 INFO:teuthology.task.internal:Opening connections... 2024-05-04T02:06:38.468 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi001.front.sepia.ceph.com 2024-05-04T02:06:38.470 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-04T02:06:38.550 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi107.front.sepia.ceph.com 2024-05-04T02:06:38.551 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-04T02:06:38.623 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-04T02:06:38.630 DEBUG:teuthology.orchestra.run.smithi001:> uname -m 2024-05-04T02:06:38.649 INFO:teuthology.orchestra.run.smithi001.stdout:x86_64 2024-05-04T02:06:38.649 DEBUG:teuthology.orchestra.run.smithi001:> cat /etc/os-release 2024-05-04T02:06:38.706 INFO:teuthology.orchestra.run.smithi001.stdout:NAME="CentOS Stream" 2024-05-04T02:06:38.706 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION="9" 2024-05-04T02:06:38.706 INFO:teuthology.orchestra.run.smithi001.stdout:ID="centos" 2024-05-04T02:06:38.706 INFO:teuthology.orchestra.run.smithi001.stdout:ID_LIKE="rhel fedora" 2024-05-04T02:06:38.706 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION_ID="9" 2024-05-04T02:06:38.706 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM_ID="platform:el9" 2024-05-04T02:06:38.707 INFO:teuthology.orchestra.run.smithi001.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-04T02:06:38.707 INFO:teuthology.orchestra.run.smithi001.stdout:ANSI_COLOR="0;31" 2024-05-04T02:06:38.707 INFO:teuthology.orchestra.run.smithi001.stdout:LOGO="fedora-logo-icon" 2024-05-04T02:06:38.707 INFO:teuthology.orchestra.run.smithi001.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-04T02:06:38.707 INFO:teuthology.orchestra.run.smithi001.stdout:HOME_URL="https://centos.org/" 2024-05-04T02:06:38.707 INFO:teuthology.orchestra.run.smithi001.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-04T02:06:38.707 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-04T02:06:38.707 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-04T02:06:38.708 INFO:teuthology.lock.ops:Updating smithi001.front.sepia.ceph.com on lock server 2024-05-04T02:06:38.732 DEBUG:teuthology.orchestra.run.smithi107:> uname -m 2024-05-04T02:06:38.749 INFO:teuthology.orchestra.run.smithi107.stdout:x86_64 2024-05-04T02:06:38.749 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release 2024-05-04T02:06:38.805 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="CentOS Stream" 2024-05-04T02:06:38.805 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="9" 2024-05-04T02:06:38.805 INFO:teuthology.orchestra.run.smithi107.stdout:ID="centos" 2024-05-04T02:06:38.806 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE="rhel fedora" 2024-05-04T02:06:38.806 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="9" 2024-05-04T02:06:38.806 INFO:teuthology.orchestra.run.smithi107.stdout:PLATFORM_ID="platform:el9" 2024-05-04T02:06:38.806 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-04T02:06:38.806 INFO:teuthology.orchestra.run.smithi107.stdout:ANSI_COLOR="0;31" 2024-05-04T02:06:38.806 INFO:teuthology.orchestra.run.smithi107.stdout:LOGO="fedora-logo-icon" 2024-05-04T02:06:38.806 INFO:teuthology.orchestra.run.smithi107.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-04T02:06:38.806 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://centos.org/" 2024-05-04T02:06:38.806 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-04T02:06:38.806 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-04T02:06:38.806 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-04T02:06:38.807 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2024-05-04T02:06:38.832 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-04T02:06:38.841 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-04T02:06:38.847 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-04T02:06:38.847 DEBUG:teuthology.orchestra.run.smithi001:> test '!' -e /home/ubuntu/cephtest 2024-05-04T02:06:38.850 DEBUG:teuthology.orchestra.run.smithi107:> test '!' -e /home/ubuntu/cephtest 2024-05-04T02:06:38.866 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-04T02:06:38.872 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-04T02:06:38.872 DEBUG:teuthology.orchestra.run.smithi001:> test -z $(ls -A /var/lib/ceph) 2024-05-04T02:06:38.907 DEBUG:teuthology.orchestra.run.smithi107:> test -z $(ls -A /var/lib/ceph) 2024-05-04T02:06:39.012 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-04T02:06:39.066 INFO:teuthology.run_tasks:Running task kernel... 2024-05-04T02:06:39.081 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-05-04T02:06:39.081 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-05-04T02:06:39.081 DEBUG:teuthology.orchestra.run.smithi001:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-04T02:06:39.081 DEBUG:teuthology.orchestra.run.smithi107:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-04T02:06:39.098 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-04T02:06:39.098 DEBUG:teuthology.orchestra.run.smithi107:> uname -r 2024-05-04T02:06:39.099 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-04T02:06:39.099 DEBUG:teuthology.orchestra.run.smithi001:> uname -r 2024-05-04T02:06:39.155 INFO:teuthology.orchestra.run.smithi107.stdout:5.14.0-437.el9.x86_64 2024-05-04T02:06:39.156 INFO:teuthology.task.kernel:Running kernel on smithi107: 5.14.0-437.el9.x86_64 2024-05-04T02:06:39.156 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum install -y kernel 2024-05-04T02:06:39.157 INFO:teuthology.orchestra.run.smithi001.stdout:5.14.0-437.el9.x86_64 2024-05-04T02:06:39.157 INFO:teuthology.task.kernel:Running kernel on smithi001: 5.14.0-437.el9.x86_64 2024-05-04T02:06:39.157 DEBUG:teuthology.orchestra.run.smithi001:> sudo yum install -y kernel 2024-05-04T02:06:41.282 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.0 MB 00:00 2024-05-04T02:06:41.416 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.0 MB 00:00 2024-05-04T02:06:43.141 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - AppStream 24 MB/s | 19 MB 00:00 2024-05-04T02:06:47.552 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - CRB 7.2 MB/s | 6.2 MB 00:00 2024-05-04T02:06:48.909 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - Extras packages 75 kB/s | 16 kB 00:00 2024-05-04T02:06:50.169 INFO:teuthology.orchestra.run.smithi107.stdout:Extra Packages for Enterprise Linux 18 MB/s | 21 MB 00:01 2024-05-04T02:06:50.966 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - AppStream 2.3 MB/s | 19 MB 00:08 2024-05-04T02:06:55.327 INFO:teuthology.orchestra.run.smithi107.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2024-05-04T02:06:56.917 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - CRB 2.8 MB/s | 6.2 MB 00:02 2024-05-04T02:06:57.250 INFO:teuthology.orchestra.run.smithi107.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-05-04T02:06:57.250 INFO:teuthology.orchestra.run.smithi107.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-05-04T02:06:57.337 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-05-04T02:06:57.338 INFO:teuthology.orchestra.run.smithi107.stdout:Nothing to do. 2024-05-04T02:06:57.338 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-05-04T02:06:57.444 DEBUG:teuthology.orchestra.run.smithi107:> echo no | sudo yum reinstall kernel || true 2024-05-04T02:06:57.942 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:00:02 ago on Sat 04 May 2024 02:06:55 AM UTC. 2024-05-04T02:06:58.062 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-05-04T02:06:58.074 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-05-04T02:06:58.074 INFO:teuthology.orchestra.run.smithi107.stdout: Package Architecture Version Repository Size 2024-05-04T02:06:58.074 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-05-04T02:06:58.074 INFO:teuthology.orchestra.run.smithi107.stdout:Reinstalling: 2024-05-04T02:06:58.074 INFO:teuthology.orchestra.run.smithi107.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-05-04T02:06:58.074 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-04T02:06:58.074 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2024-05-04T02:06:58.074 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-05-04T02:06:58.074 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-04T02:06:58.074 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 255 k 2024-05-04T02:06:58.074 INFO:teuthology.orchestra.run.smithi107.stdout:Installed size: 0 2024-05-04T02:06:58.075 INFO:teuthology.orchestra.run.smithi107.stderr:Operation aborted. 2024-05-04T02:06:58.142 INFO:teuthology.orchestra.run.smithi107.stdout:Is this ok [y/N]: 2024-05-04T02:06:58.143 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum reinstall -y kernel || true 2024-05-04T02:06:58.637 INFO:teuthology.orchestra.run.smithi107.stdout:Last metadata expiration check: 0:00:03 ago on Sat 04 May 2024 02:06:55 AM UTC. 2024-05-04T02:06:58.753 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-05-04T02:06:58.753 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-05-04T02:06:58.753 INFO:teuthology.orchestra.run.smithi107.stdout: Package Architecture Version Repository Size 2024-05-04T02:06:58.754 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-05-04T02:06:58.754 INFO:teuthology.orchestra.run.smithi107.stdout:Reinstalling: 2024-05-04T02:06:58.754 INFO:teuthology.orchestra.run.smithi107.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-05-04T02:06:58.754 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-04T02:06:58.754 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2024-05-04T02:06:58.754 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-05-04T02:06:58.754 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-04T02:06:58.754 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 255 k 2024-05-04T02:06:58.754 INFO:teuthology.orchestra.run.smithi107.stdout:Installed size: 0 2024-05-04T02:06:58.754 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2024-05-04T02:06:59.367 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - Extras packages 13 kB/s | 16 kB 00:01 2024-05-04T02:06:59.512 INFO:teuthology.orchestra.run.smithi107.stdout:kernel-5.14.0-437.el9.x86_64.rpm 532 kB/s | 255 kB 00:00 2024-05-04T02:06:59.512 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2024-05-04T02:06:59.512 INFO:teuthology.orchestra.run.smithi107.stdout:Total 336 kB/s | 255 kB 00:00 2024-05-04T02:06:59.532 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2024-05-04T02:06:59.705 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2024-05-04T02:06:59.706 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2024-05-04T02:06:59.710 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2024-05-04T02:06:59.711 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2024-05-04T02:06:59.850 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2024-05-04T02:06:59.921 INFO:teuthology.orchestra.run.smithi107.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-05-04T02:06:59.921 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-05-04T02:07:00.649 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-05-04T02:07:00.649 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-05-04T02:07:00.685 INFO:teuthology.orchestra.run.smithi001.stdout:Extra Packages for Enterprise Linux 18 MB/s | 21 MB 00:01 2024-05-04T02:07:01.399 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-05-04T02:07:01.399 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-04T02:07:01.399 INFO:teuthology.orchestra.run.smithi107.stdout:Reinstalled: 2024-05-04T02:07:01.399 INFO:teuthology.orchestra.run.smithi107.stdout: kernel-5.14.0-437.el9.x86_64 2024-05-04T02:07:01.399 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-04T02:07:01.400 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-05-04T02:07:01.590 DEBUG:teuthology.orchestra.run.smithi107:> rpm -q kernel | sort -rV | head -n 1 2024-05-04T02:07:01.636 INFO:teuthology.orchestra.run.smithi107.stdout:kernel-5.14.0-437.el9.x86_64 2024-05-04T02:07:01.636 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-05-04T02:07:01.636 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-05-04T02:07:01.636 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-05-04T02:07:01.636 DEBUG:teuthology.orchestra.run.smithi107:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-04T02:07:01.668 INFO:teuthology.orchestra.run.smithi107.stdout:ttyS1 2024-05-04T02:07:01.686 DEBUG:teuthology.parallel:result is None 2024-05-04T02:07:05.936 INFO:teuthology.orchestra.run.smithi001.stdout:lab-extras 49 kB/s | 1.7 kB 00:00 2024-05-04T02:07:07.909 INFO:teuthology.orchestra.run.smithi001.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-05-04T02:07:07.909 INFO:teuthology.orchestra.run.smithi001.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-05-04T02:07:08.006 INFO:teuthology.orchestra.run.smithi001.stdout:Dependencies resolved. 2024-05-04T02:07:08.007 INFO:teuthology.orchestra.run.smithi001.stdout:Nothing to do. 2024-05-04T02:07:08.007 INFO:teuthology.orchestra.run.smithi001.stdout:Complete! 2024-05-04T02:07:08.113 DEBUG:teuthology.orchestra.run.smithi001:> echo no | sudo yum reinstall kernel || true 2024-05-04T02:07:08.633 INFO:teuthology.orchestra.run.smithi001.stdout:Last metadata expiration check: 0:00:03 ago on Sat 04 May 2024 02:07:05 AM UTC. 2024-05-04T02:07:08.758 INFO:teuthology.orchestra.run.smithi001.stdout:Dependencies resolved. 2024-05-04T02:07:08.765 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2024-05-04T02:07:08.765 INFO:teuthology.orchestra.run.smithi001.stdout: Package Architecture Version Repository Size 2024-05-04T02:07:08.765 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2024-05-04T02:07:08.765 INFO:teuthology.orchestra.run.smithi001.stdout:Reinstalling: 2024-05-04T02:07:08.765 INFO:teuthology.orchestra.run.smithi001.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-05-04T02:07:08.766 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:07:08.766 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction Summary 2024-05-04T02:07:08.766 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2024-05-04T02:07:08.766 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:07:08.766 INFO:teuthology.orchestra.run.smithi001.stdout:Total download size: 255 k 2024-05-04T02:07:08.766 INFO:teuthology.orchestra.run.smithi001.stdout:Installed size: 0 2024-05-04T02:07:08.766 INFO:teuthology.orchestra.run.smithi001.stderr:Operation aborted. 2024-05-04T02:07:08.839 INFO:teuthology.orchestra.run.smithi001.stdout:Is this ok [y/N]: 2024-05-04T02:07:08.839 DEBUG:teuthology.orchestra.run.smithi001:> sudo yum reinstall -y kernel || true 2024-05-04T02:07:09.357 INFO:teuthology.orchestra.run.smithi001.stdout:Last metadata expiration check: 0:00:04 ago on Sat 04 May 2024 02:07:05 AM UTC. 2024-05-04T02:07:09.477 INFO:teuthology.orchestra.run.smithi001.stdout:Dependencies resolved. 2024-05-04T02:07:09.478 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2024-05-04T02:07:09.478 INFO:teuthology.orchestra.run.smithi001.stdout: Package Architecture Version Repository Size 2024-05-04T02:07:09.478 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2024-05-04T02:07:09.478 INFO:teuthology.orchestra.run.smithi001.stdout:Reinstalling: 2024-05-04T02:07:09.478 INFO:teuthology.orchestra.run.smithi001.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-05-04T02:07:09.478 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:07:09.478 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction Summary 2024-05-04T02:07:09.478 INFO:teuthology.orchestra.run.smithi001.stdout:================================================================================ 2024-05-04T02:07:09.478 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:07:09.479 INFO:teuthology.orchestra.run.smithi001.stdout:Total download size: 255 k 2024-05-04T02:07:09.479 INFO:teuthology.orchestra.run.smithi001.stdout:Installed size: 0 2024-05-04T02:07:09.479 INFO:teuthology.orchestra.run.smithi001.stdout:Downloading Packages: 2024-05-04T02:07:09.654 INFO:teuthology.orchestra.run.smithi001.stdout:kernel-5.14.0-437.el9.x86_64.rpm 2.2 MB/s | 255 kB 00:00 2024-05-04T02:07:09.654 INFO:teuthology.orchestra.run.smithi001.stdout:-------------------------------------------------------------------------------- 2024-05-04T02:07:09.654 INFO:teuthology.orchestra.run.smithi001.stdout:Total 1.4 MB/s | 255 kB 00:00 2024-05-04T02:07:09.673 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction check 2024-05-04T02:07:09.870 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction check succeeded. 2024-05-04T02:07:09.870 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction test 2024-05-04T02:07:09.875 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction test succeeded. 2024-05-04T02:07:09.876 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction 2024-05-04T02:07:10.014 INFO:teuthology.orchestra.run.smithi001.stdout: Preparing : 1/1 2024-05-04T02:07:10.080 INFO:teuthology.orchestra.run.smithi001.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-05-04T02:07:10.080 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-05-04T02:07:10.730 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-05-04T02:07:10.730 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-05-04T02:07:11.480 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-05-04T02:07:11.480 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:07:11.480 INFO:teuthology.orchestra.run.smithi001.stdout:Reinstalled: 2024-05-04T02:07:11.480 INFO:teuthology.orchestra.run.smithi001.stdout: kernel-5.14.0-437.el9.x86_64 2024-05-04T02:07:11.480 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:07:11.481 INFO:teuthology.orchestra.run.smithi001.stdout:Complete! 2024-05-04T02:07:11.677 DEBUG:teuthology.orchestra.run.smithi001:> rpm -q kernel | sort -rV | head -n 1 2024-05-04T02:07:11.726 INFO:teuthology.orchestra.run.smithi001.stdout:kernel-5.14.0-437.el9.x86_64 2024-05-04T02:07:11.726 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-05-04T02:07:11.726 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-05-04T02:07:11.726 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-05-04T02:07:11.727 DEBUG:teuthology.orchestra.run.smithi001:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-04T02:07:11.758 INFO:teuthology.orchestra.run.smithi001.stdout:ttyS1 2024-05-04T02:07:11.784 DEBUG:teuthology.parallel:result is None 2024-05-04T02:07:11.784 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-04T02:07:11.792 INFO:teuthology.task.internal:Creating test directory... 2024-05-04T02:07:11.792 DEBUG:teuthology.orchestra.run.smithi001:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-04T02:07:11.826 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-04T02:07:11.843 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-04T02:07:11.850 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-04T02:07:11.860 INFO:teuthology.task.internal:Creating archive directory... 2024-05-04T02:07:11.861 DEBUG:teuthology.orchestra.run.smithi001:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-04T02:07:11.881 DEBUG:teuthology.orchestra.run.smithi107:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-04T02:07:11.922 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-04T02:07:11.930 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-04T02:07:11.930 DEBUG:teuthology.orchestra.run.smithi001:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-04T02:07:11.945 DEBUG:teuthology.orchestra.run.smithi107:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-04T02:07:11.977 INFO:teuthology.orchestra.run.smithi001.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-04T02:07:11.987 INFO:teuthology.orchestra.run.smithi001.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-04T02:07:11.993 INFO:teuthology.orchestra.run.smithi107.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-04T02:07:12.003 INFO:teuthology.orchestra.run.smithi107.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-04T02:07:12.005 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-04T02:07:12.012 INFO:teuthology.task.internal:Configuring sudo... 2024-05-04T02:07:12.013 DEBUG:teuthology.orchestra.run.smithi001:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-04T02:07:12.031 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-04T02:07:12.072 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-04T02:07:12.080 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-04T02:07:12.080 DEBUG:teuthology.orchestra.run.smithi001:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-04T02:07:12.095 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-04T02:07:12.128 DEBUG:teuthology.orchestra.run.smithi001:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-04T02:07:12.185 DEBUG:teuthology.orchestra.run.smithi001:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-04T02:07:12.234 DEBUG:teuthology.orchestra.run.smithi001:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-04T02:07:12.312 DEBUG:teuthology.orchestra.run.smithi001:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-04T02:07:12.355 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-05-04T02:07:12.355 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-04T02:07:12.420 DEBUG:teuthology.orchestra.run.smithi107:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-04T02:07:12.462 DEBUG:teuthology.orchestra.run.smithi107:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-04T02:07:12.510 DEBUG:teuthology.orchestra.run.smithi107:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-04T02:07:12.593 DEBUG:teuthology.orchestra.run.smithi107:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-04T02:07:12.637 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-04T02:07:12.637 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-04T02:07:12.703 DEBUG:teuthology.orchestra.run.smithi001:> sudo service rsyslog restart 2024-05-04T02:07:12.705 DEBUG:teuthology.orchestra.run.smithi107:> sudo service rsyslog restart 2024-05-04T02:07:12.743 INFO:teuthology.orchestra.run.smithi001.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-04T02:07:12.778 INFO:teuthology.orchestra.run.smithi107.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-04T02:07:13.135 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-04T02:07:13.144 INFO:teuthology.task.internal:Starting timer... 2024-05-04T02:07:13.144 INFO:teuthology.run_tasks:Running task pcp... 2024-05-04T02:07:13.154 INFO:teuthology.run_tasks:Running task selinux... 2024-05-04T02:07:13.162 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-05-04T02:07:13.162 DEBUG:teuthology.orchestra.run.smithi001:> sudo service auditd rotate 2024-05-04T02:07:13.238 INFO:teuthology.orchestra.run.smithi001.stdout:Rotating logs: 2024-05-04T02:07:13.240 DEBUG:teuthology.orchestra.run.smithi107:> sudo service auditd rotate 2024-05-04T02:07:13.298 INFO:teuthology.orchestra.run.smithi107.stdout:Rotating logs: 2024-05-04T02:07:13.300 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-04T02:07:13.300 DEBUG:teuthology.orchestra.run.smithi001:> /usr/sbin/getenforce 2024-05-04T02:07:13.323 INFO:teuthology.orchestra.run.smithi001.stdout:Permissive 2024-05-04T02:07:13.323 DEBUG:teuthology.orchestra.run.smithi107:> /usr/sbin/getenforce 2024-05-04T02:07:13.343 INFO:teuthology.orchestra.run.smithi107.stdout:Permissive 2024-05-04T02:07:13.343 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi001.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi107.front.sepia.ceph.com': 'permissive'} 2024-05-04T02:07:13.343 DEBUG:teuthology.orchestra.run.smithi001:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-04T02:07:13.387 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-04T02:07:13.388 DEBUG:teuthology.orchestra.run.smithi107:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-04T02:07:13.411 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-04T02:07:13.411 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-04T02:07:13.412 DEBUG:teuthology.orchestra.run.smithi001:> sudo /usr/sbin/setenforce permissive 2024-05-04T02:07:13.458 DEBUG:teuthology.orchestra.run.smithi107:> sudo /usr/sbin/setenforce permissive 2024-05-04T02:07:13.481 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-04T02:07:13.491 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-04T02:07:13.506 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-04T02:07:13.508 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi001.front.sepia.ceph.com,smithi107.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-04T02:11:04.683 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi001.front.sepia.ceph.com'), Remote(name='ubuntu@smithi107.front.sepia.ceph.com')] 2024-05-04T02:11:04.684 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi001.front.sepia.ceph.com' 2024-05-04T02:11:04.685 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-04T02:11:04.765 DEBUG:teuthology.orchestra.run.smithi001:> true 2024-05-04T02:11:04.849 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi001.front.sepia.ceph.com' 2024-05-04T02:11:04.850 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-05-04T02:11:04.851 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-04T02:11:04.926 DEBUG:teuthology.orchestra.run.smithi107:> true 2024-05-04T02:11:05.001 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-05-04T02:11:05.002 INFO:teuthology.run_tasks:Running task clock... 2024-05-04T02:11:05.012 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-04T02:11:05.012 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-04T02:11:05.013 DEBUG:teuthology.orchestra.run.smithi001:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-04T02:11:05.015 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-04T02:11:05.015 DEBUG:teuthology.orchestra.run.smithi107:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-04T02:11:05.042 INFO:teuthology.orchestra.run.smithi001.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-04T02:11:05.057 INFO:teuthology.orchestra.run.smithi001.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-04T02:11:05.071 INFO:teuthology.orchestra.run.smithi107.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-04T02:11:05.081 INFO:teuthology.orchestra.run.smithi001.stderr:sudo: ntpd: command not found 2024-05-04T02:11:05.084 INFO:teuthology.orchestra.run.smithi107.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-04T02:11:05.092 INFO:teuthology.orchestra.run.smithi001.stdout:506 Cannot talk to daemon 2024-05-04T02:11:05.106 INFO:teuthology.orchestra.run.smithi001.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-04T02:11:05.106 INFO:teuthology.orchestra.run.smithi107.stderr:sudo: ntpd: command not found 2024-05-04T02:11:05.116 INFO:teuthology.orchestra.run.smithi107.stdout:506 Cannot talk to daemon 2024-05-04T02:11:05.119 INFO:teuthology.orchestra.run.smithi001.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-04T02:11:05.133 INFO:teuthology.orchestra.run.smithi107.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-04T02:11:05.142 INFO:teuthology.orchestra.run.smithi107.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-04T02:11:05.176 INFO:teuthology.orchestra.run.smithi001.stderr:bash: line 1: ntpq: command not found 2024-05-04T02:11:05.180 INFO:teuthology.orchestra.run.smithi001.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-04T02:11:05.180 INFO:teuthology.orchestra.run.smithi001.stdout:=============================================================================== 2024-05-04T02:11:05.180 INFO:teuthology.orchestra.run.smithi001.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-04T02:11:05.180 INFO:teuthology.orchestra.run.smithi001.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-04T02:11:05.180 INFO:teuthology.orchestra.run.smithi001.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-04T02:11:05.180 INFO:teuthology.orchestra.run.smithi001.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-04T02:11:05.194 INFO:teuthology.orchestra.run.smithi107.stderr:bash: line 1: ntpq: command not found 2024-05-04T02:11:05.197 INFO:teuthology.orchestra.run.smithi107.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-04T02:11:05.197 INFO:teuthology.orchestra.run.smithi107.stdout:=============================================================================== 2024-05-04T02:11:05.197 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-04T02:11:05.197 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-04T02:11:05.197 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-04T02:11:05.198 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-04T02:11:05.199 INFO:teuthology.run_tasks:Running task install... 2024-05-04T02:11:05.207 DEBUG:teuthology.task.install:project ceph 2024-05-04T02:11:05.207 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': 'bd4e00a39d766328b458e4c953f4d722fed96a31'}} 2024-05-04T02:11:05.207 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'debuginfo': True, 'flavor': 'default', 'sha1': 'bd4e00a39d766328b458e4c953f4d722fed96a31'} 2024-05-04T02:11:05.207 INFO:teuthology.task.install:Using flavor: default 2024-05-04T02:11:05.213 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse', 'ceph-common-dbg', 'ceph-fuse-dbg', 'ceph-mds-dbg', 'ceph-mgr-dbg', 'ceph-mon-dbg', 'ceph-osd-dbg', 'ceph-test-dbg', 'libcephfs2-dbg', 'librados2-dbg', 'libradosstriper1-dbg', 'librbd1-dbg', 'librgw2-dbg', 'radosgw-dbg', 'rbd-fuse-dbg', 'rbd-mirror-dbg', 'rbd-nbd-dbg'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd', 'ceph-base-debuginfo', 'ceph-common-debuginfo', 'ceph-immutable-object-cache-debuginfo', 'ceph-radosgw-debuginfo', 'ceph-test-debuginfo', 'ceph-base-debuginfo', 'ceph-mgr-debuginfo', 'ceph-mds-debuginfo', 'ceph-mon-debuginfo', 'ceph-osd-debuginfo', 'ceph-fuse-debuginfo', 'librados-devel-debuginfo', 'libcephfs2-debuginfo', 'librados2-debuginfo', 'librbd1-debuginfo', 'python3-cephfs-debuginfo', 'python3-rados-debuginfo', 'python3-rbd-debuginfo', 'python3-rgw-debuginfo', 'rbd-fuse-debuginfo', 'rbd-mirror-debuginfo', 'rbd-nbd-debuginfo']} 2024-05-04T02:11:05.213 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-05-04T02:11:05.214 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bd4e00a39d766328b458e4c953f4d722fed96a31', 'tag': None, 'wait_for_package': False} 2024-05-04T02:11:05.214 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bd4e00a39d766328b458e4c953f4d722fed96a31 2024-05-04T02:11:05.216 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bd4e00a39d766328b458e4c953f4d722fed96a31', 'tag': None, 'wait_for_package': False} 2024-05-04T02:11:05.216 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bd4e00a39d766328b458e4c953f4d722fed96a31 2024-05-04T02:11:05.366 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/centos/9/flavors/default/ 2024-05-04T02:11:05.366 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3522.gbd4e00a3 2024-05-04T02:11:05.449 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/centos/9/flavors/default/ 2024-05-04T02:11:05.449 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3522.gbd4e00a3 2024-05-04T02:11:05.553 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-04T02:11:05.554 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-05-04T02:11:05.554 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-04T02:11:05.580 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-04T02:11:05.580 DEBUG:teuthology.orchestra.run.smithi001:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bd4e00a39d766328b458e4c953f4d722fed96a31/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-04T02:11:05.628 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240503.163550-debug/bd4e00a39d766328b458e4c953f4d722fed96a31/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-04T02:11:05.628 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-04T02:11:05.628 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-04T02:11:05.646 DEBUG:teuthology.orchestra.run.smithi001:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-04T02:11:05.653 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-04T02:11:05.653 DEBUG:teuthology.orchestra.run.smithi107:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bd4e00a39d766328b458e4c953f4d722fed96a31/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-04T02:11:05.718 DEBUG:teuthology.orchestra.run.smithi107:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-04T02:11:05.721 DEBUG:teuthology.orchestra.run.smithi001:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-04T02:11:05.785 INFO:teuthology.orchestra.run.smithi001.stdout:check_obsoletes = 1 2024-05-04T02:11:05.787 DEBUG:teuthology.orchestra.run.smithi001:> sudo yum clean all 2024-05-04T02:11:05.790 DEBUG:teuthology.orchestra.run.smithi107:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-04T02:11:05.853 INFO:teuthology.orchestra.run.smithi107.stdout:check_obsoletes = 1 2024-05-04T02:11:05.855 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum clean all 2024-05-04T02:11:06.021 INFO:teuthology.orchestra.run.smithi001.stdout:50 files removed 2024-05-04T02:11:06.049 DEBUG:teuthology.orchestra.run.smithi001:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd ceph-base-debuginfo ceph-common-debuginfo ceph-immutable-object-cache-debuginfo ceph-radosgw-debuginfo ceph-test-debuginfo ceph-base-debuginfo ceph-mgr-debuginfo ceph-mds-debuginfo ceph-mon-debuginfo ceph-osd-debuginfo ceph-fuse-debuginfo librados-devel-debuginfo libcephfs2-debuginfo librados2-debuginfo librbd1-debuginfo python3-cephfs-debuginfo python3-rados-debuginfo python3-rbd-debuginfo python3-rgw-debuginfo rbd-fuse-debuginfo rbd-mirror-debuginfo rbd-nbd-debuginfo python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-04T02:11:06.079 INFO:teuthology.orchestra.run.smithi107.stdout:50 files removed 2024-05-04T02:11:06.106 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd ceph-base-debuginfo ceph-common-debuginfo ceph-immutable-object-cache-debuginfo ceph-radosgw-debuginfo ceph-test-debuginfo ceph-base-debuginfo ceph-mgr-debuginfo ceph-mds-debuginfo ceph-mon-debuginfo ceph-osd-debuginfo ceph-fuse-debuginfo librados-devel-debuginfo libcephfs2-debuginfo librados2-debuginfo librbd1-debuginfo python3-cephfs-debuginfo python3-rados-debuginfo python3-rbd-debuginfo python3-rgw-debuginfo rbd-fuse-debuginfo rbd-mirror-debuginfo rbd-nbd-debuginfo python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-04T02:11:06.722 INFO:teuthology.orchestra.run.smithi107.stdout:ceph packages for x86_64 236 kB/s | 84 kB 00:00 2024-05-04T02:11:06.801 INFO:teuthology.orchestra.run.smithi001.stdout:ceph packages for x86_64 175 kB/s | 84 kB 00:00 2024-05-04T02:11:07.081 INFO:teuthology.orchestra.run.smithi107.stdout:ceph noarch packages 37 kB/s | 12 kB 00:00 2024-05-04T02:11:07.168 INFO:teuthology.orchestra.run.smithi001.stdout:ceph noarch packages 37 kB/s | 12 kB 00:00 2024-05-04T02:11:07.503 INFO:teuthology.orchestra.run.smithi001.stdout:ceph source packages 6.4 kB/s | 1.9 kB 00:00 2024-05-04T02:11:07.507 INFO:teuthology.orchestra.run.smithi107.stdout:ceph source packages 4.9 kB/s | 1.9 kB 00:00 2024-05-04T02:11:08.128 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.0 MB 00:00 2024-05-04T02:11:09.157 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - BaseOS 5.0 MB/s | 8.0 MB 00:01 2024-05-04T02:11:11.429 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - AppStream 8.7 MB/s | 19 MB 00:02 2024-05-04T02:11:12.458 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - AppStream 8.5 MB/s | 19 MB 00:02 2024-05-04T02:11:15.613 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.2 MB 00:00 2024-05-04T02:11:16.794 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - CRB 8.0 MB/s | 6.2 MB 00:00 2024-05-04T02:11:17.306 INFO:teuthology.orchestra.run.smithi001.stdout:CentOS Stream 9 - Extras packages 33 kB/s | 16 kB 00:00 2024-05-04T02:11:18.300 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - Extras packages 45 kB/s | 16 kB 00:00 2024-05-04T02:11:18.933 INFO:teuthology.orchestra.run.smithi001.stdout:Extra Packages for Enterprise Linux 14 MB/s | 21 MB 00:01 2024-05-04T02:11:20.530 INFO:teuthology.orchestra.run.smithi107.stdout:Extra Packages for Enterprise Linux 9.9 MB/s | 21 MB 00:02 2024-05-04T02:11:24.240 INFO:teuthology.orchestra.run.smithi001.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-05-04T02:11:25.493 INFO:teuthology.orchestra.run.smithi107.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-05-04T02:11:26.460 INFO:teuthology.orchestra.run.smithi001.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-04T02:11:26.460 INFO:teuthology.orchestra.run.smithi001.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-04T02:11:26.488 INFO:teuthology.orchestra.run.smithi001.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-04T02:11:26.489 INFO:teuthology.orchestra.run.smithi001.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-04T02:11:26.489 INFO:teuthology.orchestra.run.smithi001.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-04T02:11:26.490 INFO:teuthology.orchestra.run.smithi001.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-04T02:11:26.492 INFO:teuthology.orchestra.run.smithi001.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-04T02:11:26.494 INFO:teuthology.orchestra.run.smithi001.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-04T02:11:26.495 INFO:teuthology.orchestra.run.smithi001.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-04T02:11:26.563 INFO:teuthology.orchestra.run.smithi001.stdout:Dependencies resolved. 2024-05-04T02:11:26.574 INFO:teuthology.orchestra.run.smithi001.stdout:=============================================================================================== 2024-05-04T02:11:26.575 INFO:teuthology.orchestra.run.smithi001.stdout: Package Arch Version Repository Size 2024-05-04T02:11:26.575 INFO:teuthology.orchestra.run.smithi001.stdout:=============================================================================================== 2024-05-04T02:11:26.575 INFO:teuthology.orchestra.run.smithi001.stdout:Installing: 2024-05-04T02:11:26.575 INFO:teuthology.orchestra.run.smithi001.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-04T02:11:26.575 INFO:teuthology.orchestra.run.smithi001.stdout: ceph x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 6.6 k 2024-05-04T02:11:26.575 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-base x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 5.4 M 2024-05-04T02:11:26.575 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-base-debuginfo x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 70 M 2024-05-04T02:11:26.575 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-common-debuginfo x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 420 M 2024-05-04T02:11:26.575 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-fuse x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 863 k 2024-05-04T02:11:26.575 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-fuse-debuginfo x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 6.2 M 2024-05-04T02:11:26.575 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 147 k 2024-05-04T02:11:26.575 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 1.5 M 2024-05-04T02:11:26.576 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mds-debuginfo x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 49 M 2024-05-04T02:11:26.576 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 1.5 M 2024-05-04T02:11:26.576 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3522.gbd4e00a3.el9 ceph-noarch 142 k 2024-05-04T02:11:26.576 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3522.gbd4e00a3.el9 ceph-noarch 3.5 M 2024-05-04T02:11:26.576 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-debuginfo x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 21 M 2024-05-04T02:11:26.576 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3522.gbd4e00a3.el9 ceph-noarch 7.4 M 2024-05-04T02:11:26.576 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-rook noarch 2:19.0.0-3522.gbd4e00a3.el9 ceph-noarch 49 k 2024-05-04T02:11:26.576 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mon-debuginfo x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 99 M 2024-05-04T02:11:26.576 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-osd-debuginfo x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 283 M 2024-05-04T02:11:26.576 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-radosgw x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 10 M 2024-05-04T02:11:26.576 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-radosgw-debuginfo x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 192 M 2024-05-04T02:11:26.576 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-test x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 43 M 2024-05-04T02:11:26.576 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-test-debuginfo x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 623 M 2024-05-04T02:11:26.576 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-volume noarch 2:19.0.0-3522.gbd4e00a3.el9 ceph-noarch 273 k 2024-05-04T02:11:26.577 INFO:teuthology.orchestra.run.smithi001.stdout: cephadm noarch 2:19.0.0-3522.gbd4e00a3.el9 ceph-noarch 763 k 2024-05-04T02:11:26.577 INFO:teuthology.orchestra.run.smithi001.stdout: cephfs-mirror x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 224 k 2024-05-04T02:11:26.577 INFO:teuthology.orchestra.run.smithi001.stdout: cephfs-shell x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 27 k 2024-05-04T02:11:26.577 INFO:teuthology.orchestra.run.smithi001.stdout: cephfs-top noarch 2:19.0.0-3522.gbd4e00a3.el9 ceph-noarch 18 k 2024-05-04T02:11:26.577 INFO:teuthology.orchestra.run.smithi001.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-04T02:11:26.577 INFO:teuthology.orchestra.run.smithi001.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-04T02:11:26.577 INFO:teuthology.orchestra.run.smithi001.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-04T02:11:26.577 INFO:teuthology.orchestra.run.smithi001.stdout: libcephfs-devel x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 32 k 2024-05-04T02:11:26.577 INFO:teuthology.orchestra.run.smithi001.stdout: libcephfs2 x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 756 k 2024-05-04T02:11:26.577 INFO:teuthology.orchestra.run.smithi001.stdout: libcephfs2-debuginfo x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 5.4 M 2024-05-04T02:11:26.577 INFO:teuthology.orchestra.run.smithi001.stdout: librados-devel x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 127 k 2024-05-04T02:11:26.577 INFO:teuthology.orchestra.run.smithi001.stdout: librados-devel-debuginfo x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 104 k 2024-05-04T02:11:26.577 INFO:teuthology.orchestra.run.smithi001.stdout: librados2-debuginfo x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 47 M 2024-05-04T02:11:26.578 INFO:teuthology.orchestra.run.smithi001.stdout: librbd1-debuginfo x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 54 M 2024-05-04T02:11:26.578 INFO:teuthology.orchestra.run.smithi001.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-04T02:11:26.578 INFO:teuthology.orchestra.run.smithi001.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-04T02:11:26.578 INFO:teuthology.orchestra.run.smithi001.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-04T02:11:26.578 INFO:teuthology.orchestra.run.smithi001.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-04T02:11:26.578 INFO:teuthology.orchestra.run.smithi001.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-04T02:11:26.578 INFO:teuthology.orchestra.run.smithi001.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-04T02:11:26.578 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cephfs x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 162 k 2024-05-04T02:11:26.578 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cephfs-debuginfo x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 615 k 2024-05-04T02:11:26.578 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rados x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 321 k 2024-05-04T02:11:26.578 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rados-debuginfo x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 771 k 2024-05-04T02:11:26.578 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rbd x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 298 k 2024-05-04T02:11:26.579 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rbd-debuginfo x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 1.1 M 2024-05-04T02:11:26.579 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rgw x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 100 k 2024-05-04T02:11:26.579 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rgw-debuginfo x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 337 k 2024-05-04T02:11:26.579 INFO:teuthology.orchestra.run.smithi001.stdout: rbd-fuse x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 85 k 2024-05-04T02:11:26.579 INFO:teuthology.orchestra.run.smithi001.stdout: rbd-fuse-debuginfo x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 524 k 2024-05-04T02:11:26.579 INFO:teuthology.orchestra.run.smithi001.stdout: rbd-mirror x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 3.0 M 2024-05-04T02:11:26.579 INFO:teuthology.orchestra.run.smithi001.stdout: rbd-mirror-debuginfo x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 53 M 2024-05-04T02:11:26.579 INFO:teuthology.orchestra.run.smithi001.stdout: rbd-nbd x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 170 k 2024-05-04T02:11:26.579 INFO:teuthology.orchestra.run.smithi001.stdout: rbd-nbd-debuginfo x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 1.3 M 2024-05-04T02:11:26.579 INFO:teuthology.orchestra.run.smithi001.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-04T02:11:26.579 INFO:teuthology.orchestra.run.smithi001.stdout:Upgrading: 2024-05-04T02:11:26.579 INFO:teuthology.orchestra.run.smithi001.stdout: librados2 x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 3.3 M 2024-05-04T02:11:26.579 INFO:teuthology.orchestra.run.smithi001.stdout: librbd1 x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 3.1 M 2024-05-04T02:11:26.579 INFO:teuthology.orchestra.run.smithi001.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-04T02:11:26.580 INFO:teuthology.orchestra.run.smithi001.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-04T02:11:26.580 INFO:teuthology.orchestra.run.smithi001.stdout:Installing dependencies: 2024-05-04T02:11:26.580 INFO:teuthology.orchestra.run.smithi001.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-04T02:11:26.580 INFO:teuthology.orchestra.run.smithi001.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-04T02:11:26.580 INFO:teuthology.orchestra.run.smithi001.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-04T02:11:26.580 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-common x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 20 M 2024-05-04T02:11:26.580 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-debuginfo x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 22 M 2024-05-04T02:11:26.580 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3522.gbd4e00a3.el9 ceph-noarch 34 k 2024-05-04T02:11:26.580 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mds x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 2.3 M 2024-05-04T02:11:26.580 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3522.gbd4e00a3.el9 ceph-noarch 274 k 2024-05-04T02:11:26.580 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mon x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 4.9 M 2024-05-04T02:11:26.580 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-osd x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 18 M 2024-05-04T02:11:26.580 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3522.gbd4e00a3.el9 ceph-noarch 16 k 2024-05-04T02:11:26.580 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-selinux x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 25 k 2024-05-04T02:11:26.581 INFO:teuthology.orchestra.run.smithi001.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-04T02:11:26.581 INFO:teuthology.orchestra.run.smithi001.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-04T02:11:26.581 INFO:teuthology.orchestra.run.smithi001.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-04T02:11:26.581 INFO:teuthology.orchestra.run.smithi001.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-04T02:11:26.581 INFO:teuthology.orchestra.run.smithi001.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-04T02:11:26.581 INFO:teuthology.orchestra.run.smithi001.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-04T02:11:26.581 INFO:teuthology.orchestra.run.smithi001.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-04T02:11:26.581 INFO:teuthology.orchestra.run.smithi001.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-04T02:11:26.581 INFO:teuthology.orchestra.run.smithi001.stdout: libcephsqlite x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 158 k 2024-05-04T02:11:26.581 INFO:teuthology.orchestra.run.smithi001.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-04T02:11:26.581 INFO:teuthology.orchestra.run.smithi001.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-04T02:11:26.581 INFO:teuthology.orchestra.run.smithi001.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-04T02:11:26.581 INFO:teuthology.orchestra.run.smithi001.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-04T02:11:26.582 INFO:teuthology.orchestra.run.smithi001.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-04T02:11:26.582 INFO:teuthology.orchestra.run.smithi001.stdout: libradosstriper1 x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 497 k 2024-05-04T02:11:26.582 INFO:teuthology.orchestra.run.smithi001.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-04T02:11:26.582 INFO:teuthology.orchestra.run.smithi001.stdout: librgw2 x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 5.2 M 2024-05-04T02:11:26.582 INFO:teuthology.orchestra.run.smithi001.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-04T02:11:26.582 INFO:teuthology.orchestra.run.smithi001.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-04T02:11:26.582 INFO:teuthology.orchestra.run.smithi001.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-04T02:11:26.582 INFO:teuthology.orchestra.run.smithi001.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-04T02:11:26.582 INFO:teuthology.orchestra.run.smithi001.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-04T02:11:26.582 INFO:teuthology.orchestra.run.smithi001.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-04T02:11:26.582 INFO:teuthology.orchestra.run.smithi001.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-04T02:11:26.582 INFO:teuthology.orchestra.run.smithi001.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-04T02:11:26.583 INFO:teuthology.orchestra.run.smithi001.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-04T02:11:26.583 INFO:teuthology.orchestra.run.smithi001.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-04T02:11:26.583 INFO:teuthology.orchestra.run.smithi001.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-04T02:11:26.583 INFO:teuthology.orchestra.run.smithi001.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-04T02:11:26.583 INFO:teuthology.orchestra.run.smithi001.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-04T02:11:26.583 INFO:teuthology.orchestra.run.smithi001.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-04T02:11:26.583 INFO:teuthology.orchestra.run.smithi001.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-04T02:11:26.583 INFO:teuthology.orchestra.run.smithi001.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-04T02:11:26.583 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-04T02:11:26.583 INFO:teuthology.orchestra.run.smithi001.stdout: python3-ceph-argparse x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 45 k 2024-05-04T02:11:26.583 INFO:teuthology.orchestra.run.smithi001.stdout: python3-ceph-common x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 135 k 2024-05-04T02:11:26.583 INFO:teuthology.orchestra.run.smithi001.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-04T02:11:26.583 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-04T02:11:26.584 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-04T02:11:26.584 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-04T02:11:26.584 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-04T02:11:26.584 INFO:teuthology.orchestra.run.smithi001.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-04T02:11:26.584 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-04T02:11:26.584 INFO:teuthology.orchestra.run.smithi001.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-04T02:11:26.584 INFO:teuthology.orchestra.run.smithi001.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-04T02:11:26.584 INFO:teuthology.orchestra.run.smithi001.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-04T02:11:26.584 INFO:teuthology.orchestra.run.smithi001.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-04T02:11:26.584 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-04T02:11:26.584 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-04T02:11:26.584 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-04T02:11:26.584 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-04T02:11:26.584 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-04T02:11:26.585 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-04T02:11:26.585 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-04T02:11:26.585 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-04T02:11:26.585 INFO:teuthology.orchestra.run.smithi001.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-04T02:11:26.585 INFO:teuthology.orchestra.run.smithi001.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-04T02:11:26.585 INFO:teuthology.orchestra.run.smithi001.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-04T02:11:26.585 INFO:teuthology.orchestra.run.smithi001.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-04T02:11:26.585 INFO:teuthology.orchestra.run.smithi001.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-04T02:11:26.585 INFO:teuthology.orchestra.run.smithi001.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-04T02:11:26.585 INFO:teuthology.orchestra.run.smithi001.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-04T02:11:26.585 INFO:teuthology.orchestra.run.smithi001.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-04T02:11:26.585 INFO:teuthology.orchestra.run.smithi001.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-04T02:11:26.585 INFO:teuthology.orchestra.run.smithi001.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-04T02:11:26.585 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-04T02:11:26.586 INFO:teuthology.orchestra.run.smithi001.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-04T02:11:26.586 INFO:teuthology.orchestra.run.smithi001.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-04T02:11:26.586 INFO:teuthology.orchestra.run.smithi001.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-04T02:11:26.586 INFO:teuthology.orchestra.run.smithi001.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-04T02:11:26.586 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-04T02:11:26.586 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-04T02:11:26.586 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-04T02:11:26.586 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-04T02:11:26.586 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-04T02:11:26.586 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-04T02:11:26.586 INFO:teuthology.orchestra.run.smithi001.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-04T02:11:26.586 INFO:teuthology.orchestra.run.smithi001.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-04T02:11:26.586 INFO:teuthology.orchestra.run.smithi001.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-04T02:11:26.586 INFO:teuthology.orchestra.run.smithi001.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-04T02:11:26.586 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-04T02:11:26.587 INFO:teuthology.orchestra.run.smithi001.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-04T02:11:26.587 INFO:teuthology.orchestra.run.smithi001.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-04T02:11:26.587 INFO:teuthology.orchestra.run.smithi001.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-04T02:11:26.587 INFO:teuthology.orchestra.run.smithi001.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-04T02:11:26.587 INFO:teuthology.orchestra.run.smithi001.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-04T02:11:26.587 INFO:teuthology.orchestra.run.smithi001.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-04T02:11:26.587 INFO:teuthology.orchestra.run.smithi001.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-04T02:11:26.587 INFO:teuthology.orchestra.run.smithi001.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-04T02:11:26.587 INFO:teuthology.orchestra.run.smithi001.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-04T02:11:26.587 INFO:teuthology.orchestra.run.smithi001.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-04T02:11:26.587 INFO:teuthology.orchestra.run.smithi001.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-04T02:11:26.587 INFO:teuthology.orchestra.run.smithi001.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-04T02:11:26.587 INFO:teuthology.orchestra.run.smithi001.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-04T02:11:26.587 INFO:teuthology.orchestra.run.smithi001.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-04T02:11:26.590 INFO:teuthology.orchestra.run.smithi001.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-04T02:11:26.590 INFO:teuthology.orchestra.run.smithi001.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-04T02:11:26.590 INFO:teuthology.orchestra.run.smithi001.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-04T02:11:26.590 INFO:teuthology.orchestra.run.smithi001.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-04T02:11:26.590 INFO:teuthology.orchestra.run.smithi001.stdout:Installing weak dependencies: 2024-05-04T02:11:26.590 INFO:teuthology.orchestra.run.smithi001.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-04T02:11:26.590 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:11:26.590 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction Summary 2024-05-04T02:11:26.590 INFO:teuthology.orchestra.run.smithi001.stdout:=============================================================================================== 2024-05-04T02:11:26.591 INFO:teuthology.orchestra.run.smithi001.stdout:Install 170 Packages 2024-05-04T02:11:26.591 INFO:teuthology.orchestra.run.smithi001.stdout:Upgrade 4 Packages 2024-05-04T02:11:26.591 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:11:26.591 INFO:teuthology.orchestra.run.smithi001.stdout:Total download size: 2.1 G 2024-05-04T02:11:26.591 INFO:teuthology.orchestra.run.smithi001.stdout:Downloading Packages: 2024-05-04T02:11:27.594 INFO:teuthology.orchestra.run.smithi107.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-04T02:11:27.595 INFO:teuthology.orchestra.run.smithi107.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-04T02:11:27.622 INFO:teuthology.orchestra.run.smithi107.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-04T02:11:27.622 INFO:teuthology.orchestra.run.smithi107.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-04T02:11:27.622 INFO:teuthology.orchestra.run.smithi107.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-04T02:11:27.623 INFO:teuthology.orchestra.run.smithi107.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-04T02:11:27.624 INFO:teuthology.orchestra.run.smithi107.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-04T02:11:27.626 INFO:teuthology.orchestra.run.smithi107.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-04T02:11:27.627 INFO:teuthology.orchestra.run.smithi107.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-04T02:11:27.689 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-05-04T02:11:27.700 INFO:teuthology.orchestra.run.smithi107.stdout:=============================================================================================== 2024-05-04T02:11:27.700 INFO:teuthology.orchestra.run.smithi107.stdout: Package Arch Version Repository Size 2024-05-04T02:11:27.700 INFO:teuthology.orchestra.run.smithi107.stdout:=============================================================================================== 2024-05-04T02:11:27.700 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2024-05-04T02:11:27.700 INFO:teuthology.orchestra.run.smithi107.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-04T02:11:27.700 INFO:teuthology.orchestra.run.smithi107.stdout: ceph x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 6.6 k 2024-05-04T02:11:27.700 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-base x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 5.4 M 2024-05-04T02:11:27.700 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-base-debuginfo x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 70 M 2024-05-04T02:11:27.700 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-common-debuginfo x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 420 M 2024-05-04T02:11:27.701 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-fuse x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 863 k 2024-05-04T02:11:27.701 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-fuse-debuginfo x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 6.2 M 2024-05-04T02:11:27.701 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 147 k 2024-05-04T02:11:27.701 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 1.5 M 2024-05-04T02:11:27.701 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mds-debuginfo x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 49 M 2024-05-04T02:11:27.701 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 1.5 M 2024-05-04T02:11:27.701 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3522.gbd4e00a3.el9 ceph-noarch 142 k 2024-05-04T02:11:27.701 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3522.gbd4e00a3.el9 ceph-noarch 3.5 M 2024-05-04T02:11:27.701 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-debuginfo x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 21 M 2024-05-04T02:11:27.701 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3522.gbd4e00a3.el9 ceph-noarch 7.4 M 2024-05-04T02:11:27.701 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-rook noarch 2:19.0.0-3522.gbd4e00a3.el9 ceph-noarch 49 k 2024-05-04T02:11:27.701 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mon-debuginfo x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 99 M 2024-05-04T02:11:27.701 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-osd-debuginfo x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 283 M 2024-05-04T02:11:27.701 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-radosgw x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 10 M 2024-05-04T02:11:27.702 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-radosgw-debuginfo x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 192 M 2024-05-04T02:11:27.702 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-test x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 43 M 2024-05-04T02:11:27.702 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-test-debuginfo x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 623 M 2024-05-04T02:11:27.702 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-volume noarch 2:19.0.0-3522.gbd4e00a3.el9 ceph-noarch 273 k 2024-05-04T02:11:27.702 INFO:teuthology.orchestra.run.smithi107.stdout: cephadm noarch 2:19.0.0-3522.gbd4e00a3.el9 ceph-noarch 763 k 2024-05-04T02:11:27.702 INFO:teuthology.orchestra.run.smithi107.stdout: cephfs-mirror x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 224 k 2024-05-04T02:11:27.702 INFO:teuthology.orchestra.run.smithi107.stdout: cephfs-shell x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 27 k 2024-05-04T02:11:27.702 INFO:teuthology.orchestra.run.smithi107.stdout: cephfs-top noarch 2:19.0.0-3522.gbd4e00a3.el9 ceph-noarch 18 k 2024-05-04T02:11:27.702 INFO:teuthology.orchestra.run.smithi107.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-04T02:11:27.702 INFO:teuthology.orchestra.run.smithi107.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-04T02:11:27.702 INFO:teuthology.orchestra.run.smithi107.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-04T02:11:27.702 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs-devel x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 32 k 2024-05-04T02:11:27.702 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs2 x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 756 k 2024-05-04T02:11:27.703 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs2-debuginfo x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 5.4 M 2024-05-04T02:11:27.703 INFO:teuthology.orchestra.run.smithi107.stdout: librados-devel x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 127 k 2024-05-04T02:11:27.703 INFO:teuthology.orchestra.run.smithi107.stdout: librados-devel-debuginfo x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 104 k 2024-05-04T02:11:27.703 INFO:teuthology.orchestra.run.smithi107.stdout: librados2-debuginfo x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 47 M 2024-05-04T02:11:27.703 INFO:teuthology.orchestra.run.smithi107.stdout: librbd1-debuginfo x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 54 M 2024-05-04T02:11:27.703 INFO:teuthology.orchestra.run.smithi107.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-04T02:11:27.703 INFO:teuthology.orchestra.run.smithi107.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-04T02:11:27.703 INFO:teuthology.orchestra.run.smithi107.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-04T02:11:27.703 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-04T02:11:27.703 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-04T02:11:27.703 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-04T02:11:27.703 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cephfs x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 162 k 2024-05-04T02:11:27.703 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cephfs-debuginfo x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 615 k 2024-05-04T02:11:27.703 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rados x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 321 k 2024-05-04T02:11:27.704 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rados-debuginfo x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 771 k 2024-05-04T02:11:27.704 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rbd x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 298 k 2024-05-04T02:11:27.704 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rbd-debuginfo x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 1.1 M 2024-05-04T02:11:27.704 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rgw x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 100 k 2024-05-04T02:11:27.704 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rgw-debuginfo x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 337 k 2024-05-04T02:11:27.704 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-fuse x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 85 k 2024-05-04T02:11:27.704 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-fuse-debuginfo x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 524 k 2024-05-04T02:11:27.704 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-mirror x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 3.0 M 2024-05-04T02:11:27.704 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-mirror-debuginfo x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 53 M 2024-05-04T02:11:27.704 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-nbd x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 170 k 2024-05-04T02:11:27.704 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-nbd-debuginfo x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 1.3 M 2024-05-04T02:11:27.704 INFO:teuthology.orchestra.run.smithi107.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-04T02:11:27.704 INFO:teuthology.orchestra.run.smithi107.stdout:Upgrading: 2024-05-04T02:11:27.704 INFO:teuthology.orchestra.run.smithi107.stdout: librados2 x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 3.3 M 2024-05-04T02:11:27.705 INFO:teuthology.orchestra.run.smithi107.stdout: librbd1 x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 3.1 M 2024-05-04T02:11:27.705 INFO:teuthology.orchestra.run.smithi107.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-04T02:11:27.705 INFO:teuthology.orchestra.run.smithi107.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-04T02:11:27.705 INFO:teuthology.orchestra.run.smithi107.stdout:Installing dependencies: 2024-05-04T02:11:27.705 INFO:teuthology.orchestra.run.smithi107.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-04T02:11:27.705 INFO:teuthology.orchestra.run.smithi107.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-04T02:11:27.705 INFO:teuthology.orchestra.run.smithi107.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-04T02:11:27.705 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-common x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 20 M 2024-05-04T02:11:27.705 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-debuginfo x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 22 M 2024-05-04T02:11:27.705 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3522.gbd4e00a3.el9 ceph-noarch 34 k 2024-05-04T02:11:27.705 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mds x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 2.3 M 2024-05-04T02:11:27.705 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3522.gbd4e00a3.el9 ceph-noarch 274 k 2024-05-04T02:11:27.705 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mon x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 4.9 M 2024-05-04T02:11:27.705 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-osd x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 18 M 2024-05-04T02:11:27.706 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3522.gbd4e00a3.el9 ceph-noarch 16 k 2024-05-04T02:11:27.706 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-selinux x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 25 k 2024-05-04T02:11:27.706 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-04T02:11:27.706 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-04T02:11:27.706 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-04T02:11:27.706 INFO:teuthology.orchestra.run.smithi107.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-04T02:11:27.706 INFO:teuthology.orchestra.run.smithi107.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-04T02:11:27.706 INFO:teuthology.orchestra.run.smithi107.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-04T02:11:27.706 INFO:teuthology.orchestra.run.smithi107.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-04T02:11:27.706 INFO:teuthology.orchestra.run.smithi107.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-04T02:11:27.706 INFO:teuthology.orchestra.run.smithi107.stdout: libcephsqlite x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 158 k 2024-05-04T02:11:27.706 INFO:teuthology.orchestra.run.smithi107.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-04T02:11:27.706 INFO:teuthology.orchestra.run.smithi107.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-04T02:11:27.706 INFO:teuthology.orchestra.run.smithi107.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-04T02:11:27.707 INFO:teuthology.orchestra.run.smithi107.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-04T02:11:27.707 INFO:teuthology.orchestra.run.smithi107.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-04T02:11:27.707 INFO:teuthology.orchestra.run.smithi107.stdout: libradosstriper1 x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 497 k 2024-05-04T02:11:27.707 INFO:teuthology.orchestra.run.smithi107.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-04T02:11:27.707 INFO:teuthology.orchestra.run.smithi107.stdout: librgw2 x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 5.2 M 2024-05-04T02:11:27.707 INFO:teuthology.orchestra.run.smithi107.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-04T02:11:27.707 INFO:teuthology.orchestra.run.smithi107.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-04T02:11:27.707 INFO:teuthology.orchestra.run.smithi107.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-04T02:11:27.707 INFO:teuthology.orchestra.run.smithi107.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-04T02:11:27.707 INFO:teuthology.orchestra.run.smithi107.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-04T02:11:27.707 INFO:teuthology.orchestra.run.smithi107.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-04T02:11:27.707 INFO:teuthology.orchestra.run.smithi107.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-04T02:11:27.707 INFO:teuthology.orchestra.run.smithi107.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-04T02:11:27.708 INFO:teuthology.orchestra.run.smithi107.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-04T02:11:27.708 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-04T02:11:27.708 INFO:teuthology.orchestra.run.smithi107.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-04T02:11:27.708 INFO:teuthology.orchestra.run.smithi107.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-04T02:11:27.708 INFO:teuthology.orchestra.run.smithi107.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-04T02:11:27.708 INFO:teuthology.orchestra.run.smithi107.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-04T02:11:27.708 INFO:teuthology.orchestra.run.smithi107.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-04T02:11:27.708 INFO:teuthology.orchestra.run.smithi107.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-04T02:11:27.708 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-04T02:11:27.708 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-argparse x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 45 k 2024-05-04T02:11:27.708 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-common x86_64 2:19.0.0-3522.gbd4e00a3.el9 ceph 135 k 2024-05-04T02:11:27.708 INFO:teuthology.orchestra.run.smithi107.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-04T02:11:27.708 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-04T02:11:27.708 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-04T02:11:27.709 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-04T02:11:27.709 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-04T02:11:27.709 INFO:teuthology.orchestra.run.smithi107.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-04T02:11:27.709 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-04T02:11:27.709 INFO:teuthology.orchestra.run.smithi107.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-04T02:11:27.709 INFO:teuthology.orchestra.run.smithi107.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-04T02:11:27.709 INFO:teuthology.orchestra.run.smithi107.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-04T02:11:27.709 INFO:teuthology.orchestra.run.smithi107.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-04T02:11:27.709 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-04T02:11:27.709 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-04T02:11:27.709 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-04T02:11:27.709 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-04T02:11:27.709 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-04T02:11:27.709 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-04T02:11:27.710 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-04T02:11:27.710 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-04T02:11:27.710 INFO:teuthology.orchestra.run.smithi107.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-04T02:11:27.710 INFO:teuthology.orchestra.run.smithi107.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-04T02:11:27.710 INFO:teuthology.orchestra.run.smithi107.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-04T02:11:27.710 INFO:teuthology.orchestra.run.smithi107.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-04T02:11:27.710 INFO:teuthology.orchestra.run.smithi107.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-04T02:11:27.710 INFO:teuthology.orchestra.run.smithi107.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-04T02:11:27.710 INFO:teuthology.orchestra.run.smithi107.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-04T02:11:27.710 INFO:teuthology.orchestra.run.smithi107.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-04T02:11:27.710 INFO:teuthology.orchestra.run.smithi107.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-04T02:11:27.710 INFO:teuthology.orchestra.run.smithi107.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-04T02:11:27.710 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-04T02:11:27.710 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-04T02:11:27.711 INFO:teuthology.orchestra.run.smithi107.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-04T02:11:27.711 INFO:teuthology.orchestra.run.smithi107.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-04T02:11:27.711 INFO:teuthology.orchestra.run.smithi107.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-04T02:11:27.711 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-04T02:11:27.711 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-04T02:11:27.711 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-04T02:11:27.711 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-04T02:11:27.711 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-04T02:11:27.711 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-04T02:11:27.711 INFO:teuthology.orchestra.run.smithi107.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-04T02:11:27.711 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-04T02:11:27.711 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-04T02:11:27.711 INFO:teuthology.orchestra.run.smithi107.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-04T02:11:27.711 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-04T02:11:27.711 INFO:teuthology.orchestra.run.smithi107.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-04T02:11:27.712 INFO:teuthology.orchestra.run.smithi107.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-04T02:11:27.712 INFO:teuthology.orchestra.run.smithi107.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-04T02:11:27.712 INFO:teuthology.orchestra.run.smithi107.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-04T02:11:27.712 INFO:teuthology.orchestra.run.smithi107.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-04T02:11:27.712 INFO:teuthology.orchestra.run.smithi107.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-04T02:11:27.712 INFO:teuthology.orchestra.run.smithi107.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-04T02:11:27.712 INFO:teuthology.orchestra.run.smithi107.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-04T02:11:27.712 INFO:teuthology.orchestra.run.smithi107.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-04T02:11:27.712 INFO:teuthology.orchestra.run.smithi107.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-04T02:11:27.712 INFO:teuthology.orchestra.run.smithi107.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-04T02:11:27.712 INFO:teuthology.orchestra.run.smithi107.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-04T02:11:27.712 INFO:teuthology.orchestra.run.smithi107.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-04T02:11:27.712 INFO:teuthology.orchestra.run.smithi107.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-04T02:11:27.712 INFO:teuthology.orchestra.run.smithi107.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-04T02:11:27.713 INFO:teuthology.orchestra.run.smithi107.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-04T02:11:27.713 INFO:teuthology.orchestra.run.smithi107.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-04T02:11:27.713 INFO:teuthology.orchestra.run.smithi107.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-04T02:11:27.713 INFO:teuthology.orchestra.run.smithi107.stdout:Installing weak dependencies: 2024-05-04T02:11:27.713 INFO:teuthology.orchestra.run.smithi107.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-04T02:11:27.713 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-04T02:11:27.713 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2024-05-04T02:11:27.713 INFO:teuthology.orchestra.run.smithi107.stdout:=============================================================================================== 2024-05-04T02:11:27.713 INFO:teuthology.orchestra.run.smithi107.stdout:Install 170 Packages 2024-05-04T02:11:27.713 INFO:teuthology.orchestra.run.smithi107.stdout:Upgrade 4 Packages 2024-05-04T02:11:27.713 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-04T02:11:27.714 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 2.1 G 2024-05-04T02:11:27.714 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2024-05-04T02:11:27.750 INFO:teuthology.orchestra.run.smithi001.stdout:(1/174): ceph-19.0.0-3522.gbd4e00a3.el9.x86_64. 22 kB/s | 6.6 kB 00:00 2024-05-04T02:11:28.084 INFO:teuthology.orchestra.run.smithi001.stdout:(2/174): ceph-base-19.0.0-3522.gbd4e00a3.el9.x8 8.5 MB/s | 5.4 MB 00:00 2024-05-04T02:11:28.752 INFO:teuthology.orchestra.run.smithi107.stdout:(1/174): ceph-19.0.0-3522.gbd4e00a3.el9.x86_64. 20 kB/s | 6.6 kB 00:00 2024-05-04T02:11:31.286 INFO:teuthology.orchestra.run.smithi107.stdout:(2/174): ceph-base-19.0.0-3522.gbd4e00a3.el9.x8 1.9 MB/s | 5.4 MB 00:02 2024-05-04T02:11:35.892 INFO:teuthology.orchestra.run.smithi001.stdout:(3/174): ceph-common-19.0.0-3522.gbd4e00a3.el9. 2.4 MB/s | 20 MB 00:08 2024-05-04T02:11:37.660 INFO:teuthology.orchestra.run.smithi107.stdout:(3/174): ceph-common-19.0.0-3522.gbd4e00a3.el9. 2.2 MB/s | 20 MB 00:08 2024-05-04T02:11:37.875 INFO:teuthology.orchestra.run.smithi001.stdout:(4/174): ceph-base-debuginfo-19.0.0-3522.gbd4e0 6.7 MB/s | 70 MB 00:10 2024-05-04T02:11:38.109 INFO:teuthology.orchestra.run.smithi001.stdout:(5/174): ceph-fuse-19.0.0-3522.gbd4e00a3.el9.x8 3.6 MB/s | 863 kB 00:00 2024-05-04T02:11:39.175 INFO:teuthology.orchestra.run.smithi001.stdout:(6/174): ceph-fuse-debuginfo-19.0.0-3522.gbd4e0 5.8 MB/s | 6.2 MB 00:01 2024-05-04T02:11:39.326 INFO:teuthology.orchestra.run.smithi001.stdout:(7/174): ceph-immutable-object-cache-19.0.0-352 980 kB/s | 147 kB 00:00 2024-05-04T02:11:39.618 INFO:teuthology.orchestra.run.smithi001.stdout:(8/174): ceph-immutable-object-cache-debuginfo- 5.0 MB/s | 1.5 MB 00:00 2024-05-04T02:11:40.101 INFO:teuthology.orchestra.run.smithi001.stdout:(9/174): ceph-mds-19.0.0-3522.gbd4e00a3.el9.x86 4.7 MB/s | 2.3 MB 00:00 2024-05-04T02:11:43.226 INFO:teuthology.orchestra.run.smithi001.stdout:(10/174): ceph-debuginfo-19.0.0-3522.gbd4e00a3. 3.0 MB/s | 22 MB 00:07 2024-05-04T02:11:43.234 INFO:teuthology.orchestra.run.smithi107.stdout:(4/174): ceph-base-debuginfo-19.0.0-3522.gbd4e0 4.7 MB/s | 70 MB 00:14 2024-05-04T02:11:43.501 INFO:teuthology.orchestra.run.smithi107.stdout:(5/174): ceph-debuginfo-19.0.0-3522.gbd4e00a3.e 3.8 MB/s | 22 MB 00:05 2024-05-04T02:11:43.535 INFO:teuthology.orchestra.run.smithi107.stdout:(6/174): ceph-fuse-19.0.0-3522.gbd4e00a3.el9.x8 2.8 MB/s | 863 kB 00:00 2024-05-04T02:11:43.627 INFO:teuthology.orchestra.run.smithi107.stdout:(7/174): ceph-immutable-object-cache-19.0.0-352 1.6 MB/s | 147 kB 00:00 2024-05-04T02:11:43.718 INFO:teuthology.orchestra.run.smithi001.stdout:(11/174): ceph-mgr-19.0.0-3522.gbd4e00a3.el9.x8 3.1 MB/s | 1.5 MB 00:00 2024-05-04T02:11:44.135 INFO:teuthology.orchestra.run.smithi107.stdout:(8/174): ceph-immutable-object-cache-debuginfo- 2.9 MB/s | 1.5 MB 00:00 2024-05-04T02:11:44.660 INFO:teuthology.orchestra.run.smithi107.stdout:(9/174): ceph-fuse-debuginfo-19.0.0-3522.gbd4e0 5.3 MB/s | 6.2 MB 00:01 2024-05-04T02:11:44.710 INFO:teuthology.orchestra.run.smithi107.stdout:(10/174): ceph-mds-19.0.0-3522.gbd4e00a3.el9.x8 3.9 MB/s | 2.3 MB 00:00 2024-05-04T02:11:45.094 INFO:teuthology.orchestra.run.smithi107.stdout:(11/174): ceph-mgr-19.0.0-3522.gbd4e00a3.el9.x8 3.9 MB/s | 1.5 MB 00:00 2024-05-04T02:11:48.285 INFO:teuthology.orchestra.run.smithi001.stdout:(12/174): ceph-mds-debuginfo-19.0.0-3522.gbd4e0 6.0 MB/s | 49 MB 00:08 2024-05-04T02:11:49.118 INFO:teuthology.orchestra.run.smithi001.stdout:(13/174): ceph-mon-19.0.0-3522.gbd4e00a3.el9.x8 5.9 MB/s | 4.9 MB 00:00 2024-05-04T02:11:49.394 INFO:teuthology.orchestra.run.smithi107.stdout:(12/174): ceph-mgr-debuginfo-19.0.0-3522.gbd4e0 4.9 MB/s | 21 MB 00:04 2024-05-04T02:11:50.919 INFO:teuthology.orchestra.run.smithi107.stdout:(13/174): ceph-mon-19.0.0-3522.gbd4e00a3.el9.x8 3.2 MB/s | 4.9 MB 00:01 2024-05-04T02:11:51.527 INFO:teuthology.orchestra.run.smithi001.stdout:(14/174): ceph-mgr-debuginfo-19.0.0-3522.gbd4e0 2.7 MB/s | 21 MB 00:07 2024-05-04T02:11:54.202 INFO:teuthology.orchestra.run.smithi107.stdout:(14/174): ceph-mds-debuginfo-19.0.0-3522.gbd4e0 5.1 MB/s | 49 MB 00:09 2024-05-04T02:11:57.818 INFO:teuthology.orchestra.run.smithi001.stdout:(15/174): ceph-osd-19.0.0-3522.gbd4e00a3.el9.x8 2.8 MB/s | 18 MB 00:06 2024-05-04T02:11:58.409 INFO:teuthology.orchestra.run.smithi107.stdout:(15/174): ceph-osd-19.0.0-3522.gbd4e00a3.el9.x8 4.2 MB/s | 18 MB 00:04 2024-05-04T02:12:07.201 INFO:teuthology.orchestra.run.smithi107.stdout:(16/174): ceph-mon-debuginfo-19.0.0-3522.gbd4e0 6.1 MB/s | 99 MB 00:16 2024-05-04T02:12:07.468 INFO:teuthology.orchestra.run.smithi001.stdout:(16/174): ceph-mon-debuginfo-19.0.0-3522.gbd4e0 5.4 MB/s | 99 MB 00:18 2024-05-04T02:12:08.109 INFO:teuthology.orchestra.run.smithi107.stdout:(17/174): ceph-radosgw-19.0.0-3522.gbd4e00a3.el 11 MB/s | 10 MB 00:00 2024-05-04T02:12:10.234 INFO:teuthology.orchestra.run.smithi001.stdout:(17/174): ceph-radosgw-19.0.0-3522.gbd4e00a3.el 3.7 MB/s | 10 MB 00:02 2024-05-04T02:12:31.156 INFO:teuthology.orchestra.run.smithi107.stdout:(18/174): ceph-radosgw-debuginfo-19.0.0-3522.gb 8.3 MB/s | 192 MB 00:23 2024-05-04T02:12:31.222 INFO:teuthology.orchestra.run.smithi107.stdout:(19/174): ceph-selinux-19.0.0-3522.gbd4e00a3.el 379 kB/s | 25 kB 00:00 2024-05-04T02:12:32.641 INFO:teuthology.orchestra.run.smithi001.stdout:(18/174): ceph-radosgw-debuginfo-19.0.0-3522.gb 8.6 MB/s | 192 MB 00:22 2024-05-04T02:12:32.725 INFO:teuthology.orchestra.run.smithi001.stdout:(19/174): ceph-selinux-19.0.0-3522.gbd4e00a3.el 304 kB/s | 25 kB 00:00 2024-05-04T02:12:36.808 INFO:teuthology.orchestra.run.smithi001.stdout:(20/174): ceph-test-19.0.0-3522.gbd4e00a3.el9.x 11 MB/s | 43 MB 00:04 2024-05-04T02:12:36.863 INFO:teuthology.orchestra.run.smithi107.stdout:(20/174): ceph-test-19.0.0-3522.gbd4e00a3.el9.x 7.7 MB/s | 43 MB 00:05 2024-05-04T02:12:52.366 INFO:teuthology.orchestra.run.smithi001.stdout:(21/174): ceph-common-debuginfo-19.0.0-3522.gbd 5.0 MB/s | 420 MB 01:24 2024-05-04T02:12:52.665 INFO:teuthology.orchestra.run.smithi001.stdout:(22/174): cephfs-mirror-19.0.0-3522.gbd4e00a3.e 748 kB/s | 224 kB 00:00 2024-05-04T02:12:52.765 INFO:teuthology.orchestra.run.smithi001.stdout:(23/174): cephfs-shell-19.0.0-3522.gbd4e00a3.el 271 kB/s | 27 kB 00:00 2024-05-04T02:12:52.866 INFO:teuthology.orchestra.run.smithi001.stdout:(24/174): libcephfs-devel-19.0.0-3522.gbd4e00a3 317 kB/s | 32 kB 00:00 2024-05-04T02:12:53.208 INFO:teuthology.orchestra.run.smithi001.stdout:(25/174): libcephfs2-19.0.0-3522.gbd4e00a3.el9. 2.2 MB/s | 756 kB 00:00 2024-05-04T02:12:54.750 INFO:teuthology.orchestra.run.smithi001.stdout:(26/174): libcephfs2-debuginfo-19.0.0-3522.gbd4 3.5 MB/s | 5.4 MB 00:01 2024-05-04T02:12:54.850 INFO:teuthology.orchestra.run.smithi001.stdout:(27/174): libcephsqlite-19.0.0-3522.gbd4e00a3.e 1.5 MB/s | 158 kB 00:00 2024-05-04T02:12:54.933 INFO:teuthology.orchestra.run.smithi001.stdout:(28/174): librados-devel-19.0.0-3522.gbd4e00a3. 1.5 MB/s | 127 kB 00:00 2024-05-04T02:12:55.042 INFO:teuthology.orchestra.run.smithi001.stdout:(29/174): librados-devel-debuginfo-19.0.0-3522. 964 kB/s | 104 kB 00:00 2024-05-04T02:13:06.667 INFO:teuthology.orchestra.run.smithi001.stdout:(30/174): librados2-debuginfo-19.0.0-3522.gbd4e 4.0 MB/s | 47 MB 00:11 2024-05-04T02:13:06.867 INFO:teuthology.orchestra.run.smithi001.stdout:(31/174): libradosstriper1-19.0.0-3522.gbd4e00a 2.4 MB/s | 497 kB 00:00 2024-05-04T02:13:17.142 INFO:teuthology.orchestra.run.smithi001.stdout:(32/174): librbd1-debuginfo-19.0.0-3522.gbd4e00 5.2 MB/s | 54 MB 00:10 2024-05-04T02:13:18.158 INFO:teuthology.orchestra.run.smithi001.stdout:(33/174): librgw2-19.0.0-3522.gbd4e00a3.el9.x86 5.1 MB/s | 5.2 MB 00:01 2024-05-04T02:13:18.225 INFO:teuthology.orchestra.run.smithi001.stdout:(34/174): python3-ceph-argparse-19.0.0-3522.gbd 680 kB/s | 45 kB 00:00 2024-05-04T02:13:18.284 INFO:teuthology.orchestra.run.smithi001.stdout:(35/174): python3-ceph-common-19.0.0-3522.gbd4e 2.3 MB/s | 135 kB 00:00 2024-05-04T02:13:18.359 INFO:teuthology.orchestra.run.smithi001.stdout:(36/174): python3-cephfs-19.0.0-3522.gbd4e00a3. 2.1 MB/s | 162 kB 00:00 2024-05-04T02:13:18.518 INFO:teuthology.orchestra.run.smithi001.stdout:(37/174): python3-cephfs-debuginfo-19.0.0-3522. 3.8 MB/s | 615 kB 00:00 2024-05-04T02:13:18.593 INFO:teuthology.orchestra.run.smithi001.stdout:(38/174): python3-rados-19.0.0-3522.gbd4e00a3.e 4.2 MB/s | 321 kB 00:00 2024-05-04T02:13:18.777 INFO:teuthology.orchestra.run.smithi001.stdout:(39/174): python3-rados-debuginfo-19.0.0-3522.g 4.1 MB/s | 771 kB 00:00 2024-05-04T02:13:18.852 INFO:teuthology.orchestra.run.smithi001.stdout:(40/174): python3-rbd-19.0.0-3522.gbd4e00a3.el9 3.9 MB/s | 298 kB 00:00 2024-05-04T02:13:19.057 INFO:teuthology.orchestra.run.smithi107.stdout:(21/174): ceph-osd-debuginfo-19.0.0-3522.gbd4e0 3.5 MB/s | 283 MB 01:20 2024-05-04T02:13:19.119 INFO:teuthology.orchestra.run.smithi001.stdout:(41/174): python3-rbd-debuginfo-19.0.0-3522.gbd 4.2 MB/s | 1.1 MB 00:00 2024-05-04T02:13:19.219 INFO:teuthology.orchestra.run.smithi001.stdout:(42/174): python3-rgw-19.0.0-3522.gbd4e00a3.el9 1.0 MB/s | 100 kB 00:00 2024-05-04T02:13:19.314 INFO:teuthology.orchestra.run.smithi107.stdout:(22/174): cephfs-mirror-19.0.0-3522.gbd4e00a3.e 869 kB/s | 224 kB 00:00 2024-05-04T02:13:19.386 INFO:teuthology.orchestra.run.smithi001.stdout:(43/174): python3-rgw-debuginfo-19.0.0-3522.gbd 2.0 MB/s | 337 kB 00:00 2024-05-04T02:13:19.389 INFO:teuthology.orchestra.run.smithi107.stdout:(23/174): cephfs-shell-19.0.0-3522.gbd4e00a3.el 360 kB/s | 27 kB 00:00 2024-05-04T02:13:19.456 INFO:teuthology.orchestra.run.smithi107.stdout:(24/174): libcephfs-devel-19.0.0-3522.gbd4e00a3 477 kB/s | 32 kB 00:00 2024-05-04T02:13:19.461 INFO:teuthology.orchestra.run.smithi001.stdout:(44/174): rbd-fuse-19.0.0-3522.gbd4e00a3.el9.x8 1.1 MB/s | 85 kB 00:00 2024-05-04T02:13:19.670 INFO:teuthology.orchestra.run.smithi001.stdout:(45/174): rbd-fuse-debuginfo-19.0.0-3522.gbd4e0 2.5 MB/s | 524 kB 00:00 2024-05-04T02:13:19.723 INFO:teuthology.orchestra.run.smithi107.stdout:(25/174): libcephfs2-19.0.0-3522.gbd4e00a3.el9. 2.8 MB/s | 756 kB 00:00 2024-05-04T02:13:20.337 INFO:teuthology.orchestra.run.smithi001.stdout:(46/174): rbd-mirror-19.0.0-3522.gbd4e00a3.el9. 4.6 MB/s | 3.0 MB 00:00 2024-05-04T02:13:21.665 INFO:teuthology.orchestra.run.smithi107.stdout:(26/174): libcephfs2-debuginfo-19.0.0-3522.gbd4 2.8 MB/s | 5.4 MB 00:01 2024-05-04T02:13:21.765 INFO:teuthology.orchestra.run.smithi107.stdout:(27/174): libcephsqlite-19.0.0-3522.gbd4e00a3.e 1.5 MB/s | 158 kB 00:00 2024-05-04T02:13:21.866 INFO:teuthology.orchestra.run.smithi107.stdout:(28/174): librados-devel-19.0.0-3522.gbd4e00a3. 1.2 MB/s | 127 kB 00:00 2024-05-04T02:13:21.966 INFO:teuthology.orchestra.run.smithi107.stdout:(29/174): librados-devel-debuginfo-19.0.0-3522. 1.0 MB/s | 104 kB 00:00 2024-05-04T02:13:30.320 INFO:teuthology.orchestra.run.smithi001.stdout:(47/174): ceph-osd-debuginfo-19.0.0-3522.gbd4e0 3.1 MB/s | 283 MB 01:32 2024-05-04T02:13:30.537 INFO:teuthology.orchestra.run.smithi001.stdout:(48/174): rbd-nbd-19.0.0-3522.gbd4e00a3.el9.x86 784 kB/s | 170 kB 00:00 2024-05-04T02:13:31.062 INFO:teuthology.orchestra.run.smithi001.stdout:(49/174): rbd-mirror-debuginfo-19.0.0-3522.gbd4 5.0 MB/s | 53 MB 00:10 2024-05-04T02:13:31.112 INFO:teuthology.orchestra.run.smithi001.stdout:(50/174): rbd-nbd-debuginfo-19.0.0-3522.gbd4e00 2.2 MB/s | 1.3 MB 00:00 2024-05-04T02:13:31.137 INFO:teuthology.orchestra.run.smithi001.stdout:(51/174): ceph-grafana-dashboards-19.0.0-3522.g 456 kB/s | 34 kB 00:00 2024-05-04T02:13:31.196 INFO:teuthology.orchestra.run.smithi001.stdout:(52/174): ceph-mgr-cephadm-19.0.0-3522.gbd4e00a 1.7 MB/s | 142 kB 00:00 2024-05-04T02:13:31.821 INFO:teuthology.orchestra.run.smithi001.stdout:(53/174): ceph-mgr-dashboard-19.0.0-3522.gbd4e0 5.2 MB/s | 3.5 MB 00:00 2024-05-04T02:13:31.913 INFO:teuthology.orchestra.run.smithi001.stdout:(54/174): ceph-mgr-modules-core-19.0.0-3522.gbd 2.9 MB/s | 274 kB 00:00 2024-05-04T02:13:32.022 INFO:teuthology.orchestra.run.smithi001.stdout:(55/174): ceph-mgr-rook-19.0.0-3522.gbd4e00a3.e 456 kB/s | 49 kB 00:00 2024-05-04T02:13:32.105 INFO:teuthology.orchestra.run.smithi001.stdout:(56/174): ceph-prometheus-alerts-19.0.0-3522.gb 198 kB/s | 16 kB 00:00 2024-05-04T02:13:32.198 INFO:teuthology.orchestra.run.smithi001.stdout:(57/174): ceph-volume-19.0.0-3522.gbd4e00a3.el9 2.9 MB/s | 273 kB 00:00 2024-05-04T02:13:32.406 INFO:teuthology.orchestra.run.smithi001.stdout:(58/174): cephadm-19.0.0-3522.gbd4e00a3.el9.noa 3.6 MB/s | 763 kB 00:00 2024-05-04T02:13:32.481 INFO:teuthology.orchestra.run.smithi001.stdout:(59/174): cephfs-top-19.0.0-3522.gbd4e00a3.el9. 243 kB/s | 18 kB 00:00 2024-05-04T02:13:32.673 INFO:teuthology.orchestra.run.smithi001.stdout:(60/174): fuse-2.9.9-15.el9.x86_64.rpm 419 kB/s | 80 kB 00:00 2024-05-04T02:13:32.832 INFO:teuthology.orchestra.run.smithi001.stdout:(61/174): libgfortran-11.4.1-3.el9.x86_64.rpm 5.0 MB/s | 803 kB 00:00 2024-05-04T02:13:32.890 INFO:teuthology.orchestra.run.smithi001.stdout:(62/174): libquadmath-11.4.1-3.el9.x86_64.rpm 3.3 MB/s | 195 kB 00:00 2024-05-04T02:13:32.983 INFO:teuthology.orchestra.run.smithi001.stdout:(63/174): ceph-mgr-diskprediction-local-19.0.0- 4.1 MB/s | 7.4 MB 00:01 2024-05-04T02:13:33.008 INFO:teuthology.orchestra.run.smithi001.stdout:(64/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.1 MB/s | 253 kB 00:00 2024-05-04T02:13:33.066 INFO:teuthology.orchestra.run.smithi001.stdout:(65/174): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-05-04T02:13:33.125 INFO:teuthology.orchestra.run.smithi001.stdout:(66/174): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-05-04T02:13:33.184 INFO:teuthology.orchestra.run.smithi001.stdout:(67/174): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-05-04T02:13:33.242 INFO:teuthology.orchestra.run.smithi001.stdout:(68/174): python3-urllib3-1.26.5-5.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-05-04T02:13:33.293 INFO:teuthology.orchestra.run.smithi001.stdout:(69/174): python3-cryptography-36.0.1-4.el9.x86 4.0 MB/s | 1.2 MB 00:00 2024-05-04T02:13:33.376 INFO:teuthology.orchestra.run.smithi001.stdout:(70/174): automake-1.16.2-8.el9.noarch.rpm 5.0 MB/s | 689 kB 00:00 2024-05-04T02:13:33.427 INFO:teuthology.orchestra.run.smithi001.stdout:(71/174): bison-3.7.4-5.el9.x86_64.rpm 6.9 MB/s | 943 kB 00:00 2024-05-04T02:13:33.460 INFO:teuthology.orchestra.run.smithi001.stdout:(72/174): boost-program-options-1.75.0-8.el9.x8 1.2 MB/s | 107 kB 00:00 2024-05-04T02:13:33.502 INFO:teuthology.orchestra.run.smithi001.stdout:(73/174): elfutils-libelf-devel-0.190-2.el9.x86 286 kB/s | 21 kB 00:00 2024-05-04T02:13:33.552 INFO:teuthology.orchestra.run.smithi001.stdout:(74/174): flex-2.6.4-9.el9.x86_64.rpm 3.3 MB/s | 313 kB 00:00 2024-05-04T02:13:33.578 INFO:teuthology.orchestra.run.smithi001.stdout:(75/174): flexiblas-3.0.4-8.el9.x86_64.rpm 435 kB/s | 33 kB 00:00 2024-05-04T02:13:33.628 INFO:teuthology.orchestra.run.smithi001.stdout:(76/174): flexiblas-openblas-openmp-3.0.4-8.el9 364 kB/s | 18 kB 00:00 2024-05-04T02:13:33.670 INFO:teuthology.orchestra.run.smithi001.stdout:(77/174): libaio-devel-0.3.111-13.el9.x86_64.rp 268 kB/s | 11 kB 00:00 2024-05-04T02:13:33.745 INFO:teuthology.orchestra.run.smithi001.stdout:(78/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 16 MB/s | 3.0 MB 00:00 2024-05-04T02:13:33.787 INFO:teuthology.orchestra.run.smithi001.stdout:(79/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.3 MB/s | 160 kB 00:00 2024-05-04T02:13:33.812 INFO:teuthology.orchestra.run.smithi001.stdout:(80/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 676 kB/s | 45 kB 00:00 2024-05-04T02:13:33.896 INFO:teuthology.orchestra.run.smithi001.stdout:(81/174): librdkafka-1.6.1-102.el9.x86_64.rpm 6.0 MB/s | 662 kB 00:00 2024-05-04T02:13:33.921 INFO:teuthology.orchestra.run.smithi001.stdout:(82/174): libtool-2.4.6-45.el9.x86_64.rpm 5.2 MB/s | 582 kB 00:00 2024-05-04T02:13:33.963 INFO:teuthology.orchestra.run.smithi001.stdout:(83/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 381 kB/s | 25 kB 00:00 2024-05-04T02:13:33.989 INFO:teuthology.orchestra.run.smithi001.stdout:(84/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 710 kB/s | 47 kB 00:00 2024-05-04T02:13:34.056 INFO:teuthology.orchestra.run.smithi001.stdout:(85/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.1 MB/s | 292 kB 00:00 2024-05-04T02:13:34.081 INFO:teuthology.orchestra.run.smithi001.stdout:(86/174): lua-5.4.4-4.el9.x86_64.rpm 2.0 MB/s | 188 kB 00:00 2024-05-04T02:13:34.123 INFO:teuthology.orchestra.run.smithi001.stdout:(87/174): openblas-0.3.21-2.el9.x86_64.rpm 525 kB/s | 35 kB 00:00 2024-05-04T02:13:34.323 INFO:teuthology.orchestra.run.smithi001.stdout:(88/174): openblas-openmp-0.3.21-2.el9.x86_64.r 20 MB/s | 4.7 MB 00:00 2024-05-04T02:13:34.415 INFO:teuthology.orchestra.run.smithi001.stdout:(89/174): openssl-devel-3.2.1-1.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-05-04T02:13:34.516 INFO:teuthology.orchestra.run.smithi001.stdout:(90/174): postgresql-13.14-1.el9.x86_64.rpm 8.3 MB/s | 1.6 MB 00:00 2024-05-04T02:13:34.558 INFO:teuthology.orchestra.run.smithi001.stdout:(91/174): postgresql-contrib-13.14-1.el9.x86_64 6.3 MB/s | 911 kB 00:00 2024-05-04T02:13:34.616 INFO:teuthology.orchestra.run.smithi001.stdout:(92/174): postgresql-private-libs-13.14-1.el9.x 1.3 MB/s | 133 kB 00:00 2024-05-04T02:13:34.725 INFO:teuthology.orchestra.run.smithi001.stdout:(93/174): protobuf-3.14.0-13.el9.x86_64.rpm 9.3 MB/s | 1.0 MB 00:00 2024-05-04T02:13:34.792 INFO:teuthology.orchestra.run.smithi001.stdout:(94/174): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-05-04T02:13:34.875 INFO:teuthology.orchestra.run.smithi001.stdout:(95/174): postgresql-server-13.14-1.el9.x86_64. 18 MB/s | 5.8 MB 00:00 2024-05-04T02:13:34.951 INFO:teuthology.orchestra.run.smithi001.stdout:(96/174): python3-devel-3.9.18-3.el9.x86_64.rpm 3.2 MB/s | 244 kB 00:00 2024-05-04T02:13:35.026 INFO:teuthology.orchestra.run.smithi001.stdout:(97/174): python3-jinja2-2.11.3-5.el9.noarch.rp 3.2 MB/s | 248 kB 00:00 2024-05-04T02:13:35.076 INFO:teuthology.orchestra.run.smithi001.stdout:(98/174): python3-jsonpatch-1.21-16.el9.noarch. 514 kB/s | 26 kB 00:00 2024-05-04T02:13:35.168 INFO:teuthology.orchestra.run.smithi001.stdout:(99/174): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 6.0 MB 00:00 2024-05-04T02:13:35.194 INFO:teuthology.orchestra.run.smithi001.stdout:(100/174): python3-jsonpointer-2.0-4.el9.noarch 163 kB/s | 19 kB 00:00 2024-05-04T02:13:35.244 INFO:teuthology.orchestra.run.smithi001.stdout:(101/174): python3-markupsafe-1.1.1-12.el9.x86_ 697 kB/s | 35 kB 00:00 2024-05-04T02:13:35.260 INFO:teuthology.orchestra.run.smithi001.stdout:(102/174): python3-mako-1.1.4-6.el9.noarch.rpm 1.8 MB/s | 172 kB 00:00 2024-05-04T02:13:35.336 INFO:teuthology.orchestra.run.smithi001.stdout:(103/174): python3-numpy-f2py-1.20.1-5.el9.x86_ 3.3 MB/s | 250 kB 00:00 2024-05-04T02:13:35.411 INFO:teuthology.orchestra.run.smithi001.stdout:(104/174): python3-oauthlib-3.1.1-5.el9.noarch. 2.9 MB/s | 222 kB 00:00 2024-05-04T02:13:35.478 INFO:teuthology.orchestra.run.smithi001.stdout:(105/174): python3-packaging-20.9-5.el9.noarch. 1.1 MB/s | 77 kB 00:00 2024-05-04T02:13:35.545 INFO:teuthology.orchestra.run.smithi001.stdout:(106/174): python3-numpy-1.20.1-5.el9.x86_64.rp 17 MB/s | 5.1 MB 00:00 2024-05-04T02:13:35.595 INFO:teuthology.orchestra.run.smithi001.stdout:(107/174): python3-prettytable-0.7.2-27.el9.noa 361 kB/s | 42 kB 00:00 2024-05-04T02:13:35.646 INFO:teuthology.orchestra.run.smithi001.stdout:(108/174): python3-protobuf-3.14.0-13.el9.noarc 2.6 MB/s | 269 kB 00:00 2024-05-04T02:13:35.663 INFO:teuthology.orchestra.run.smithi107.stdout:(30/174): librados2-debuginfo-19.0.0-3522.gbd4e 3.4 MB/s | 47 MB 00:13 2024-05-04T02:13:35.688 INFO:teuthology.orchestra.run.smithi001.stdout:(109/174): python3-pyasn1-0.4.8-6.el9.noarch.rp 1.7 MB/s | 159 kB 00:00 2024-05-04T02:13:35.738 INFO:teuthology.orchestra.run.smithi001.stdout:(110/174): python3-pyasn1-modules-0.4.8-6.el9.n 3.0 MB/s | 279 kB 00:00 2024-05-04T02:13:35.763 INFO:teuthology.orchestra.run.smithi001.stdout:(111/174): python3-pytz-2021.1-5.el9.noarch.rpm 678 kB/s | 51 kB 00:00 2024-05-04T02:13:35.814 INFO:teuthology.orchestra.run.smithi001.stdout:(112/174): python3-requests-oauthlib-1.3.0-12.e 712 kB/s | 54 kB 00:00 2024-05-04T02:13:35.873 INFO:teuthology.orchestra.run.smithi001.stdout:(113/174): python3-toml-0.10.2-6.el9.noarch.rpm 711 kB/s | 42 kB 00:00 2024-05-04T02:13:35.931 INFO:teuthology.orchestra.run.smithi001.stdout:(114/174): python3-wcwidth-0.2.5-8.el9.noarch.r 759 kB/s | 44 kB 00:00 2024-05-04T02:13:36.040 INFO:teuthology.orchestra.run.smithi001.stdout:(115/174): qatlib-24.02.0-1.el9.x86_64.rpm 2.0 MB/s | 221 kB 00:00 2024-05-04T02:13:36.090 INFO:teuthology.orchestra.run.smithi001.stdout:(116/174): qatlib-service-24.02.0-1.el9.x86_64. 717 kB/s | 36 kB 00:00 2024-05-04T02:13:36.157 INFO:teuthology.orchestra.run.smithi001.stdout:(117/174): qatzip-libs-1.2.0-1.el9.x86_64.rpm 715 kB/s | 47 kB 00:00 2024-05-04T02:13:36.241 INFO:teuthology.orchestra.run.smithi001.stdout:(118/174): socat-1.7.4.1-5.el9.x86_64.rpm 3.6 MB/s | 305 kB 00:00 2024-05-04T02:13:36.408 INFO:teuthology.orchestra.run.smithi001.stdout:(119/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 25 MB/s | 16 MB 00:00 2024-05-04T02:13:36.433 INFO:teuthology.orchestra.run.smithi001.stdout:(120/174): uuid-1.6.2-55.el9.x86_64.rpm 301 kB/s | 58 kB 00:00 2024-05-04T02:13:36.492 INFO:teuthology.orchestra.run.smithi001.stdout:(121/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.1 MB/s | 94 kB 00:00 2024-05-04T02:13:36.517 INFO:teuthology.orchestra.run.smithi001.stdout:(122/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 762 kB/s | 64 kB 00:00 2024-05-04T02:13:36.575 INFO:teuthology.orchestra.run.smithi001.stdout:(123/174): zlib-devel-1.2.11-41.el9.x86_64.rpm 770 kB/s | 45 kB 00:00 2024-05-04T02:13:36.601 INFO:teuthology.orchestra.run.smithi001.stdout:(124/174): lua-devel-5.4.4-4.el9.x86_64.rpm 267 kB/s | 22 kB 00:00 2024-05-04T02:13:37.464 INFO:teuthology.orchestra.run.smithi107.stdout:(31/174): ceph-common-debuginfo-19.0.0-3522.gbd 3.3 MB/s | 420 MB 02:06 2024-05-04T02:13:37.497 INFO:teuthology.orchestra.run.smithi107.stdout:(32/174): libradosstriper1-19.0.0-3522.gbd4e00a 271 kB/s | 497 kB 00:01 2024-05-04T02:13:38.172 INFO:teuthology.orchestra.run.smithi107.stdout:(33/174): librgw2-19.0.0-3522.gbd4e00a3.el9.x86 7.6 MB/s | 5.2 MB 00:00 2024-05-04T02:13:38.214 INFO:teuthology.orchestra.run.smithi107.stdout:(34/174): python3-ceph-argparse-19.0.0-3522.gbd 1.1 MB/s | 45 kB 00:00 2024-05-04T02:13:38.264 INFO:teuthology.orchestra.run.smithi107.stdout:(35/174): python3-ceph-common-19.0.0-3522.gbd4e 2.6 MB/s | 135 kB 00:00 2024-05-04T02:13:38.323 INFO:teuthology.orchestra.run.smithi107.stdout:(36/174): python3-cephfs-19.0.0-3522.gbd4e00a3. 2.7 MB/s | 162 kB 00:00 2024-05-04T02:13:38.440 INFO:teuthology.orchestra.run.smithi107.stdout:(37/174): python3-cephfs-debuginfo-19.0.0-3522. 5.1 MB/s | 615 kB 00:00 2024-05-04T02:13:38.518 INFO:teuthology.orchestra.run.smithi107.stdout:(38/174): python3-rados-19.0.0-3522.gbd4e00a3.e 4.2 MB/s | 321 kB 00:00 2024-05-04T02:13:38.641 INFO:teuthology.orchestra.run.smithi107.stdout:(39/174): python3-rados-debuginfo-19.0.0-3522.g 6.0 MB/s | 771 kB 00:00 2024-05-04T02:13:38.724 INFO:teuthology.orchestra.run.smithi107.stdout:(40/174): python3-rbd-19.0.0-3522.gbd4e00a3.el9 3.5 MB/s | 298 kB 00:00 2024-05-04T02:13:38.900 INFO:teuthology.orchestra.run.smithi107.stdout:(41/174): python3-rbd-debuginfo-19.0.0-3522.gbd 6.4 MB/s | 1.1 MB 00:00 2024-05-04T02:13:38.958 INFO:teuthology.orchestra.run.smithi107.stdout:(42/174): python3-rgw-19.0.0-3522.gbd4e00a3.el9 1.7 MB/s | 100 kB 00:00 2024-05-04T02:13:39.042 INFO:teuthology.orchestra.run.smithi107.stdout:(43/174): python3-rgw-debuginfo-19.0.0-3522.gbd 4.0 MB/s | 337 kB 00:00 2024-05-04T02:13:39.092 INFO:teuthology.orchestra.run.smithi107.stdout:(44/174): rbd-fuse-19.0.0-3522.gbd4e00a3.el9.x8 1.7 MB/s | 85 kB 00:00 2024-05-04T02:13:39.193 INFO:teuthology.orchestra.run.smithi107.stdout:(45/174): rbd-fuse-debuginfo-19.0.0-3522.gbd4e0 5.1 MB/s | 524 kB 00:00 2024-05-04T02:13:39.576 INFO:teuthology.orchestra.run.smithi107.stdout:(46/174): rbd-mirror-19.0.0-3522.gbd4e00a3.el9. 7.9 MB/s | 3.0 MB 00:00 2024-05-04T02:13:40.018 INFO:teuthology.orchestra.run.smithi001.stdout:(125/174): ceph-test-debuginfo-19.0.0-3522.gbd4 9.9 MB/s | 623 MB 01:03 2024-05-04T02:13:40.176 INFO:teuthology.orchestra.run.smithi001.stdout:(126/174): protobuf-compiler-3.14.0-13.el9.x86_ 240 kB/s | 863 kB 00:03 2024-05-04T02:13:40.359 INFO:teuthology.orchestra.run.smithi001.stdout:(127/174): grpc-data-1.46.7-10.el9.noarch.rpm 107 kB/s | 19 kB 00:00 2024-05-04T02:13:40.410 INFO:teuthology.orchestra.run.smithi001.stdout:(128/174): gperftools-libs-2.9.1-2.el9.x86_64.r 852 kB/s | 309 kB 00:00 2024-05-04T02:13:40.435 INFO:teuthology.orchestra.run.smithi001.stdout:(129/174): abseil-cpp-20211102.0-3.el9.x86_64.r 143 kB/s | 548 kB 00:03 2024-05-04T02:13:40.562 INFO:teuthology.orchestra.run.smithi001.stdout:(130/174): libarrow-doc-9.0.0-11.el9.noarch.rpm 174 kB/s | 26 kB 00:00 2024-05-04T02:13:40.586 INFO:teuthology.orchestra.run.smithi001.stdout:(131/174): liboath-2.6.7-2.el9.x86_64.rpm 323 kB/s | 49 kB 00:00 2024-05-04T02:13:40.644 INFO:teuthology.orchestra.run.smithi001.stdout:(132/174): libarrow-9.0.0-11.el9.x86_64.rpm 16 MB/s | 4.4 MB 00:00 2024-05-04T02:13:40.661 INFO:teuthology.orchestra.run.smithi001.stdout:(133/174): libunwind-1.6.2-1.el9.x86_64.rpm 671 kB/s | 67 kB 00:00 2024-05-04T02:13:40.686 INFO:teuthology.orchestra.run.smithi001.stdout:(134/174): luarocks-3.9.2-1.el9.noarch.rpm 1.5 MB/s | 151 kB 00:00 2024-05-04T02:13:40.736 INFO:teuthology.orchestra.run.smithi001.stdout:(135/174): parquet-libs-9.0.0-11.el9.x86_64.rpm 9.0 MB/s | 839 kB 00:00 2024-05-04T02:13:40.779 INFO:teuthology.orchestra.run.smithi001.stdout:(136/174): python3-asyncssh-2.13.2-5.el9.noarch 5.8 MB/s | 548 kB 00:00 2024-05-04T02:13:40.804 INFO:teuthology.orchestra.run.smithi001.stdout:(137/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 371 kB/s | 43 kB 00:00 2024-05-04T02:13:40.829 INFO:teuthology.orchestra.run.smithi001.stdout:(138/174): python3-cachetools-4.2.4-1.el9.noarc 350 kB/s | 32 kB 00:00 2024-05-04T02:13:40.854 INFO:teuthology.orchestra.run.smithi001.stdout:(139/174): python3-certifi-2021.10.8-2.el9.noar 198 kB/s | 15 kB 00:00 2024-05-04T02:13:40.879 INFO:teuthology.orchestra.run.smithi001.stdout:(140/174): python3-cheroot-8.6.0-4.el9.noarch.r 2.2 MB/s | 172 kB 00:00 2024-05-04T02:13:40.913 INFO:teuthology.orchestra.run.smithi001.stdout:(141/174): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-05-04T02:13:40.955 INFO:teuthology.orchestra.run.smithi001.stdout:(142/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.0 MB/s | 303 kB 00:00 2024-05-04T02:13:40.981 INFO:teuthology.orchestra.run.smithi001.stdout:(143/174): python3-colorama-0.4.4-12.el9.noarch 352 kB/s | 35 kB 00:00 2024-05-04T02:13:41.006 INFO:teuthology.orchestra.run.smithi001.stdout:(144/174): python3-google-auth-2.29.0-1.el9.noa 2.2 MB/s | 206 kB 00:00 2024-05-04T02:13:41.089 INFO:teuthology.orchestra.run.smithi001.stdout:(145/174): python3-grpcio-1.46.7-10.el9.x86_64. 15 MB/s | 2.0 MB 00:00 2024-05-04T02:13:41.115 INFO:teuthology.orchestra.run.smithi001.stdout:(146/174): python3-grpcio-tools-1.46.7-10.el9.x 1.1 MB/s | 144 kB 00:00 2024-05-04T02:13:41.140 INFO:teuthology.orchestra.run.smithi001.stdout:(147/174): python3-jaraco-8.2.1-3.el9.noarch.rp 80 kB/s | 11 kB 00:00 2024-05-04T02:13:41.232 INFO:teuthology.orchestra.run.smithi001.stdout:(148/174): python3-jaraco-classes-3.2.1-5.el9.n 125 kB/s | 18 kB 00:00 2024-05-04T02:13:41.257 INFO:teuthology.orchestra.run.smithi001.stdout:(149/174): python3-jaraco-collections-3.0.0-8.e 198 kB/s | 23 kB 00:00 2024-05-04T02:13:41.282 INFO:teuthology.orchestra.run.smithi001.stdout:(150/174): python3-jaraco-functools-3.5.0-2.el9 137 kB/s | 19 kB 00:00 2024-05-04T02:13:41.308 INFO:teuthology.orchestra.run.smithi001.stdout:(151/174): python3-jaraco-text-3.2.0-6.el9.noar 261 kB/s | 20 kB 00:00 2024-05-04T02:13:41.383 INFO:teuthology.orchestra.run.smithi001.stdout:(152/174): python3-kubernetes-26.1.0-2.el9.noar 10 MB/s | 1.0 MB 00:00 2024-05-04T02:13:41.408 INFO:teuthology.orchestra.run.smithi001.stdout:(153/174): python3-logutils-0.3.5-21.el9.noarch 370 kB/s | 46 kB 00:00 2024-05-04T02:13:41.433 INFO:teuthology.orchestra.run.smithi001.stdout:(154/174): python3-more-itertools-8.12.0-2.el9. 628 kB/s | 79 kB 00:00 2024-05-04T02:13:41.458 INFO:teuthology.orchestra.run.smithi001.stdout:(155/174): python3-natsort-7.1.1-5.el9.noarch.r 767 kB/s | 58 kB 00:00 2024-05-04T02:13:41.509 INFO:teuthology.orchestra.run.smithi001.stdout:(156/174): python3-pecan-1.4.2-3.el9.noarch.rpm 3.6 MB/s | 272 kB 00:00 2024-05-04T02:13:41.534 INFO:teuthology.orchestra.run.smithi001.stdout:(157/174): python3-portend-3.1.0-2.el9.noarch.r 164 kB/s | 16 kB 00:00 2024-05-04T02:13:41.559 INFO:teuthology.orchestra.run.smithi001.stdout:(158/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 896 kB/s | 90 kB 00:00 2024-05-04T02:13:41.585 INFO:teuthology.orchestra.run.smithi001.stdout:(159/174): python3-pyperclip-1.8.2-2.el9.noarch 376 kB/s | 28 kB 00:00 2024-05-04T02:13:41.635 INFO:teuthology.orchestra.run.smithi001.stdout:(160/174): python3-repoze-lru-0.7-16.el9.noarch 411 kB/s | 31 kB 00:00 2024-05-04T02:13:41.660 INFO:teuthology.orchestra.run.smithi001.stdout:(161/174): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-05-04T02:13:41.685 INFO:teuthology.orchestra.run.smithi001.stdout:(162/174): python3-rsa-4.9-2.el9.noarch.rpm 588 kB/s | 59 kB 00:00 2024-05-04T02:13:41.710 INFO:teuthology.orchestra.run.smithi001.stdout:(163/174): python3-tempora-5.0.0-2.el9.noarch.r 478 kB/s | 36 kB 00:00 2024-05-04T02:13:41.752 INFO:teuthology.orchestra.run.smithi001.stdout:(164/174): python3-typing-extensions-4.4.0-2.el 765 kB/s | 51 kB 00:00 2024-05-04T02:13:41.786 INFO:teuthology.orchestra.run.smithi001.stdout:(165/174): python3-webob-1.8.7-6.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-05-04T02:13:41.811 INFO:teuthology.orchestra.run.smithi001.stdout:(166/174): python3-websocket-client-1.2.3-2.el9 891 kB/s | 90 kB 00:00 2024-05-04T02:13:41.845 INFO:teuthology.orchestra.run.smithi001.stdout:(167/174): python3-werkzeug-2.0.3-3.el9.1.noarc 4.6 MB/s | 427 kB 00:00 2024-05-04T02:13:41.870 INFO:teuthology.orchestra.run.smithi001.stdout:(168/174): python3-zc-lockfile-2.0-10.el9.noarc 239 kB/s | 20 kB 00:00 2024-05-04T02:13:41.895 INFO:teuthology.orchestra.run.smithi001.stdout:(169/174): re2-20211101-3.el9.x86_64.rpm 2.3 MB/s | 192 kB 00:00 2024-05-04T02:13:41.962 INFO:teuthology.orchestra.run.smithi001.stdout:(170/174): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-05-04T02:13:42.263 INFO:teuthology.orchestra.run.smithi001.stdout:(171/174): openssl-3.2.1-1.el9.x86_64.rpm 4.5 MB/s | 1.3 MB 00:00 2024-05-04T02:13:42.413 INFO:teuthology.orchestra.run.smithi001.stdout:(172/174): openssl-libs-3.2.1-1.el9.x86_64.rpm 16 MB/s | 2.4 MB 00:00 2024-05-04T02:13:42.513 INFO:teuthology.orchestra.run.smithi001.stdout:(173/174): librbd1-19.0.0-3522.gbd4e00a3.el9.x8 5.0 MB/s | 3.1 MB 00:00 2024-05-04T02:13:42.713 INFO:teuthology.orchestra.run.smithi001.stdout:(174/174): librados2-19.0.0-3522.gbd4e00a3.el9. 3.9 MB/s | 3.3 MB 00:00 2024-05-04T02:13:42.719 INFO:teuthology.orchestra.run.smithi001.stdout:-------------------------------------------------------------------------------- 2024-05-04T02:13:42.719 INFO:teuthology.orchestra.run.smithi001.stdout:Total 16 MB/s | 2.1 GB 02:16 2024-05-04T02:13:43.795 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction check 2024-05-04T02:13:43.960 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction check succeeded. 2024-05-04T02:13:43.960 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction test 2024-05-04T02:13:45.601 INFO:teuthology.orchestra.run.smithi107.stdout:(47/174): rbd-mirror-debuginfo-19.0.0-3522.gbd4 8.8 MB/s | 53 MB 00:06 2024-05-04T02:13:45.659 INFO:teuthology.orchestra.run.smithi107.stdout:(48/174): rbd-nbd-19.0.0-3522.gbd4e00a3.el9.x86 2.9 MB/s | 170 kB 00:00 2024-05-04T02:13:45.843 INFO:teuthology.orchestra.run.smithi107.stdout:(49/174): rbd-nbd-debuginfo-19.0.0-3522.gbd4e00 7.0 MB/s | 1.3 MB 00:00 2024-05-04T02:13:45.901 INFO:teuthology.orchestra.run.smithi107.stdout:(50/174): ceph-grafana-dashboards-19.0.0-3522.g 588 kB/s | 34 kB 00:00 2024-05-04T02:13:45.960 INFO:teuthology.orchestra.run.smithi107.stdout:(51/174): ceph-mgr-cephadm-19.0.0-3522.gbd4e00a 2.4 MB/s | 142 kB 00:00 2024-05-04T02:13:46.443 INFO:teuthology.orchestra.run.smithi107.stdout:(52/174): librbd1-debuginfo-19.0.0-3522.gbd4e00 6.0 MB/s | 54 MB 00:08 2024-05-04T02:13:46.560 INFO:teuthology.orchestra.run.smithi107.stdout:(53/174): ceph-mgr-dashboard-19.0.0-3522.gbd4e0 5.9 MB/s | 3.5 MB 00:00 2024-05-04T02:13:46.619 INFO:teuthology.orchestra.run.smithi107.stdout:(54/174): ceph-mgr-modules-core-19.0.0-3522.gbd 4.6 MB/s | 274 kB 00:00 2024-05-04T02:13:46.686 INFO:teuthology.orchestra.run.smithi107.stdout:(55/174): ceph-mgr-rook-19.0.0-3522.gbd4e00a3.e 741 kB/s | 49 kB 00:00 2024-05-04T02:13:46.753 INFO:teuthology.orchestra.run.smithi107.stdout:(56/174): ceph-prometheus-alerts-19.0.0-3522.gb 247 kB/s | 16 kB 00:00 2024-05-04T02:13:46.828 INFO:teuthology.orchestra.run.smithi107.stdout:(57/174): ceph-volume-19.0.0-3522.gbd4e00a3.el9 3.6 MB/s | 273 kB 00:00 2024-05-04T02:13:46.979 INFO:teuthology.orchestra.run.smithi107.stdout:(58/174): cephadm-19.0.0-3522.gbd4e00a3.el9.noa 5.0 MB/s | 763 kB 00:00 2024-05-04T02:13:47.037 INFO:teuthology.orchestra.run.smithi107.stdout:(59/174): cephfs-top-19.0.0-3522.gbd4e00a3.el9. 314 kB/s | 18 kB 00:00 2024-05-04T02:13:47.146 INFO:teuthology.orchestra.run.smithi107.stdout:(60/174): fuse-2.9.9-15.el9.x86_64.rpm 742 kB/s | 80 kB 00:00 2024-05-04T02:13:47.254 INFO:teuthology.orchestra.run.smithi107.stdout:(61/174): libgfortran-11.4.1-3.el9.x86_64.rpm 7.3 MB/s | 803 kB 00:00 2024-05-04T02:13:47.297 INFO:teuthology.orchestra.run.smithi107.stdout:(62/174): libquadmath-11.4.1-3.el9.x86_64.rpm 4.6 MB/s | 195 kB 00:00 2024-05-04T02:13:47.339 INFO:teuthology.orchestra.run.smithi107.stdout:(63/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 6.0 MB/s | 253 kB 00:00 2024-05-04T02:13:47.431 INFO:teuthology.orchestra.run.smithi107.stdout:(64/174): ceph-mgr-diskprediction-local-19.0.0- 7.5 MB/s | 7.4 MB 00:00 2024-05-04T02:13:47.473 INFO:teuthology.orchestra.run.smithi107.stdout:(65/174): python3-cryptography-36.0.1-4.el9.x86 9.2 MB/s | 1.2 MB 00:00 2024-05-04T02:13:47.514 INFO:teuthology.orchestra.run.smithi107.stdout:(66/174): python3-pycparser-2.20-6.el9.noarch.r 3.2 MB/s | 135 kB 00:00 2024-05-04T02:13:47.556 INFO:teuthology.orchestra.run.smithi107.stdout:(67/174): python3-requests-2.25.1-8.el9.noarch. 2.9 MB/s | 125 kB 00:00 2024-05-04T02:13:47.582 INFO:teuthology.orchestra.run.smithi107.stdout:(68/174): python3-ply-3.11-14.el9.noarch.rpm 708 kB/s | 106 kB 00:00 2024-05-04T02:13:47.615 INFO:teuthology.orchestra.run.smithi107.stdout:(69/174): python3-urllib3-1.26.5-5.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-05-04T02:13:47.807 INFO:teuthology.orchestra.run.smithi107.stdout:(70/174): automake-1.16.2-8.el9.noarch.rpm 3.0 MB/s | 689 kB 00:00 2024-05-04T02:13:47.858 INFO:teuthology.orchestra.run.smithi107.stdout:(71/174): boost-program-options-1.75.0-8.el9.x8 2.1 MB/s | 107 kB 00:00 2024-05-04T02:13:47.891 INFO:teuthology.orchestra.run.smithi107.stdout:(72/174): bison-3.7.4-5.el9.x86_64.rpm 3.3 MB/s | 943 kB 00:00 2024-05-04T02:13:47.916 INFO:teuthology.orchestra.run.smithi107.stdout:(73/174): elfutils-libelf-devel-0.190-2.el9.x86 369 kB/s | 21 kB 00:00 2024-05-04T02:13:47.942 INFO:teuthology.orchestra.run.smithi107.stdout:(74/174): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-05-04T02:13:47.958 INFO:teuthology.orchestra.run.smithi107.stdout:(75/174): flexiblas-3.0.4-8.el9.x86_64.rpm 778 kB/s | 33 kB 00:00 2024-05-04T02:13:48.000 INFO:teuthology.orchestra.run.smithi107.stdout:(76/174): flexiblas-openblas-openmp-3.0.4-8.el9 439 kB/s | 18 kB 00:00 2024-05-04T02:13:48.084 INFO:teuthology.orchestra.run.smithi107.stdout:(77/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 21 MB/s | 3.0 MB 00:00 2024-05-04T02:13:48.109 INFO:teuthology.orchestra.run.smithi107.stdout:(78/174): libaio-devel-0.3.111-13.el9.x86_64.rp 102 kB/s | 11 kB 00:00 2024-05-04T02:13:48.135 INFO:teuthology.orchestra.run.smithi107.stdout:(79/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-05-04T02:13:48.160 INFO:teuthology.orchestra.run.smithi107.stdout:(80/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 903 kB/s | 45 kB 00:00 2024-05-04T02:13:48.194 INFO:teuthology.orchestra.run.smithi107.stdout:(81/174): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-05-04T02:13:48.227 INFO:teuthology.orchestra.run.smithi107.stdout:(82/174): libtool-2.4.6-45.el9.x86_64.rpm 8.5 MB/s | 582 kB 00:00 2024-05-04T02:13:48.253 INFO:teuthology.orchestra.run.smithi107.stdout:(83/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 435 kB/s | 25 kB 00:00 2024-05-04T02:13:48.278 INFO:teuthology.orchestra.run.smithi107.stdout:(84/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 947 kB/s | 47 kB 00:00 2024-05-04T02:13:48.303 INFO:teuthology.orchestra.run.smithi107.stdout:(85/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-05-04T02:13:48.328 INFO:teuthology.orchestra.run.smithi107.stdout:(86/174): lua-5.4.4-4.el9.x86_64.rpm 3.6 MB/s | 188 kB 00:00 2024-05-04T02:13:48.354 INFO:teuthology.orchestra.run.smithi107.stdout:(87/174): openblas-0.3.21-2.el9.x86_64.rpm 703 kB/s | 35 kB 00:00 2024-05-04T02:13:48.471 INFO:teuthology.orchestra.run.smithi107.stdout:(88/174): openblas-openmp-0.3.21-2.el9.x86_64.r 33 MB/s | 4.7 MB 00:00 2024-05-04T02:13:48.555 INFO:teuthology.orchestra.run.smithi107.stdout:(89/174): openssl-devel-3.2.1-1.el9.x86_64.rpm 22 MB/s | 4.4 MB 00:00 2024-05-04T02:13:48.605 INFO:teuthology.orchestra.run.smithi107.stdout:(90/174): postgresql-13.14-1.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-05-04T02:13:48.638 INFO:teuthology.orchestra.run.smithi107.stdout:(91/174): postgresql-contrib-13.14-1.el9.x86_64 11 MB/s | 911 kB 00:00 2024-05-04T02:13:48.664 INFO:teuthology.orchestra.run.smithi107.stdout:(92/174): postgresql-private-libs-13.14-1.el9.x 2.2 MB/s | 133 kB 00:00 2024-05-04T02:13:48.739 INFO:teuthology.orchestra.run.smithi107.stdout:(93/174): protobuf-3.14.0-13.el9.x86_64.rpm 13 MB/s | 1.0 MB 00:00 2024-05-04T02:13:48.789 INFO:teuthology.orchestra.run.smithi107.stdout:(94/174): python3-attrs-20.3.0-7.el9.noarch.rpm 1.7 MB/s | 87 kB 00:00 2024-05-04T02:13:48.890 INFO:teuthology.orchestra.run.smithi107.stdout:(95/174): postgresql-server-13.14-1.el9.x86_64. 23 MB/s | 5.8 MB 00:00 2024-05-04T02:13:48.940 INFO:teuthology.orchestra.run.smithi107.stdout:(96/174): python3-devel-3.9.18-3.el9.x86_64.rpm 4.8 MB/s | 244 kB 00:00 2024-05-04T02:13:49.015 INFO:teuthology.orchestra.run.smithi107.stdout:(97/174): python3-babel-2.9.1-2.el9.noarch.rpm 26 MB/s | 6.0 MB 00:00 2024-05-04T02:13:49.041 INFO:teuthology.orchestra.run.smithi107.stdout:(98/174): python3-jinja2-2.11.3-5.el9.noarch.rp 2.4 MB/s | 248 kB 00:00 2024-05-04T02:13:49.066 INFO:teuthology.orchestra.run.smithi107.stdout:(99/174): python3-jsonpatch-1.21-16.el9.noarch. 510 kB/s | 26 kB 00:00 2024-05-04T02:13:49.091 INFO:teuthology.orchestra.run.smithi107.stdout:(100/174): python3-jsonpointer-2.0-4.el9.noarch 382 kB/s | 19 kB 00:00 2024-05-04T02:13:49.116 INFO:teuthology.orchestra.run.smithi107.stdout:(101/174): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-05-04T02:13:49.142 INFO:teuthology.orchestra.run.smithi107.stdout:(102/174): python3-markupsafe-1.1.1-12.el9.x86_ 693 kB/s | 35 kB 00:00 2024-05-04T02:13:49.200 INFO:teuthology.orchestra.run.smithi107.stdout:(103/174): python3-numpy-f2py-1.20.1-5.el9.x86_ 4.2 MB/s | 250 kB 00:00 2024-05-04T02:13:49.276 INFO:teuthology.orchestra.run.smithi107.stdout:(104/174): python3-numpy-1.20.1-5.el9.x86_64.rp 32 MB/s | 5.1 MB 00:00 2024-05-04T02:13:49.301 INFO:teuthology.orchestra.run.smithi107.stdout:(105/174): python3-oauthlib-3.1.1-5.el9.noarch. 2.2 MB/s | 222 kB 00:00 2024-05-04T02:13:49.326 INFO:teuthology.orchestra.run.smithi107.stdout:(106/174): python3-packaging-20.9-5.el9.noarch. 1.5 MB/s | 77 kB 00:00 2024-05-04T02:13:49.343 INFO:teuthology.orchestra.run.smithi107.stdout:(107/174): python3-prettytable-0.7.2-27.el9.noa 1.0 MB/s | 42 kB 00:00 2024-05-04T02:13:49.377 INFO:teuthology.orchestra.run.smithi107.stdout:(108/174): python3-protobuf-3.14.0-13.el9.noarc 5.2 MB/s | 269 kB 00:00 2024-05-04T02:13:49.410 INFO:teuthology.orchestra.run.smithi107.stdout:(109/174): python3-pyasn1-0.4.8-6.el9.noarch.rp 2.3 MB/s | 159 kB 00:00 2024-05-04T02:13:49.436 INFO:teuthology.orchestra.run.smithi107.stdout:(110/174): python3-pyasn1-modules-0.4.8-6.el9.n 4.7 MB/s | 279 kB 00:00 2024-05-04T02:13:49.461 INFO:teuthology.orchestra.run.smithi107.stdout:(111/174): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-05-04T02:13:49.486 INFO:teuthology.orchestra.run.smithi107.stdout:(112/174): python3-requests-oauthlib-1.3.0-12.e 1.0 MB/s | 54 kB 00:00 2024-05-04T02:13:49.537 INFO:teuthology.orchestra.run.smithi107.stdout:(113/174): python3-toml-0.10.2-6.el9.noarch.rpm 828 kB/s | 42 kB 00:00 2024-05-04T02:13:49.587 INFO:teuthology.orchestra.run.smithi107.stdout:(114/174): python3-wcwidth-0.2.5-8.el9.noarch.r 884 kB/s | 44 kB 00:00 2024-05-04T02:13:49.638 INFO:teuthology.orchestra.run.smithi107.stdout:(115/174): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-05-04T02:13:49.688 INFO:teuthology.orchestra.run.smithi107.stdout:(116/174): qatlib-service-24.02.0-1.el9.x86_64. 722 kB/s | 36 kB 00:00 2024-05-04T02:13:49.763 INFO:teuthology.orchestra.run.smithi107.stdout:(117/174): qatzip-libs-1.2.0-1.el9.x86_64.rpm 632 kB/s | 47 kB 00:00 2024-05-04T02:13:49.813 INFO:teuthology.orchestra.run.smithi107.stdout:(118/174): socat-1.7.4.1-5.el9.x86_64.rpm 6.0 MB/s | 305 kB 00:00 2024-05-04T02:13:49.972 INFO:teuthology.orchestra.run.smithi107.stdout:(119/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 32 MB/s | 16 MB 00:00 2024-05-04T02:13:49.997 INFO:teuthology.orchestra.run.smithi107.stdout:(120/174): uuid-1.6.2-55.el9.x86_64.rpm 315 kB/s | 58 kB 00:00 2024-05-04T02:13:50.031 INFO:teuthology.orchestra.run.smithi107.stdout:(121/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.6 MB/s | 94 kB 00:00 2024-05-04T02:13:50.056 INFO:teuthology.orchestra.run.smithi107.stdout:(122/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-05-04T02:13:50.081 INFO:teuthology.orchestra.run.smithi107.stdout:(123/174): zlib-devel-1.2.11-41.el9.x86_64.rpm 893 kB/s | 45 kB 00:00 2024-05-04T02:13:50.115 INFO:teuthology.orchestra.run.smithi107.stdout:(124/174): lua-devel-5.4.4-4.el9.x86_64.rpm 379 kB/s | 22 kB 00:00 2024-05-04T02:13:50.240 INFO:teuthology.orchestra.run.smithi107.stdout:(125/174): protobuf-compiler-3.14.0-13.el9.x86_ 5.3 MB/s | 863 kB 00:00 2024-05-04T02:13:50.466 INFO:teuthology.orchestra.run.smithi107.stdout:(126/174): abseil-cpp-20211102.0-3.el9.x86_64.r 1.5 MB/s | 548 kB 00:00 2024-05-04T02:13:50.524 INFO:teuthology.orchestra.run.smithi107.stdout:(127/174): grpc-data-1.46.7-10.el9.noarch.rpm 335 kB/s | 19 kB 00:00 2024-05-04T02:13:50.624 INFO:teuthology.orchestra.run.smithi107.stdout:(128/174): gperftools-libs-2.9.1-2.el9.x86_64.r 807 kB/s | 309 kB 00:00 2024-05-04T02:13:50.691 INFO:teuthology.orchestra.run.smithi107.stdout:(129/174): libarrow-doc-9.0.0-11.el9.noarch.rpm 391 kB/s | 26 kB 00:00 2024-05-04T02:13:50.783 INFO:teuthology.orchestra.run.smithi107.stdout:(130/174): libarrow-9.0.0-11.el9.x86_64.rpm 17 MB/s | 4.4 MB 00:00 2024-05-04T02:13:50.808 INFO:teuthology.orchestra.run.smithi107.stdout:(131/174): liboath-2.6.7-2.el9.x86_64.rpm 415 kB/s | 49 kB 00:00 2024-05-04T02:13:50.842 INFO:teuthology.orchestra.run.smithi107.stdout:(132/174): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-05-04T02:13:50.884 INFO:teuthology.orchestra.run.smithi107.stdout:(133/174): luarocks-3.9.2-1.el9.noarch.rpm 2.0 MB/s | 151 kB 00:00 2024-05-04T02:13:50.927 INFO:teuthology.orchestra.run.smithi107.stdout:(134/174): parquet-libs-9.0.0-11.el9.x86_64.rpm 9.8 MB/s | 839 kB 00:00 2024-05-04T02:13:50.985 INFO:teuthology.orchestra.run.smithi107.stdout:(135/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 745 kB/s | 43 kB 00:00 2024-05-04T02:13:51.018 INFO:teuthology.orchestra.run.smithi107.stdout:(136/174): python3-asyncssh-2.13.2-5.el9.noarch 4.0 MB/s | 548 kB 00:00 2024-05-04T02:13:51.043 INFO:teuthology.orchestra.run.smithi107.stdout:(137/174): python3-cachetools-4.2.4-1.el9.noarc 548 kB/s | 32 kB 00:00 2024-05-04T02:13:51.094 INFO:teuthology.orchestra.run.smithi107.stdout:(138/174): python3-certifi-2021.10.8-2.el9.noar 198 kB/s | 15 kB 00:00 2024-05-04T02:13:51.119 INFO:teuthology.orchestra.run.smithi107.stdout:(139/174): python3-cheroot-8.6.0-4.el9.noarch.r 2.2 MB/s | 172 kB 00:00 2024-05-04T02:13:51.220 INFO:teuthology.orchestra.run.smithi107.stdout:(140/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.0 MB/s | 303 kB 00:00 2024-05-04T02:13:51.245 INFO:teuthology.orchestra.run.smithi107.stdout:(141/174): python3-cherrypy-18.6.1-2.el9.noarch 2.3 MB/s | 358 kB 00:00 2024-05-04T02:13:51.279 INFO:teuthology.orchestra.run.smithi107.stdout:(142/174): python3-colorama-0.4.4-12.el9.noarch 601 kB/s | 35 kB 00:00 2024-05-04T02:13:51.312 INFO:teuthology.orchestra.run.smithi107.stdout:(143/174): python3-google-auth-2.29.0-1.el9.noa 3.0 MB/s | 206 kB 00:00 2024-05-04T02:13:51.404 INFO:teuthology.orchestra.run.smithi107.stdout:(144/174): python3-grpcio-1.46.7-10.el9.x86_64. 16 MB/s | 2.0 MB 00:00 2024-05-04T02:13:51.430 INFO:teuthology.orchestra.run.smithi107.stdout:(145/174): python3-grpcio-tools-1.46.7-10.el9.x 1.2 MB/s | 144 kB 00:00 2024-05-04T02:13:51.455 INFO:teuthology.orchestra.run.smithi107.stdout:(146/174): python3-jaraco-8.2.1-3.el9.noarch.rp 212 kB/s | 11 kB 00:00 2024-05-04T02:13:51.489 INFO:teuthology.orchestra.run.smithi107.stdout:(147/174): python3-jaraco-classes-3.2.1-5.el9.n 302 kB/s | 18 kB 00:00 2024-05-04T02:13:51.514 INFO:teuthology.orchestra.run.smithi107.stdout:(148/174): python3-jaraco-collections-3.0.0-8.e 395 kB/s | 23 kB 00:00 2024-05-04T02:13:51.556 INFO:teuthology.orchestra.run.smithi107.stdout:(149/174): python3-jaraco-functools-3.5.0-2.el9 290 kB/s | 19 kB 00:00 2024-05-04T02:13:51.581 INFO:teuthology.orchestra.run.smithi107.stdout:(150/174): python3-jaraco-text-3.2.0-6.el9.noar 293 kB/s | 20 kB 00:00 2024-05-04T02:13:51.640 INFO:teuthology.orchestra.run.smithi107.stdout:(151/174): python3-logutils-0.3.5-21.el9.noarch 794 kB/s | 46 kB 00:00 2024-05-04T02:13:51.690 INFO:teuthology.orchestra.run.smithi107.stdout:(152/174): python3-more-itertools-8.12.0-2.el9. 1.5 MB/s | 79 kB 00:00 2024-05-04T02:13:51.723 INFO:teuthology.orchestra.run.smithi107.stdout:(153/174): python3-kubernetes-26.1.0-2.el9.noar 6.1 MB/s | 1.0 MB 00:00 2024-05-04T02:13:51.749 INFO:teuthology.orchestra.run.smithi107.stdout:(154/174): python3-natsort-7.1.1-5.el9.noarch.r 985 kB/s | 58 kB 00:00 2024-05-04T02:13:51.791 INFO:teuthology.orchestra.run.smithi107.stdout:(155/174): python3-pecan-1.4.2-3.el9.noarch.rpm 4.0 MB/s | 272 kB 00:00 2024-05-04T02:13:51.816 INFO:teuthology.orchestra.run.smithi107.stdout:(156/174): python3-portend-3.1.0-2.el9.noarch.r 245 kB/s | 16 kB 00:00 2024-05-04T02:13:51.858 INFO:teuthology.orchestra.run.smithi107.stdout:(157/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2024-05-04T02:13:51.883 INFO:teuthology.orchestra.run.smithi107.stdout:(158/174): python3-pyperclip-1.8.2-2.el9.noarch 422 kB/s | 28 kB 00:00 2024-05-04T02:13:51.925 INFO:teuthology.orchestra.run.smithi107.stdout:(159/174): python3-repoze-lru-0.7-16.el9.noarch 460 kB/s | 31 kB 00:00 2024-05-04T02:13:51.942 INFO:teuthology.orchestra.run.smithi107.stdout:(160/174): python3-routes-2.5.1-5.el9.noarch.rp 3.1 MB/s | 188 kB 00:00 2024-05-04T02:13:52.001 INFO:teuthology.orchestra.run.smithi107.stdout:(161/174): python3-rsa-4.9-2.el9.noarch.rpm 785 kB/s | 59 kB 00:00 2024-05-04T02:13:52.026 INFO:teuthology.orchestra.run.smithi107.stdout:(162/174): python3-tempora-5.0.0-2.el9.noarch.r 428 kB/s | 36 kB 00:00 2024-05-04T02:13:52.076 INFO:teuthology.orchestra.run.smithi107.stdout:(163/174): python3-typing-extensions-4.4.0-2.el 677 kB/s | 51 kB 00:00 2024-05-04T02:13:52.102 INFO:teuthology.orchestra.run.smithi107.stdout:(164/174): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-05-04T02:13:52.168 INFO:teuthology.orchestra.run.smithi107.stdout:(165/174): python3-websocket-client-1.2.3-2.el9 977 kB/s | 90 kB 00:00 2024-05-04T02:13:52.219 INFO:teuthology.orchestra.run.smithi107.stdout:(166/174): python3-werkzeug-2.0.3-3.el9.1.noarc 3.6 MB/s | 427 kB 00:00 2024-05-04T02:13:52.261 INFO:teuthology.orchestra.run.smithi107.stdout:(167/174): python3-zc-lockfile-2.0-10.el9.noarc 217 kB/s | 20 kB 00:00 2024-05-04T02:13:52.286 INFO:teuthology.orchestra.run.smithi107.stdout:(168/174): re2-20211101-3.el9.x86_64.rpm 2.8 MB/s | 192 kB 00:00 2024-05-04T02:13:52.612 INFO:teuthology.orchestra.run.smithi107.stdout:(169/174): thrift-0.15.0-2.el9.x86_64.rpm 4.5 MB/s | 1.6 MB 00:00 2024-05-04T02:13:52.829 INFO:teuthology.orchestra.run.smithi107.stdout:(170/174): librados2-19.0.0-3522.gbd4e00a3.el9. 6.1 MB/s | 3.3 MB 00:00 2024-05-04T02:13:52.987 INFO:teuthology.orchestra.run.smithi107.stdout:(171/174): openssl-3.2.1-1.el9.x86_64.rpm 8.5 MB/s | 1.3 MB 00:00 2024-05-04T02:13:53.062 INFO:teuthology.orchestra.run.smithi107.stdout:(172/174): openssl-libs-3.2.1-1.el9.x86_64.rpm 32 MB/s | 2.4 MB 00:00 2024-05-04T02:13:53.388 INFO:teuthology.orchestra.run.smithi107.stdout:(173/174): librbd1-19.0.0-3522.gbd4e00a3.el9.x8 4.0 MB/s | 3.1 MB 00:00 2024-05-04T02:13:57.777 INFO:teuthology.orchestra.run.smithi001.stdout:Transaction test succeeded. 2024-05-04T02:13:57.777 INFO:teuthology.orchestra.run.smithi001.stdout:Running transaction 2024-05-04T02:13:59.512 INFO:teuthology.orchestra.run.smithi107.stdout:(174/174): ceph-test-debuginfo-19.0.0-3522.gbd4 7.5 MB/s | 623 MB 01:22 2024-05-04T02:13:59.518 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2024-05-04T02:13:59.518 INFO:teuthology.orchestra.run.smithi107.stdout:Total 14 MB/s | 2.1 GB 02:31 2024-05-04T02:14:00.563 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2024-05-04T02:14:00.711 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2024-05-04T02:14:00.711 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2024-05-04T02:14:13.820 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2024-05-04T02:14:13.821 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2024-05-04T02:14:16.391 INFO:teuthology.orchestra.run.smithi001.stdout: Preparing : 1/1 2024-05-04T02:14:19.518 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/178 2024-05-04T02:14:19.548 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-debuginfo-2:19.0.0-3522.gbd4e00a3.el9.x86_6 2/178 2024-05-04T02:14:19.587 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/178 2024-05-04T02:14:19.750 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 4/178 2024-05-04T02:14:19.783 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/178 2024-05-04T02:14:19.808 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 6/178 2024-05-04T02:14:19.851 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 7/178 2024-05-04T02:14:20.202 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 8/178 2024-05-04T02:14:20.309 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : librados2-2:19.0.0-3522.gbd4e00a3.el9.x86_64 9/178 2024-05-04T02:14:20.436 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: librados2-2:19.0.0-3522.gbd4e00a3.el9.x86_64 9/178 2024-05-04T02:14:20.468 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libcephfs2-2:19.0.0-3522.gbd4e00a3.el9.x86_64 10/178 2024-05-04T02:14:20.561 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: libcephfs2-2:19.0.0-3522.gbd4e00a3.el9.x86_64 10/178 2024-05-04T02:14:20.598 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-rados-2:19.0.0-3522.gbd4e00a3.el9.x86_64 11/178 2024-05-04T02:14:20.754 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 12/178 2024-05-04T02:14:20.803 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : postgresql-13.14-1.el9.x86_64 13/178 2024-05-04T02:14:20.830 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libcephsqlite-2:19.0.0-3522.gbd4e00a3.el9.x86_64 14/178 2024-05-04T02:14:20.937 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3522.gbd4e00a3.el9.x86_64 14/178 2024-05-04T02:14:20.965 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libradosstriper1-2:19.0.0-3522.gbd4e00a3.el9.x86 15/178 2024-05-04T02:14:21.027 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3522.gbd4e00a3.el9.x86 15/178 2024-05-04T02:14:21.049 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/178 2024-05-04T02:14:21.068 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/178 2024-05-04T02:14:21.250 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/178 2024-05-04T02:14:21.283 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/178 2024-05-04T02:14:21.392 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : re2-1:20211101-3.el9.x86_64 18/178 2024-05-04T02:14:21.422 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 19/178 2024-05-04T02:14:21.458 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/178 2024-05-04T02:14:21.534 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/178 2024-05-04T02:14:21.573 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/178 2024-05-04T02:14:21.620 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/178 2024-05-04T02:14:21.658 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/178 2024-05-04T02:14:21.686 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/178 2024-05-04T02:14:21.758 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/178 2024-05-04T02:14:21.817 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/178 2024-05-04T02:14:21.847 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/178 2024-05-04T02:14:21.899 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/178 2024-05-04T02:14:21.978 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/178 2024-05-04T02:14:22.010 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-ceph-common-2:19.0.0-3522.gbd4e00a3.el9. 31/178 2024-05-04T02:14:22.053 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-ceph-argparse-2:19.0.0-3522.gbd4e00a3.el 32/178 2024-05-04T02:14:22.081 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-cephfs-2:19.0.0-3522.gbd4e00a3.el9.x86_6 33/178 2024-05-04T02:14:22.157 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/178 2024-05-04T02:14:22.205 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/178 2024-05-04T02:14:22.283 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/178 2024-05-04T02:14:22.427 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/178 2024-05-04T02:14:22.475 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/178 2024-05-04T02:14:23.032 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/178 2024-05-04T02:14:23.130 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/178 2024-05-04T02:14:23.165 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/178 2024-05-04T02:14:23.208 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/178 2024-05-04T02:14:23.245 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : librados-devel-2:19.0.0-3522.gbd4e00a3.el9.x86_6 43/178 2024-05-04T02:14:23.287 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/178 2024-05-04T02:14:23.445 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/178 2024-05-04T02:14:23.490 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/178 2024-05-04T02:14:23.585 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/178 2024-05-04T02:14:23.648 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 48/178 2024-05-04T02:14:23.722 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 49/178 2024-05-04T02:14:23.766 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 50/178 2024-05-04T02:14:23.803 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 51/178 2024-05-04T02:14:23.851 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 52/178 2024-05-04T02:14:23.886 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 53/178 2024-05-04T02:14:23.938 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 54/178 2024-05-04T02:14:23.979 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 55/178 2024-05-04T02:14:24.126 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 56/178 2024-05-04T02:14:24.185 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 57/178 2024-05-04T02:14:24.215 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 58/178 2024-05-04T02:14:24.257 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 59/178 2024-05-04T02:14:24.364 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 60/178 2024-05-04T02:14:24.406 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 61/178 2024-05-04T02:14:24.446 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 62/178 2024-05-04T02:14:24.480 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 63/178 2024-05-04T02:14:24.504 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 64/178 2024-05-04T02:14:24.583 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 65/178 2024-05-04T02:14:24.713 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 66/178 2024-05-04T02:14:24.745 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 67/178 2024-05-04T02:14:24.773 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 68/178 2024-05-04T02:14:24.816 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 69/178 2024-05-04T02:14:24.857 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : uuid-1.6.2-55.el9.x86_64 70/178 2024-05-04T02:14:24.895 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 71/178 2024-05-04T02:14:24.933 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 72/178 2024-05-04T02:14:24.968 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 73/178 2024-05-04T02:14:25.001 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 74/178 2024-05-04T02:14:25.043 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 75/178 2024-05-04T02:14:25.077 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 76/178 2024-05-04T02:14:25.167 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 77/178 2024-05-04T02:14:25.216 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 78/178 2024-05-04T02:14:25.255 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 79/178 2024-05-04T02:14:25.303 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 80/178 2024-05-04T02:14:25.414 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-packaging-20.9-5.el9.noarch 81/178 2024-05-04T02:14:25.465 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/178 2024-05-04T02:14:26.236 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/178 2024-05-04T02:14:26.287 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/178 2024-05-04T02:14:26.320 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/178 2024-05-04T02:14:26.424 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/178 2024-05-04T02:14:26.479 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 87/178 2024-05-04T02:14:26.570 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 88/178 2024-05-04T02:14:26.605 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 89/178 2024-05-04T02:14:26.789 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : openblas-0.3.21-2.el9.x86_64 90/178 2024-05-04T02:14:26.819 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 91/178 2024-05-04T02:14:26.899 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 92/178 2024-05-04T02:14:27.591 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 93/178 2024-05-04T02:14:27.722 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 94/178 2024-05-04T02:14:29.018 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 95/178 2024-05-04T02:14:29.090 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 96/178 2024-05-04T02:14:29.117 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 97/178 2024-05-04T02:14:29.151 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 98/178 2024-05-04T02:14:29.484 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 99/178 2024-05-04T02:14:29.530 INFO:teuthology.orchestra.run.smithi001.stdout: Upgrading : librbd1-2:19.0.0-3522.gbd4e00a3.el9.x86_64 100/178 2024-05-04T02:14:29.605 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: librbd1-2:19.0.0-3522.gbd4e00a3.el9.x86_64 100/178 2024-05-04T02:14:29.635 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-rbd-2:19.0.0-3522.gbd4e00a3.el9.x86_64 101/178 2024-05-04T02:14:29.671 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 102/178 2024-05-04T02:14:30.186 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 103/178 2024-05-04T02:14:30.216 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : librgw2-2:19.0.0-3522.gbd4e00a3.el9.x86_64 104/178 2024-05-04T02:14:30.287 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: librgw2-2:19.0.0-3522.gbd4e00a3.el9.x86_64 104/178 2024-05-04T02:14:30.309 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-rgw-2:19.0.0-3522.gbd4e00a3.el9.x86_64 105/178 2024-05-04T02:14:31.669 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2024-05-04T02:14:32.644 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-common-2:19.0.0-3522.gbd4e00a3.el9.x86_64 106/178 2024-05-04T02:14:32.681 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-common-2:19.0.0-3522.gbd4e00a3.el9.x86_64 106/178 2024-05-04T02:14:33.269 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-common-2:19.0.0-3522.gbd4e00a3.el9.x86_64 106/178 2024-05-04T02:14:33.309 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-base-2:19.0.0-3522.gbd4e00a3.el9.x86_64 107/178 2024-05-04T02:14:33.383 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-base-2:19.0.0-3522.gbd4e00a3.el9.x86_64 107/178 2024-05-04T02:14:33.383 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-04T02:14:33.383 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-04T02:14:33.383 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:14:33.410 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-selinux-2:19.0.0-3522.gbd4e00a3.el9.x86_64 108/178 2024-05-04T02:14:34.597 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/178 2024-05-04T02:14:34.702 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-debuginfo-2:19.0.0-3522.gbd4e00a3.el9.x86_6 2/178 2024-05-04T02:14:34.740 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/178 2024-05-04T02:14:34.794 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 4/178 2024-05-04T02:14:34.836 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/178 2024-05-04T02:14:34.861 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 6/178 2024-05-04T02:14:34.904 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 7/178 2024-05-04T02:14:35.229 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 8/178 2024-05-04T02:14:35.338 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : librados2-2:19.0.0-3522.gbd4e00a3.el9.x86_64 9/178 2024-05-04T02:14:35.462 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librados2-2:19.0.0-3522.gbd4e00a3.el9.x86_64 9/178 2024-05-04T02:14:35.489 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libcephfs2-2:19.0.0-3522.gbd4e00a3.el9.x86_64 10/178 2024-05-04T02:14:35.579 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: libcephfs2-2:19.0.0-3522.gbd4e00a3.el9.x86_64 10/178 2024-05-04T02:14:35.618 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rados-2:19.0.0-3522.gbd4e00a3.el9.x86_64 11/178 2024-05-04T02:14:35.765 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 12/178 2024-05-04T02:14:35.815 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : postgresql-13.14-1.el9.x86_64 13/178 2024-05-04T02:14:35.843 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libcephsqlite-2:19.0.0-3522.gbd4e00a3.el9.x86_64 14/178 2024-05-04T02:14:35.930 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3522.gbd4e00a3.el9.x86_64 14/178 2024-05-04T02:14:35.961 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libradosstriper1-2:19.0.0-3522.gbd4e00a3.el9.x86 15/178 2024-05-04T02:14:36.023 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3522.gbd4e00a3.el9.x86 15/178 2024-05-04T02:14:36.045 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/178 2024-05-04T02:14:36.065 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/178 2024-05-04T02:14:36.253 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/178 2024-05-04T02:14:36.286 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/178 2024-05-04T02:14:36.392 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : re2-1:20211101-3.el9.x86_64 18/178 2024-05-04T02:14:36.426 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 19/178 2024-05-04T02:14:36.460 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/178 2024-05-04T02:14:36.525 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/178 2024-05-04T02:14:36.568 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/178 2024-05-04T02:14:36.612 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/178 2024-05-04T02:14:36.644 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/178 2024-05-04T02:14:36.672 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/178 2024-05-04T02:14:36.741 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/178 2024-05-04T02:14:36.812 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/178 2024-05-04T02:14:36.842 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/178 2024-05-04T02:14:36.886 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/178 2024-05-04T02:14:36.963 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/178 2024-05-04T02:14:36.997 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-ceph-common-2:19.0.0-3522.gbd4e00a3.el9. 31/178 2024-05-04T02:14:37.040 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-ceph-argparse-2:19.0.0-3522.gbd4e00a3.el 32/178 2024-05-04T02:14:37.068 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cephfs-2:19.0.0-3522.gbd4e00a3.el9.x86_6 33/178 2024-05-04T02:14:37.138 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/178 2024-05-04T02:14:37.199 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/178 2024-05-04T02:14:37.273 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/178 2024-05-04T02:14:37.405 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/178 2024-05-04T02:14:37.468 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/178 2024-05-04T02:14:37.996 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/178 2024-05-04T02:14:38.079 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/178 2024-05-04T02:14:38.110 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/178 2024-05-04T02:14:38.144 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/178 2024-05-04T02:14:38.182 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librados-devel-2:19.0.0-3522.gbd4e00a3.el9.x86_6 43/178 2024-05-04T02:14:38.223 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/178 2024-05-04T02:14:38.369 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/178 2024-05-04T02:14:38.426 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/178 2024-05-04T02:14:38.517 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/178 2024-05-04T02:14:38.582 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 48/178 2024-05-04T02:14:38.654 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 49/178 2024-05-04T02:14:38.686 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 50/178 2024-05-04T02:14:38.723 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 51/178 2024-05-04T02:14:38.770 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 52/178 2024-05-04T02:14:38.806 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 53/178 2024-05-04T02:14:38.848 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 54/178 2024-05-04T02:14:38.891 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 55/178 2024-05-04T02:14:39.026 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 56/178 2024-05-04T02:14:39.071 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 57/178 2024-05-04T02:14:39.101 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 58/178 2024-05-04T02:14:39.143 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 59/178 2024-05-04T02:14:39.237 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 60/178 2024-05-04T02:14:39.276 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 61/178 2024-05-04T02:14:39.316 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 62/178 2024-05-04T02:14:39.342 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 63/178 2024-05-04T02:14:39.366 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 64/178 2024-05-04T02:14:39.441 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 65/178 2024-05-04T02:14:39.568 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 66/178 2024-05-04T02:14:39.608 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 67/178 2024-05-04T02:14:39.627 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 68/178 2024-05-04T02:14:39.661 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 69/178 2024-05-04T02:14:39.700 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : uuid-1.6.2-55.el9.x86_64 70/178 2024-05-04T02:14:39.732 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 71/178 2024-05-04T02:14:39.762 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 72/178 2024-05-04T02:14:39.796 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 73/178 2024-05-04T02:14:39.830 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 74/178 2024-05-04T02:14:39.870 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 75/178 2024-05-04T02:14:39.922 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 76/178 2024-05-04T02:14:40.008 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 77/178 2024-05-04T02:14:40.052 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 78/178 2024-05-04T02:14:40.084 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 79/178 2024-05-04T02:14:40.130 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 80/178 2024-05-04T02:14:40.229 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-packaging-20.9-5.el9.noarch 81/178 2024-05-04T02:14:40.276 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/178 2024-05-04T02:14:40.990 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/178 2024-05-04T02:14:41.040 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/178 2024-05-04T02:14:41.074 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/178 2024-05-04T02:14:41.172 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/178 2024-05-04T02:14:41.231 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 87/178 2024-05-04T02:14:41.319 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 88/178 2024-05-04T02:14:41.359 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 89/178 2024-05-04T02:14:41.536 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : openblas-0.3.21-2.el9.x86_64 90/178 2024-05-04T02:14:41.565 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 91/178 2024-05-04T02:14:41.642 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 92/178 2024-05-04T02:14:42.276 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 93/178 2024-05-04T02:14:42.387 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 94/178 2024-05-04T02:14:43.609 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 95/178 2024-05-04T02:14:43.694 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 96/178 2024-05-04T02:14:43.722 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 97/178 2024-05-04T02:14:43.755 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 98/178 2024-05-04T02:14:44.073 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 99/178 2024-05-04T02:14:44.110 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : librbd1-2:19.0.0-3522.gbd4e00a3.el9.x86_64 100/178 2024-05-04T02:14:44.200 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librbd1-2:19.0.0-3522.gbd4e00a3.el9.x86_64 100/178 2024-05-04T02:14:44.231 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rbd-2:19.0.0-3522.gbd4e00a3.el9.x86_64 101/178 2024-05-04T02:14:44.268 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 102/178 2024-05-04T02:14:44.754 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 103/178 2024-05-04T02:14:44.780 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librgw2-2:19.0.0-3522.gbd4e00a3.el9.x86_64 104/178 2024-05-04T02:14:44.850 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librgw2-2:19.0.0-3522.gbd4e00a3.el9.x86_64 104/178 2024-05-04T02:14:44.873 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rgw-2:19.0.0-3522.gbd4e00a3.el9.x86_64 105/178 2024-05-04T02:14:47.132 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-common-2:19.0.0-3522.gbd4e00a3.el9.x86_64 106/178 2024-05-04T02:14:47.161 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3522.gbd4e00a3.el9.x86_64 108/178 2024-05-04T02:14:47.161 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /sys 2024-05-04T02:14:47.161 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /proc 2024-05-04T02:14:47.161 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /mnt 2024-05-04T02:14:47.161 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /var/tmp 2024-05-04T02:14:47.161 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /home 2024-05-04T02:14:47.162 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /root 2024-05-04T02:14:47.162 INFO:teuthology.orchestra.run.smithi001.stdout:skipping the directory /tmp 2024-05-04T02:14:47.162 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:14:47.169 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-common-2:19.0.0-3522.gbd4e00a3.el9.x86_64 106/178 2024-05-04T02:14:47.342 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-volume-2:19.0.0-3522.gbd4e00a3.el9.noarch 109/178 2024-05-04T02:14:47.358 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-volume-2:19.0.0-3522.gbd4e00a3.el9.noarch 109/178 2024-05-04T02:14:47.358 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-04T02:14:47.358 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-04T02:14:47.358 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:14:47.729 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-common-2:19.0.0-3522.gbd4e00a3.el9.x86_64 106/178 2024-05-04T02:14:47.914 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-base-2:19.0.0-3522.gbd4e00a3.el9.x86_64 107/178 2024-05-04T02:14:48.008 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-base-2:19.0.0-3522.gbd4e00a3.el9.x86_64 107/178 2024-05-04T02:14:48.008 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-04T02:14:48.008 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-04T02:14:48.008 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-04T02:14:48.040 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-selinux-2:19.0.0-3522.gbd4e00a3.el9.x86_64 108/178 2024-05-04T02:14:48.986 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-osd-2:19.0.0-3522.gbd4e00a3.el9.x86_64 110/178 2024-05-04T02:14:49.013 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-osd-2:19.0.0-3522.gbd4e00a3.el9.x86_64 110/178 2024-05-04T02:14:49.013 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-04T02:14:49.013 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-04T02:14:49.013 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-04T02:14:49.013 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-04T02:14:49.013 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:14:49.246 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mds-2:19.0.0-3522.gbd4e00a3.el9.x86_64 111/178 2024-05-04T02:14:49.268 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mds-2:19.0.0-3522.gbd4e00a3.el9.x86_64 111/178 2024-05-04T02:14:49.269 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-04T02:14:49.269 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-04T02:14:49.269 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-04T02:14:49.269 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-04T02:14:49.269 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:14:49.879 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mon-2:19.0.0-3522.gbd4e00a3.el9.x86_64 112/178 2024-05-04T02:14:49.903 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mon-2:19.0.0-3522.gbd4e00a3.el9.x86_64 112/178 2024-05-04T02:14:49.903 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-04T02:14:49.903 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-04T02:14:49.903 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-04T02:14:49.904 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-04T02:14:49.904 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:14:50.010 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : automake-1.16.2-8.el9.noarch 113/178 2024-05-04T02:14:50.069 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-ply-3.11-14.el9.noarch 114/178 2024-05-04T02:14:50.132 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 115/178 2024-05-04T02:14:50.338 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 116/178 2024-05-04T02:14:50.389 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 117/178 2024-05-04T02:14:50.471 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 118/178 2024-05-04T02:14:50.569 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 119/178 2024-05-04T02:14:50.843 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 120/178 2024-05-04T02:14:50.889 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 121/178 2024-05-04T02:14:50.921 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 122/178 2024-05-04T02:14:50.948 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : fuse-2.9.9-15.el9.x86_64 123/178 2024-05-04T02:14:51.370 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: cephadm-2:19.0.0-3522.gbd4e00a3.el9.noarch 124/178 2024-05-04T02:14:51.413 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : cephadm-2:19.0.0-3522.gbd4e00a3.el9.noarch 124/178 2024-05-04T02:14:51.447 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3522.gbd4e00a3.e 125/178 2024-05-04T02:14:51.511 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3522.gbd4e00a3. 126/178 2024-05-04T02:14:51.536 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3522.gbd4e00a3.el9.noa 127/178 2024-05-04T02:14:52.629 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3522.gbd4e00a3.el9.noa 127/178 2024-05-04T02:14:52.663 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3522.gbd4e00a3.el9.n 128/178 2024-05-04T02:14:53.673 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3522.gbd4e00a3.el9.n 128/178 2024-05-04T02:14:53.697 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3522.gbd4 129/178 2024-05-04T02:14:53.814 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3522.gbd4 129/178 2024-05-04T02:14:53.987 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3522.gbd4e00a3.el 130/178 2024-05-04T02:14:54.016 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mgr-2:19.0.0-3522.gbd4e00a3.el9.x86_64 131/178 2024-05-04T02:14:54.039 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3522.gbd4e00a3.el9.x86_64 131/178 2024-05-04T02:14:54.039 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-04T02:14:54.039 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-04T02:14:54.039 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-04T02:14:54.040 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-04T02:14:54.040 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:14:54.091 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mgr-rook-2:19.0.0-3522.gbd4e00a3.el9.noarch 132/178 2024-05-04T02:14:54.102 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3522.gbd4e00a3.el9.noarch 132/178 2024-05-04T02:14:54.205 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-2:19.0.0-3522.gbd4e00a3.el9.x86_64 133/178 2024-05-04T02:14:54.266 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-fuse-2:19.0.0-3522.gbd4e00a3.el9.x86_64 134/178 2024-05-04T02:14:55.252 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libtool-2.4.6-45.el9.x86_64 135/178 2024-05-04T02:14:55.285 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-radosgw-2:19.0.0-3522.gbd4e00a3.el9.x86_64 136/178 2024-05-04T02:14:55.309 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3522.gbd4e00a3.el9.x86_64 136/178 2024-05-04T02:14:55.309 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-04T02:14:55.309 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-04T02:14:55.309 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-04T02:14:55.309 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-04T02:14:55.309 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:14:55.353 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3522.gbd4e0 137/178 2024-05-04T02:14:55.375 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3522.gbd4e0 137/178 2024-05-04T02:14:55.376 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-04T02:14:55.376 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-04T02:14:55.376 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:14:55.429 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : cephfs-mirror-2:19.0.0-3522.gbd4e00a3.el9.x86_64 138/178 2024-05-04T02:14:55.452 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3522.gbd4e00a3.el9.x86_64 138/178 2024-05-04T02:14:55.452 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-04T02:14:55.452 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-04T02:14:55.452 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-04T02:14:55.452 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-04T02:14:55.452 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:14:55.787 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : rbd-mirror-2:19.0.0-3522.gbd4e00a3.el9.x86_64 139/178 2024-05-04T02:14:55.811 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3522.gbd4e00a3.el9.x86_64 139/178 2024-05-04T02:14:55.811 INFO:teuthology.orchestra.run.smithi001.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-04T02:14:55.811 INFO:teuthology.orchestra.run.smithi001.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-04T02:14:55.811 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-04T02:14:55.814 INFO:teuthology.orchestra.run.smithi001.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-04T02:14:55.814 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:15:00.309 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-test-2:19.0.0-3522.gbd4e00a3.el9.x86_64 140/178 2024-05-04T02:15:00.350 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : rbd-fuse-2:19.0.0-3522.gbd4e00a3.el9.x86_64 141/178 2024-05-04T02:15:00.391 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : rbd-nbd-2:19.0.0-3522.gbd4e00a3.el9.x86_64 142/178 2024-05-04T02:15:00.422 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 143/178 2024-05-04T02:15:00.450 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 144/178 2024-05-04T02:15:00.653 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : cephfs-shell-2:19.0.0-3522.gbd4e00a3.el9.x86_64 145/178 2024-05-04T02:15:00.704 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 146/178 2024-05-04T02:15:00.734 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libcephfs-devel-2:19.0.0-3522.gbd4e00a3.el9.x86_ 147/178 2024-05-04T02:15:01.026 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3522.gbd4e00a3.el9.x86_64 108/178 2024-05-04T02:15:01.026 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /sys 2024-05-04T02:15:01.026 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /proc 2024-05-04T02:15:01.026 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /mnt 2024-05-04T02:15:01.026 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /var/tmp 2024-05-04T02:15:01.026 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /home 2024-05-04T02:15:01.027 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /root 2024-05-04T02:15:01.027 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /tmp 2024-05-04T02:15:01.027 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-04T02:15:01.193 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-volume-2:19.0.0-3522.gbd4e00a3.el9.noarch 109/178 2024-05-04T02:15:01.208 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-volume-2:19.0.0-3522.gbd4e00a3.el9.noarch 109/178 2024-05-04T02:15:01.209 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-04T02:15:01.209 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-04T02:15:01.209 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-04T02:15:01.406 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 148/178 2024-05-04T02:15:01.439 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 148/178 2024-05-04T02:15:01.459 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 148/178 2024-05-04T02:15:02.788 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-osd-2:19.0.0-3522.gbd4e00a3.el9.x86_64 110/178 2024-05-04T02:15:02.813 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-osd-2:19.0.0-3522.gbd4e00a3.el9.x86_64 110/178 2024-05-04T02:15:02.813 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-04T02:15:02.813 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-04T02:15:02.813 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-04T02:15:02.813 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-04T02:15:02.813 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-04T02:15:03.048 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mds-2:19.0.0-3522.gbd4e00a3.el9.x86_64 111/178 2024-05-04T02:15:03.070 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mds-2:19.0.0-3522.gbd4e00a3.el9.x86_64 111/178 2024-05-04T02:15:03.070 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-04T02:15:03.070 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-04T02:15:03.070 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-04T02:15:03.070 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-04T02:15:03.070 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-04T02:15:03.532 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mon-2:19.0.0-3522.gbd4e00a3.el9.x86_64 112/178 2024-05-04T02:15:03.554 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mon-2:19.0.0-3522.gbd4e00a3.el9.x86_64 112/178 2024-05-04T02:15:03.554 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-04T02:15:03.555 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-04T02:15:03.555 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-04T02:15:03.555 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-04T02:15:03.555 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-04T02:15:03.654 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : automake-1.16.2-8.el9.noarch 113/178 2024-05-04T02:15:03.711 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-ply-3.11-14.el9.noarch 114/178 2024-05-04T02:15:03.769 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 115/178 2024-05-04T02:15:03.952 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 116/178 2024-05-04T02:15:04.002 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 117/178 2024-05-04T02:15:04.078 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 118/178 2024-05-04T02:15:04.168 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 119/178 2024-05-04T02:15:04.304 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 120/178 2024-05-04T02:15:04.343 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 121/178 2024-05-04T02:15:04.375 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 122/178 2024-05-04T02:15:04.402 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : fuse-2.9.9-15.el9.x86_64 123/178 2024-05-04T02:15:04.787 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: cephadm-2:19.0.0-3522.gbd4e00a3.el9.noarch 124/178 2024-05-04T02:15:04.826 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : cephadm-2:19.0.0-3522.gbd4e00a3.el9.noarch 124/178 2024-05-04T02:15:04.858 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3522.gbd4e00a3.e 125/178 2024-05-04T02:15:04.919 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3522.gbd4e00a3. 126/178 2024-05-04T02:15:04.949 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3522.gbd4e00a3.el9.noa 127/178 2024-05-04T02:15:05.972 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3522.gbd4e00a3.el9.noa 127/178 2024-05-04T02:15:06.009 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3522.gbd4e00a3.el9.n 128/178 2024-05-04T02:15:06.966 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3522.gbd4e00a3.el9.n 128/178 2024-05-04T02:15:07.001 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3522.gbd4 129/178 2024-05-04T02:15:07.109 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3522.gbd4 129/178 2024-05-04T02:15:07.295 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3522.gbd4e00a3.el 130/178 2024-05-04T02:15:07.328 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-2:19.0.0-3522.gbd4e00a3.el9.x86_64 131/178 2024-05-04T02:15:07.350 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3522.gbd4e00a3.el9.x86_64 131/178 2024-05-04T02:15:07.350 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-04T02:15:07.350 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-04T02:15:07.350 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-04T02:15:07.350 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-04T02:15:07.351 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-04T02:15:07.395 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-rook-2:19.0.0-3522.gbd4e00a3.el9.noarch 132/178 2024-05-04T02:15:07.406 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3522.gbd4e00a3.el9.noarch 132/178 2024-05-04T02:15:07.506 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-2:19.0.0-3522.gbd4e00a3.el9.x86_64 133/178 2024-05-04T02:15:07.552 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-fuse-2:19.0.0-3522.gbd4e00a3.el9.x86_64 134/178 2024-05-04T02:15:08.488 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libtool-2.4.6-45.el9.x86_64 135/178 2024-05-04T02:15:08.523 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-radosgw-2:19.0.0-3522.gbd4e00a3.el9.x86_64 136/178 2024-05-04T02:15:08.545 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3522.gbd4e00a3.el9.x86_64 136/178 2024-05-04T02:15:08.545 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-04T02:15:08.545 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-04T02:15:08.545 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-04T02:15:08.545 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-04T02:15:08.545 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-04T02:15:08.590 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3522.gbd4e0 137/178 2024-05-04T02:15:08.611 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3522.gbd4e0 137/178 2024-05-04T02:15:08.611 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-04T02:15:08.611 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-04T02:15:08.611 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-04T02:15:08.657 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : cephfs-mirror-2:19.0.0-3522.gbd4e00a3.el9.x86_64 138/178 2024-05-04T02:15:08.679 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3522.gbd4e00a3.el9.x86_64 138/178 2024-05-04T02:15:08.679 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-04T02:15:08.680 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-04T02:15:08.680 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-04T02:15:08.680 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-04T02:15:08.680 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-04T02:15:08.991 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : rbd-mirror-2:19.0.0-3522.gbd4e00a3.el9.x86_64 139/178 2024-05-04T02:15:09.013 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3522.gbd4e00a3.el9.x86_64 139/178 2024-05-04T02:15:09.013 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-04T02:15:09.013 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-04T02:15:09.013 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-04T02:15:09.013 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-04T02:15:09.013 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-04T02:15:09.153 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : cephfs-top-2:19.0.0-3522.gbd4e00a3.el9.noarch 149/178 2024-05-04T02:15:13.278 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-test-2:19.0.0-3522.gbd4e00a3.el9.x86_64 140/178 2024-05-04T02:15:13.319 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : rbd-fuse-2:19.0.0-3522.gbd4e00a3.el9.x86_64 141/178 2024-05-04T02:15:13.359 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : rbd-nbd-2:19.0.0-3522.gbd4e00a3.el9.x86_64 142/178 2024-05-04T02:15:13.392 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 143/178 2024-05-04T02:15:13.419 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 144/178 2024-05-04T02:15:13.591 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : cephfs-shell-2:19.0.0-3522.gbd4e00a3.el9.x86_64 145/178 2024-05-04T02:15:13.632 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 146/178 2024-05-04T02:15:13.662 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libcephfs-devel-2:19.0.0-3522.gbd4e00a3.el9.x86_ 147/178 2024-05-04T02:15:14.297 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 148/178 2024-05-04T02:15:14.334 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 148/178 2024-05-04T02:15:14.353 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 148/178 2024-05-04T02:15:21.606 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : cephfs-top-2:19.0.0-3522.gbd4e00a3.el9.noarch 149/178 2024-05-04T02:15:53.082 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-base-debuginfo-2:19.0.0-3522.gbd4e00a3.el9. 150/178 2024-05-04T02:15:53.778 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-common-debuginfo-2:19.0.0-3522.gbd4e00a3.el 151/178 2024-05-04T02:15:53.962 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-fuse-debuginfo-2:19.0.0-3522.gbd4e00a3.el9. 152/178 2024-05-04T02:15:58.745 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:19.0.0-3 153/178 2024-05-04T02:16:01.532 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mds-debuginfo-2:19.0.0-3522.gbd4e00a3.el9.x 154/178 2024-05-04T02:16:03.012 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-base-debuginfo-2:19.0.0-3522.gbd4e00a3.el9. 150/178 2024-05-04T02:16:03.671 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-common-debuginfo-2:19.0.0-3522.gbd4e00a3.el 151/178 2024-05-04T02:16:03.842 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-fuse-debuginfo-2:19.0.0-3522.gbd4e00a3.el9. 152/178 2024-05-04T02:16:08.364 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:19.0.0-3 153/178 2024-05-04T02:16:11.036 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mds-debuginfo-2:19.0.0-3522.gbd4e00a3.el9.x 154/178 2024-05-04T02:16:11.997 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mgr-debuginfo-2:19.0.0-3522.gbd4e00a3.el9.x 155/178 2024-05-04T02:16:21.002 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-debuginfo-2:19.0.0-3522.gbd4e00a3.el9.x 155/178 2024-05-04T02:16:41.634 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-mon-debuginfo-2:19.0.0-3522.gbd4e00a3.el9.x 156/178 2024-05-04T02:16:48.931 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mon-debuginfo-2:19.0.0-3522.gbd4e00a3.el9.x 156/178 2024-05-04T02:17:03.014 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-osd-debuginfo-2:19.0.0-3522.gbd4e00a3.el9.x 157/178 2024-05-04T02:17:09.023 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-osd-debuginfo-2:19.0.0-3522.gbd4e00a3.el9.x 157/178 2024-05-04T02:18:13.907 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-radosgw-debuginfo-2:19.0.0-3522.gbd4e00a3.e 158/178 2024-05-04T02:18:14.529 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : ceph-test-debuginfo-2:19.0.0-3522.gbd4e00a3.el9. 159/178 2024-05-04T02:18:14.568 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libcephfs2-debuginfo-2:19.0.0-3522.gbd4e00a3.el9 160/178 2024-05-04T02:18:15.200 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-radosgw-debuginfo-2:19.0.0-3522.gbd4e00a3.e 158/178 2024-05-04T02:18:15.785 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-test-debuginfo-2:19.0.0-3522.gbd4e00a3.el9. 159/178 2024-05-04T02:18:15.827 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libcephfs2-debuginfo-2:19.0.0-3522.gbd4e00a3.el9 160/178 2024-05-04T02:18:19.997 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : librados-devel-debuginfo-2:19.0.0-3522.gbd4e00a3 161/178 2024-05-04T02:18:20.900 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librados-devel-debuginfo-2:19.0.0-3522.gbd4e00a3 161/178 2024-05-04T02:18:26.426 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : librados2-debuginfo-2:19.0.0-3522.gbd4e00a3.el9. 162/178 2024-05-04T02:18:26.761 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : librbd1-debuginfo-2:19.0.0-3522.gbd4e00a3.el9.x8 163/178 2024-05-04T02:18:26.902 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-cephfs-debuginfo-2:19.0.0-3522.gbd4e00a3 164/178 2024-05-04T02:18:27.039 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-rados-debuginfo-2:19.0.0-3522.gbd4e00a3. 165/178 2024-05-04T02:18:27.100 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-rbd-debuginfo-2:19.0.0-3522.gbd4e00a3.el 166/178 2024-05-04T02:18:27.120 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librados2-debuginfo-2:19.0.0-3522.gbd4e00a3.el9. 162/178 2024-05-04T02:18:27.183 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : python3-rgw-debuginfo-2:19.0.0-3522.gbd4e00a3.el 167/178 2024-05-04T02:18:27.441 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librbd1-debuginfo-2:19.0.0-3522.gbd4e00a3.el9.x8 163/178 2024-05-04T02:18:27.814 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cephfs-debuginfo-2:19.0.0-3522.gbd4e00a3 164/178 2024-05-04T02:18:28.168 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rados-debuginfo-2:19.0.0-3522.gbd4e00a3. 165/178 2024-05-04T02:18:28.466 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rbd-debuginfo-2:19.0.0-3522.gbd4e00a3.el 166/178 2024-05-04T02:18:28.598 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rgw-debuginfo-2:19.0.0-3522.gbd4e00a3.el 167/178 2024-05-04T02:18:33.415 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : rbd-fuse-debuginfo-2:19.0.0-3522.gbd4e00a3.el9.x 168/178 2024-05-04T02:18:33.808 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : rbd-mirror-debuginfo-2:19.0.0-3522.gbd4e00a3.el9 169/178 2024-05-04T02:18:34.377 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : rbd-fuse-debuginfo-2:19.0.0-3522.gbd4e00a3.el9.x 168/178 2024-05-04T02:18:34.716 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : rbd-mirror-debuginfo-2:19.0.0-3522.gbd4e00a3.el9 169/178 2024-05-04T02:18:34.956 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : rbd-nbd-debuginfo-2:19.0.0-3522.gbd4e00a3.el9.x8 170/178 2024-05-04T02:18:35.191 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 171/178 2024-05-04T02:18:35.520 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 172/178 2024-05-04T02:18:35.851 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : rbd-nbd-debuginfo-2:19.0.0-3522.gbd4e00a3.el9.x8 170/178 2024-05-04T02:18:35.882 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : flex-2.6.4-9.el9.x86_64 173/178 2024-05-04T02:18:36.137 INFO:teuthology.orchestra.run.smithi001.stdout: Installing : bison-3.7.4-5.el9.x86_64 174/178 2024-05-04T02:18:36.137 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 175/178 2024-05-04T02:18:36.182 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 171/178 2024-05-04T02:18:36.277 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 175/178 2024-05-04T02:18:36.310 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 176/178 2024-05-04T02:18:36.310 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 177/178 2024-05-04T02:18:36.410 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 177/178 2024-05-04T02:18:36.482 INFO:teuthology.orchestra.run.smithi001.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 178/178 2024-05-04T02:18:36.501 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 172/178 2024-05-04T02:18:36.844 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : flex-2.6.4-9.el9.x86_64 173/178 2024-05-04T02:18:37.113 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : bison-3.7.4-5.el9.x86_64 174/178 2024-05-04T02:18:37.113 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 175/178 2024-05-04T02:18:38.038 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 175/178 2024-05-04T02:18:38.313 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 176/178 2024-05-04T02:18:38.313 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 177/178 2024-05-04T02:18:38.408 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 177/178 2024-05-04T02:18:38.496 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 178/178 2024-05-04T02:18:45.384 INFO:teuthology.orchestra.run.smithi001.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 178/178 2024-05-04T02:18:45.384 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-2:19.0.0-3522.gbd4e00a3.el9.x86_64 1/178 2024-05-04T02:18:45.384 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-base-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2/178 2024-05-04T02:18:45.384 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-base-debuginfo-2:19.0.0-3522.gbd4e00a3.el9. 3/178 2024-05-04T02:18:45.384 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-common-2:19.0.0-3522.gbd4e00a3.el9.x86_64 4/178 2024-05-04T02:18:45.385 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-common-debuginfo-2:19.0.0-3522.gbd4e00a3.el 5/178 2024-05-04T02:18:45.385 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-debuginfo-2:19.0.0-3522.gbd4e00a3.el9.x86_6 6/178 2024-05-04T02:18:45.385 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-fuse-2:19.0.0-3522.gbd4e00a3.el9.x86_64 7/178 2024-05-04T02:18:45.385 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-fuse-debuginfo-2:19.0.0-3522.gbd4e00a3.el9. 8/178 2024-05-04T02:18:45.385 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3522.gbd4e0 9/178 2024-05-04T02:18:45.385 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:19.0.0-3 10/178 2024-05-04T02:18:45.385 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mds-2:19.0.0-3522.gbd4e00a3.el9.x86_64 11/178 2024-05-04T02:18:45.385 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mds-debuginfo-2:19.0.0-3522.gbd4e00a3.el9.x 12/178 2024-05-04T02:18:45.385 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mgr-2:19.0.0-3522.gbd4e00a3.el9.x86_64 13/178 2024-05-04T02:18:45.385 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mgr-debuginfo-2:19.0.0-3522.gbd4e00a3.el9.x 14/178 2024-05-04T02:18:45.385 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mon-2:19.0.0-3522.gbd4e00a3.el9.x86_64 15/178 2024-05-04T02:18:45.385 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mon-debuginfo-2:19.0.0-3522.gbd4e00a3.el9.x 16/178 2024-05-04T02:18:45.385 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-osd-2:19.0.0-3522.gbd4e00a3.el9.x86_64 17/178 2024-05-04T02:18:45.385 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-osd-debuginfo-2:19.0.0-3522.gbd4e00a3.el9.x 18/178 2024-05-04T02:18:45.385 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-radosgw-2:19.0.0-3522.gbd4e00a3.el9.x86_64 19/178 2024-05-04T02:18:45.386 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-radosgw-debuginfo-2:19.0.0-3522.gbd4e00a3.e 20/178 2024-05-04T02:18:45.386 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-selinux-2:19.0.0-3522.gbd4e00a3.el9.x86_64 21/178 2024-05-04T02:18:45.386 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-test-2:19.0.0-3522.gbd4e00a3.el9.x86_64 22/178 2024-05-04T02:18:45.386 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-test-debuginfo-2:19.0.0-3522.gbd4e00a3.el9. 23/178 2024-05-04T02:18:45.386 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : cephfs-mirror-2:19.0.0-3522.gbd4e00a3.el9.x86_64 24/178 2024-05-04T02:18:45.386 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : cephfs-shell-2:19.0.0-3522.gbd4e00a3.el9.x86_64 25/178 2024-05-04T02:18:45.386 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libcephfs-devel-2:19.0.0-3522.gbd4e00a3.el9.x86_ 26/178 2024-05-04T02:18:45.386 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libcephfs2-2:19.0.0-3522.gbd4e00a3.el9.x86_64 27/178 2024-05-04T02:18:45.386 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libcephfs2-debuginfo-2:19.0.0-3522.gbd4e00a3.el9 28/178 2024-05-04T02:18:45.386 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libcephsqlite-2:19.0.0-3522.gbd4e00a3.el9.x86_64 29/178 2024-05-04T02:18:45.386 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librados-devel-2:19.0.0-3522.gbd4e00a3.el9.x86_6 30/178 2024-05-04T02:18:45.386 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librados-devel-debuginfo-2:19.0.0-3522.gbd4e00a3 31/178 2024-05-04T02:18:45.387 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librados2-debuginfo-2:19.0.0-3522.gbd4e00a3.el9. 32/178 2024-05-04T02:18:45.387 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libradosstriper1-2:19.0.0-3522.gbd4e00a3.el9.x86 33/178 2024-05-04T02:18:45.387 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librbd1-debuginfo-2:19.0.0-3522.gbd4e00a3.el9.x8 34/178 2024-05-04T02:18:45.387 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librgw2-2:19.0.0-3522.gbd4e00a3.el9.x86_64 35/178 2024-05-04T02:18:45.387 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3522.gbd4e00a3.el 36/178 2024-05-04T02:18:45.387 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-ceph-common-2:19.0.0-3522.gbd4e00a3.el9. 37/178 2024-05-04T02:18:45.387 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-cephfs-2:19.0.0-3522.gbd4e00a3.el9.x86_6 38/178 2024-05-04T02:18:45.387 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-cephfs-debuginfo-2:19.0.0-3522.gbd4e00a3 39/178 2024-05-04T02:18:45.387 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-rados-2:19.0.0-3522.gbd4e00a3.el9.x86_64 40/178 2024-05-04T02:18:45.387 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-rados-debuginfo-2:19.0.0-3522.gbd4e00a3. 41/178 2024-05-04T02:18:45.387 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-rbd-2:19.0.0-3522.gbd4e00a3.el9.x86_64 42/178 2024-05-04T02:18:45.387 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-rbd-debuginfo-2:19.0.0-3522.gbd4e00a3.el 43/178 2024-05-04T02:18:45.387 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-rgw-2:19.0.0-3522.gbd4e00a3.el9.x86_64 44/178 2024-05-04T02:18:45.387 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-rgw-debuginfo-2:19.0.0-3522.gbd4e00a3.el 45/178 2024-05-04T02:18:45.388 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : rbd-fuse-2:19.0.0-3522.gbd4e00a3.el9.x86_64 46/178 2024-05-04T02:18:45.388 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : rbd-fuse-debuginfo-2:19.0.0-3522.gbd4e00a3.el9.x 47/178 2024-05-04T02:18:45.388 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : rbd-mirror-2:19.0.0-3522.gbd4e00a3.el9.x86_64 48/178 2024-05-04T02:18:45.388 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : rbd-mirror-debuginfo-2:19.0.0-3522.gbd4e00a3.el9 49/178 2024-05-04T02:18:45.388 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : rbd-nbd-2:19.0.0-3522.gbd4e00a3.el9.x86_64 50/178 2024-05-04T02:18:45.388 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : rbd-nbd-debuginfo-2:19.0.0-3522.gbd4e00a3.el9.x8 51/178 2024-05-04T02:18:45.388 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3522.gbd4e00a3. 52/178 2024-05-04T02:18:45.388 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3522.gbd4e00a3.el9.noa 53/178 2024-05-04T02:18:45.388 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3522.gbd4e00a3.el9.n 54/178 2024-05-04T02:18:45.388 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3522.gbd4 55/178 2024-05-04T02:18:45.388 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3522.gbd4e00a3.el 56/178 2024-05-04T02:18:45.388 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3522.gbd4e00a3.el9.noarch 57/178 2024-05-04T02:18:45.388 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3522.gbd4e00a3.e 58/178 2024-05-04T02:18:45.389 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : ceph-volume-2:19.0.0-3522.gbd4e00a3.el9.noarch 59/178 2024-05-04T02:18:45.389 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : cephadm-2:19.0.0-3522.gbd4e00a3.el9.noarch 60/178 2024-05-04T02:18:45.389 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : cephfs-top-2:19.0.0-3522.gbd4e00a3.el9.noarch 61/178 2024-05-04T02:18:45.389 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 62/178 2024-05-04T02:18:45.389 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 63/178 2024-05-04T02:18:45.389 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 64/178 2024-05-04T02:18:45.389 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 65/178 2024-05-04T02:18:45.389 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 66/178 2024-05-04T02:18:45.389 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-ply-3.11-14.el9.noarch 67/178 2024-05-04T02:18:45.389 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 68/178 2024-05-04T02:18:45.389 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 69/178 2024-05-04T02:18:45.389 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 70/178 2024-05-04T02:18:45.389 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : automake-1.16.2-8.el9.noarch 71/178 2024-05-04T02:18:45.389 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : bison-3.7.4-5.el9.x86_64 72/178 2024-05-04T02:18:45.390 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 73/178 2024-05-04T02:18:45.390 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 74/178 2024-05-04T02:18:45.390 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : flex-2.6.4-9.el9.x86_64 75/178 2024-05-04T02:18:45.390 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 76/178 2024-05-04T02:18:45.390 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 77/178 2024-05-04T02:18:45.390 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 78/178 2024-05-04T02:18:45.390 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 79/178 2024-05-04T02:18:45.390 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 80/178 2024-05-04T02:18:45.390 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 81/178 2024-05-04T02:18:45.390 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 82/178 2024-05-04T02:18:45.390 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 83/178 2024-05-04T02:18:45.390 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 84/178 2024-05-04T02:18:45.391 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 85/178 2024-05-04T02:18:45.391 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 86/178 2024-05-04T02:18:45.391 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : lua-5.4.4-4.el9.x86_64 87/178 2024-05-04T02:18:45.391 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 88/178 2024-05-04T02:18:45.391 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 89/178 2024-05-04T02:18:45.391 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 90/178 2024-05-04T02:18:45.391 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : postgresql-13.14-1.el9.x86_64 91/178 2024-05-04T02:18:45.391 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 92/178 2024-05-04T02:18:45.391 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 93/178 2024-05-04T02:18:45.391 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 94/178 2024-05-04T02:18:45.391 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 95/178 2024-05-04T02:18:45.391 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 96/178 2024-05-04T02:18:45.391 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 97/178 2024-05-04T02:18:45.392 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 98/178 2024-05-04T02:18:45.392 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 99/178 2024-05-04T02:18:45.392 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 100/178 2024-05-04T02:18:45.392 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 101/178 2024-05-04T02:18:45.392 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 102/178 2024-05-04T02:18:45.392 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 103/178 2024-05-04T02:18:45.392 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 104/178 2024-05-04T02:18:45.392 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 105/178 2024-05-04T02:18:45.392 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 106/178 2024-05-04T02:18:45.392 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 107/178 2024-05-04T02:18:45.392 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 108/178 2024-05-04T02:18:45.392 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 109/178 2024-05-04T02:18:45.392 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 110/178 2024-05-04T02:18:45.392 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 111/178 2024-05-04T02:18:45.393 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 112/178 2024-05-04T02:18:45.393 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 113/178 2024-05-04T02:18:45.393 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 114/178 2024-05-04T02:18:45.393 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 115/178 2024-05-04T02:18:45.393 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 116/178 2024-05-04T02:18:45.393 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 117/178 2024-05-04T02:18:45.393 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 118/178 2024-05-04T02:18:45.393 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 119/178 2024-05-04T02:18:45.393 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 120/178 2024-05-04T02:18:45.393 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 121/178 2024-05-04T02:18:45.393 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 122/178 2024-05-04T02:18:45.393 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 123/178 2024-05-04T02:18:45.393 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 124/178 2024-05-04T02:18:45.393 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 125/178 2024-05-04T02:18:45.393 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 126/178 2024-05-04T02:18:45.394 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 127/178 2024-05-04T02:18:45.394 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 128/178 2024-05-04T02:18:45.394 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 129/178 2024-05-04T02:18:45.394 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 130/178 2024-05-04T02:18:45.394 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 131/178 2024-05-04T02:18:45.394 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 132/178 2024-05-04T02:18:45.394 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 133/178 2024-05-04T02:18:45.394 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 134/178 2024-05-04T02:18:45.394 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 135/178 2024-05-04T02:18:45.394 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 136/178 2024-05-04T02:18:45.394 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 137/178 2024-05-04T02:18:45.394 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 138/178 2024-05-04T02:18:45.394 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 139/178 2024-05-04T02:18:45.395 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 140/178 2024-05-04T02:18:45.395 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 141/178 2024-05-04T02:18:45.395 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 142/178 2024-05-04T02:18:45.395 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 143/178 2024-05-04T02:18:45.395 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 144/178 2024-05-04T02:18:45.395 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 145/178 2024-05-04T02:18:45.395 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 146/178 2024-05-04T02:18:45.395 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 147/178 2024-05-04T02:18:45.395 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 148/178 2024-05-04T02:18:45.395 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 149/178 2024-05-04T02:18:45.395 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 150/178 2024-05-04T02:18:45.395 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 151/178 2024-05-04T02:18:45.395 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 152/178 2024-05-04T02:18:45.395 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 153/178 2024-05-04T02:18:45.395 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 154/178 2024-05-04T02:18:45.396 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 155/178 2024-05-04T02:18:45.396 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 156/178 2024-05-04T02:18:45.396 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 157/178 2024-05-04T02:18:45.396 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 158/178 2024-05-04T02:18:45.396 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 159/178 2024-05-04T02:18:45.396 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 160/178 2024-05-04T02:18:45.396 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 161/178 2024-05-04T02:18:45.396 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 162/178 2024-05-04T02:18:45.396 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 163/178 2024-05-04T02:18:45.396 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 164/178 2024-05-04T02:18:45.396 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 165/178 2024-05-04T02:18:45.396 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 166/178 2024-05-04T02:18:45.396 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 167/178 2024-05-04T02:18:45.396 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 168/178 2024-05-04T02:18:45.397 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : re2-1:20211101-3.el9.x86_64 169/178 2024-05-04T02:18:45.397 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 170/178 2024-05-04T02:18:45.397 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librados2-2:19.0.0-3522.gbd4e00a3.el9.x86_64 171/178 2024-05-04T02:18:45.397 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 172/178 2024-05-04T02:18:45.397 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librbd1-2:19.0.0-3522.gbd4e00a3.el9.x86_64 173/178 2024-05-04T02:18:45.397 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 174/178 2024-05-04T02:18:45.397 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 175/178 2024-05-04T02:18:45.397 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 176/178 2024-05-04T02:18:45.397 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 177/178 2024-05-04T02:18:47.737 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 178/178 2024-05-04T02:18:47.738 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-2:19.0.0-3522.gbd4e00a3.el9.x86_64 1/178 2024-05-04T02:18:47.738 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-base-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2/178 2024-05-04T02:18:47.738 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-base-debuginfo-2:19.0.0-3522.gbd4e00a3.el9. 3/178 2024-05-04T02:18:47.738 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-common-2:19.0.0-3522.gbd4e00a3.el9.x86_64 4/178 2024-05-04T02:18:47.738 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-common-debuginfo-2:19.0.0-3522.gbd4e00a3.el 5/178 2024-05-04T02:18:47.738 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-debuginfo-2:19.0.0-3522.gbd4e00a3.el9.x86_6 6/178 2024-05-04T02:18:47.738 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-fuse-2:19.0.0-3522.gbd4e00a3.el9.x86_64 7/178 2024-05-04T02:18:47.738 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-fuse-debuginfo-2:19.0.0-3522.gbd4e00a3.el9. 8/178 2024-05-04T02:18:47.738 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3522.gbd4e0 9/178 2024-05-04T02:18:47.738 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:19.0.0-3 10/178 2024-05-04T02:18:47.738 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mds-2:19.0.0-3522.gbd4e00a3.el9.x86_64 11/178 2024-05-04T02:18:47.739 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mds-debuginfo-2:19.0.0-3522.gbd4e00a3.el9.x 12/178 2024-05-04T02:18:47.739 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-2:19.0.0-3522.gbd4e00a3.el9.x86_64 13/178 2024-05-04T02:18:47.739 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-debuginfo-2:19.0.0-3522.gbd4e00a3.el9.x 14/178 2024-05-04T02:18:47.739 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mon-2:19.0.0-3522.gbd4e00a3.el9.x86_64 15/178 2024-05-04T02:18:47.739 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mon-debuginfo-2:19.0.0-3522.gbd4e00a3.el9.x 16/178 2024-05-04T02:18:47.739 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-osd-2:19.0.0-3522.gbd4e00a3.el9.x86_64 17/178 2024-05-04T02:18:47.739 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-osd-debuginfo-2:19.0.0-3522.gbd4e00a3.el9.x 18/178 2024-05-04T02:18:47.739 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-radosgw-2:19.0.0-3522.gbd4e00a3.el9.x86_64 19/178 2024-05-04T02:18:47.739 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-radosgw-debuginfo-2:19.0.0-3522.gbd4e00a3.e 20/178 2024-05-04T02:18:47.739 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-selinux-2:19.0.0-3522.gbd4e00a3.el9.x86_64 21/178 2024-05-04T02:18:47.739 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-test-2:19.0.0-3522.gbd4e00a3.el9.x86_64 22/178 2024-05-04T02:18:47.739 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-test-debuginfo-2:19.0.0-3522.gbd4e00a3.el9. 23/178 2024-05-04T02:18:47.739 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : cephfs-mirror-2:19.0.0-3522.gbd4e00a3.el9.x86_64 24/178 2024-05-04T02:18:47.739 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : cephfs-shell-2:19.0.0-3522.gbd4e00a3.el9.x86_64 25/178 2024-05-04T02:18:47.739 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libcephfs-devel-2:19.0.0-3522.gbd4e00a3.el9.x86_ 26/178 2024-05-04T02:18:47.740 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libcephfs2-2:19.0.0-3522.gbd4e00a3.el9.x86_64 27/178 2024-05-04T02:18:47.740 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libcephfs2-debuginfo-2:19.0.0-3522.gbd4e00a3.el9 28/178 2024-05-04T02:18:47.740 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libcephsqlite-2:19.0.0-3522.gbd4e00a3.el9.x86_64 29/178 2024-05-04T02:18:47.740 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librados-devel-2:19.0.0-3522.gbd4e00a3.el9.x86_6 30/178 2024-05-04T02:18:47.740 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librados-devel-debuginfo-2:19.0.0-3522.gbd4e00a3 31/178 2024-05-04T02:18:47.740 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librados2-debuginfo-2:19.0.0-3522.gbd4e00a3.el9. 32/178 2024-05-04T02:18:47.740 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libradosstriper1-2:19.0.0-3522.gbd4e00a3.el9.x86 33/178 2024-05-04T02:18:47.740 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librbd1-debuginfo-2:19.0.0-3522.gbd4e00a3.el9.x8 34/178 2024-05-04T02:18:47.740 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librgw2-2:19.0.0-3522.gbd4e00a3.el9.x86_64 35/178 2024-05-04T02:18:47.740 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3522.gbd4e00a3.el 36/178 2024-05-04T02:18:47.740 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-ceph-common-2:19.0.0-3522.gbd4e00a3.el9. 37/178 2024-05-04T02:18:47.740 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cephfs-2:19.0.0-3522.gbd4e00a3.el9.x86_6 38/178 2024-05-04T02:18:47.740 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cephfs-debuginfo-2:19.0.0-3522.gbd4e00a3 39/178 2024-05-04T02:18:47.740 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rados-2:19.0.0-3522.gbd4e00a3.el9.x86_64 40/178 2024-05-04T02:18:47.741 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rados-debuginfo-2:19.0.0-3522.gbd4e00a3. 41/178 2024-05-04T02:18:47.741 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rbd-2:19.0.0-3522.gbd4e00a3.el9.x86_64 42/178 2024-05-04T02:18:47.741 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rbd-debuginfo-2:19.0.0-3522.gbd4e00a3.el 43/178 2024-05-04T02:18:47.741 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rgw-2:19.0.0-3522.gbd4e00a3.el9.x86_64 44/178 2024-05-04T02:18:47.741 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rgw-debuginfo-2:19.0.0-3522.gbd4e00a3.el 45/178 2024-05-04T02:18:47.741 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : rbd-fuse-2:19.0.0-3522.gbd4e00a3.el9.x86_64 46/178 2024-05-04T02:18:47.741 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : rbd-fuse-debuginfo-2:19.0.0-3522.gbd4e00a3.el9.x 47/178 2024-05-04T02:18:47.741 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : rbd-mirror-2:19.0.0-3522.gbd4e00a3.el9.x86_64 48/178 2024-05-04T02:18:47.741 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : rbd-mirror-debuginfo-2:19.0.0-3522.gbd4e00a3.el9 49/178 2024-05-04T02:18:47.741 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : rbd-nbd-2:19.0.0-3522.gbd4e00a3.el9.x86_64 50/178 2024-05-04T02:18:47.741 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : rbd-nbd-debuginfo-2:19.0.0-3522.gbd4e00a3.el9.x8 51/178 2024-05-04T02:18:47.741 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3522.gbd4e00a3. 52/178 2024-05-04T02:18:47.741 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3522.gbd4e00a3.el9.noa 53/178 2024-05-04T02:18:47.741 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3522.gbd4e00a3.el9.n 54/178 2024-05-04T02:18:47.741 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3522.gbd4 55/178 2024-05-04T02:18:47.742 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3522.gbd4e00a3.el 56/178 2024-05-04T02:18:47.742 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3522.gbd4e00a3.el9.noarch 57/178 2024-05-04T02:18:47.742 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3522.gbd4e00a3.e 58/178 2024-05-04T02:18:47.742 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-volume-2:19.0.0-3522.gbd4e00a3.el9.noarch 59/178 2024-05-04T02:18:47.742 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : cephadm-2:19.0.0-3522.gbd4e00a3.el9.noarch 60/178 2024-05-04T02:18:47.742 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : cephfs-top-2:19.0.0-3522.gbd4e00a3.el9.noarch 61/178 2024-05-04T02:18:47.742 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 62/178 2024-05-04T02:18:47.742 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 63/178 2024-05-04T02:18:47.742 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 64/178 2024-05-04T02:18:47.742 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 65/178 2024-05-04T02:18:47.742 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 66/178 2024-05-04T02:18:47.742 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-ply-3.11-14.el9.noarch 67/178 2024-05-04T02:18:47.742 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 68/178 2024-05-04T02:18:47.742 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 69/178 2024-05-04T02:18:47.743 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 70/178 2024-05-04T02:18:47.743 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : automake-1.16.2-8.el9.noarch 71/178 2024-05-04T02:18:47.743 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : bison-3.7.4-5.el9.x86_64 72/178 2024-05-04T02:18:47.743 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 73/178 2024-05-04T02:18:47.743 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 74/178 2024-05-04T02:18:47.743 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : flex-2.6.4-9.el9.x86_64 75/178 2024-05-04T02:18:47.743 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 76/178 2024-05-04T02:18:47.743 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 77/178 2024-05-04T02:18:47.743 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 78/178 2024-05-04T02:18:47.743 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 79/178 2024-05-04T02:18:47.743 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 80/178 2024-05-04T02:18:47.743 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 81/178 2024-05-04T02:18:47.743 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 82/178 2024-05-04T02:18:47.743 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 83/178 2024-05-04T02:18:47.743 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 84/178 2024-05-04T02:18:47.743 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 85/178 2024-05-04T02:18:47.744 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 86/178 2024-05-04T02:18:47.744 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : lua-5.4.4-4.el9.x86_64 87/178 2024-05-04T02:18:47.744 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 88/178 2024-05-04T02:18:47.744 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 89/178 2024-05-04T02:18:47.744 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 90/178 2024-05-04T02:18:47.744 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : postgresql-13.14-1.el9.x86_64 91/178 2024-05-04T02:18:47.744 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 92/178 2024-05-04T02:18:47.744 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 93/178 2024-05-04T02:18:47.744 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 94/178 2024-05-04T02:18:47.744 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 95/178 2024-05-04T02:18:47.744 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 96/178 2024-05-04T02:18:47.744 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 97/178 2024-05-04T02:18:47.744 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 98/178 2024-05-04T02:18:47.744 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 99/178 2024-05-04T02:18:47.745 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 100/178 2024-05-04T02:18:47.745 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 101/178 2024-05-04T02:18:47.745 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 102/178 2024-05-04T02:18:47.745 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 103/178 2024-05-04T02:18:47.745 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 104/178 2024-05-04T02:18:47.745 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 105/178 2024-05-04T02:18:47.745 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 106/178 2024-05-04T02:18:47.745 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 107/178 2024-05-04T02:18:47.745 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 108/178 2024-05-04T02:18:47.745 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 109/178 2024-05-04T02:18:47.745 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 110/178 2024-05-04T02:18:47.745 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 111/178 2024-05-04T02:18:47.745 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 112/178 2024-05-04T02:18:47.746 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 113/178 2024-05-04T02:18:47.746 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 114/178 2024-05-04T02:18:47.746 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 115/178 2024-05-04T02:18:47.746 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 116/178 2024-05-04T02:18:47.746 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 117/178 2024-05-04T02:18:47.746 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 118/178 2024-05-04T02:18:47.746 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 119/178 2024-05-04T02:18:47.746 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 120/178 2024-05-04T02:18:47.746 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 121/178 2024-05-04T02:18:47.746 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 122/178 2024-05-04T02:18:47.746 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 123/178 2024-05-04T02:18:47.746 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 124/178 2024-05-04T02:18:47.746 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 125/178 2024-05-04T02:18:47.747 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 126/178 2024-05-04T02:18:47.747 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 127/178 2024-05-04T02:18:47.747 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 128/178 2024-05-04T02:18:47.747 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 129/178 2024-05-04T02:18:47.747 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 130/178 2024-05-04T02:18:47.747 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 131/178 2024-05-04T02:18:47.747 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 132/178 2024-05-04T02:18:47.747 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 133/178 2024-05-04T02:18:47.747 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 134/178 2024-05-04T02:18:47.747 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 135/178 2024-05-04T02:18:47.747 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 136/178 2024-05-04T02:18:47.747 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 137/178 2024-05-04T02:18:47.747 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 138/178 2024-05-04T02:18:47.747 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 139/178 2024-05-04T02:18:47.748 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 140/178 2024-05-04T02:18:47.748 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 141/178 2024-05-04T02:18:47.748 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 142/178 2024-05-04T02:18:47.748 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 143/178 2024-05-04T02:18:47.748 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 144/178 2024-05-04T02:18:47.748 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 145/178 2024-05-04T02:18:47.748 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 146/178 2024-05-04T02:18:47.748 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 147/178 2024-05-04T02:18:47.748 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 148/178 2024-05-04T02:18:47.748 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 149/178 2024-05-04T02:18:47.748 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 150/178 2024-05-04T02:18:47.748 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 151/178 2024-05-04T02:18:47.748 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 152/178 2024-05-04T02:18:47.748 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 153/178 2024-05-04T02:18:47.748 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 154/178 2024-05-04T02:18:47.749 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 155/178 2024-05-04T02:18:47.749 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 156/178 2024-05-04T02:18:47.749 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 157/178 2024-05-04T02:18:47.749 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 158/178 2024-05-04T02:18:47.749 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 159/178 2024-05-04T02:18:47.749 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 160/178 2024-05-04T02:18:47.749 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 161/178 2024-05-04T02:18:47.749 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 162/178 2024-05-04T02:18:47.749 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 163/178 2024-05-04T02:18:47.749 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 164/178 2024-05-04T02:18:47.749 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 165/178 2024-05-04T02:18:47.749 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 166/178 2024-05-04T02:18:47.749 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 167/178 2024-05-04T02:18:47.749 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 168/178 2024-05-04T02:18:47.749 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : re2-1:20211101-3.el9.x86_64 169/178 2024-05-04T02:18:47.750 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 170/178 2024-05-04T02:18:47.750 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librados2-2:19.0.0-3522.gbd4e00a3.el9.x86_64 171/178 2024-05-04T02:18:47.750 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 172/178 2024-05-04T02:18:47.750 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librbd1-2:19.0.0-3522.gbd4e00a3.el9.x86_64 173/178 2024-05-04T02:18:47.750 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 174/178 2024-05-04T02:18:47.750 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 175/178 2024-05-04T02:18:47.750 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 176/178 2024-05-04T02:18:47.750 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 177/178 2024-05-04T02:18:47.790 INFO:teuthology.orchestra.run.smithi001.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 178/178 2024-05-04T02:18:47.790 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:18:47.790 INFO:teuthology.orchestra.run.smithi001.stdout:Upgraded: 2024-05-04T02:18:47.791 INFO:teuthology.orchestra.run.smithi001.stdout: librados2-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:47.791 INFO:teuthology.orchestra.run.smithi001.stdout: librbd1-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:47.791 INFO:teuthology.orchestra.run.smithi001.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-04T02:18:47.791 INFO:teuthology.orchestra.run.smithi001.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-04T02:18:47.791 INFO:teuthology.orchestra.run.smithi001.stdout:Installed: 2024-05-04T02:18:47.791 INFO:teuthology.orchestra.run.smithi001.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-04T02:18:47.791 INFO:teuthology.orchestra.run.smithi001.stdout: automake-1.16.2-8.el9.noarch 2024-05-04T02:18:47.791 INFO:teuthology.orchestra.run.smithi001.stdout: bison-3.7.4-5.el9.x86_64 2024-05-04T02:18:47.791 INFO:teuthology.orchestra.run.smithi001.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-04T02:18:47.791 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:47.791 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-base-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:47.791 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-base-debuginfo-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:47.791 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-common-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:47.791 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-common-debuginfo-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:47.792 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-debuginfo-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:47.792 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-fuse-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:47.792 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-fuse-debuginfo-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:47.792 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-grafana-dashboards-2:19.0.0-3522.gbd4e00a3.el9.noarch 2024-05-04T02:18:47.792 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-immutable-object-cache-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:47.792 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-immutable-object-cache-debuginfo-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:47.792 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mds-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:47.792 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mds-debuginfo-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:47.792 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:47.792 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-cephadm-2:19.0.0-3522.gbd4e00a3.el9.noarch 2024-05-04T02:18:47.792 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-dashboard-2:19.0.0-3522.gbd4e00a3.el9.noarch 2024-05-04T02:18:47.792 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-debuginfo-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:47.792 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3522.gbd4e00a3.el9.noarch 2024-05-04T02:18:47.792 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-modules-core-2:19.0.0-3522.gbd4e00a3.el9.noarch 2024-05-04T02:18:47.792 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mgr-rook-2:19.0.0-3522.gbd4e00a3.el9.noarch 2024-05-04T02:18:47.793 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mon-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:47.793 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-mon-debuginfo-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:47.793 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-osd-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:47.793 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-osd-debuginfo-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:47.793 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-prometheus-alerts-2:19.0.0-3522.gbd4e00a3.el9.noarch 2024-05-04T02:18:47.793 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-radosgw-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:47.793 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-radosgw-debuginfo-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:47.793 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-selinux-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:47.793 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-test-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:47.793 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-test-debuginfo-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:47.793 INFO:teuthology.orchestra.run.smithi001.stdout: ceph-volume-2:19.0.0-3522.gbd4e00a3.el9.noarch 2024-05-04T02:18:47.793 INFO:teuthology.orchestra.run.smithi001.stdout: cephadm-2:19.0.0-3522.gbd4e00a3.el9.noarch 2024-05-04T02:18:47.793 INFO:teuthology.orchestra.run.smithi001.stdout: cephfs-mirror-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:47.793 INFO:teuthology.orchestra.run.smithi001.stdout: cephfs-shell-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:47.793 INFO:teuthology.orchestra.run.smithi001.stdout: cephfs-top-2:19.0.0-3522.gbd4e00a3.el9.noarch 2024-05-04T02:18:47.794 INFO:teuthology.orchestra.run.smithi001.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-04T02:18:47.794 INFO:teuthology.orchestra.run.smithi001.stdout: flex-2.6.4-9.el9.x86_64 2024-05-04T02:18:47.794 INFO:teuthology.orchestra.run.smithi001.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-04T02:18:47.794 INFO:teuthology.orchestra.run.smithi001.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-04T02:18:47.794 INFO:teuthology.orchestra.run.smithi001.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-04T02:18:47.794 INFO:teuthology.orchestra.run.smithi001.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-04T02:18:47.794 INFO:teuthology.orchestra.run.smithi001.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-04T02:18:47.794 INFO:teuthology.orchestra.run.smithi001.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-04T02:18:47.794 INFO:teuthology.orchestra.run.smithi001.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-04T02:18:47.794 INFO:teuthology.orchestra.run.smithi001.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-04T02:18:47.794 INFO:teuthology.orchestra.run.smithi001.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-04T02:18:47.794 INFO:teuthology.orchestra.run.smithi001.stdout: libcephfs-devel-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:47.794 INFO:teuthology.orchestra.run.smithi001.stdout: libcephfs2-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:47.795 INFO:teuthology.orchestra.run.smithi001.stdout: libcephfs2-debuginfo-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:47.795 INFO:teuthology.orchestra.run.smithi001.stdout: libcephsqlite-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:47.795 INFO:teuthology.orchestra.run.smithi001.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-04T02:18:47.795 INFO:teuthology.orchestra.run.smithi001.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-04T02:18:47.795 INFO:teuthology.orchestra.run.smithi001.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-04T02:18:47.795 INFO:teuthology.orchestra.run.smithi001.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-04T02:18:47.795 INFO:teuthology.orchestra.run.smithi001.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-04T02:18:47.795 INFO:teuthology.orchestra.run.smithi001.stdout: librados-devel-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:47.795 INFO:teuthology.orchestra.run.smithi001.stdout: librados-devel-debuginfo-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:47.795 INFO:teuthology.orchestra.run.smithi001.stdout: librados2-debuginfo-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:47.795 INFO:teuthology.orchestra.run.smithi001.stdout: libradosstriper1-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:47.795 INFO:teuthology.orchestra.run.smithi001.stdout: librbd1-debuginfo-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:47.795 INFO:teuthology.orchestra.run.smithi001.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-04T02:18:47.796 INFO:teuthology.orchestra.run.smithi001.stdout: librgw2-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:47.796 INFO:teuthology.orchestra.run.smithi001.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-04T02:18:47.796 INFO:teuthology.orchestra.run.smithi001.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-04T02:18:47.796 INFO:teuthology.orchestra.run.smithi001.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-04T02:18:47.796 INFO:teuthology.orchestra.run.smithi001.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-04T02:18:47.796 INFO:teuthology.orchestra.run.smithi001.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-04T02:18:47.796 INFO:teuthology.orchestra.run.smithi001.stdout: lua-5.4.4-4.el9.x86_64 2024-05-04T02:18:47.796 INFO:teuthology.orchestra.run.smithi001.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-04T02:18:47.796 INFO:teuthology.orchestra.run.smithi001.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-04T02:18:47.796 INFO:teuthology.orchestra.run.smithi001.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-04T02:18:47.796 INFO:teuthology.orchestra.run.smithi001.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-04T02:18:47.796 INFO:teuthology.orchestra.run.smithi001.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-04T02:18:47.796 INFO:teuthology.orchestra.run.smithi001.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-04T02:18:47.796 INFO:teuthology.orchestra.run.smithi001.stdout: postgresql-13.14-1.el9.x86_64 2024-05-04T02:18:47.797 INFO:teuthology.orchestra.run.smithi001.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-04T02:18:47.797 INFO:teuthology.orchestra.run.smithi001.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-04T02:18:47.797 INFO:teuthology.orchestra.run.smithi001.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-04T02:18:47.797 INFO:teuthology.orchestra.run.smithi001.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-04T02:18:47.797 INFO:teuthology.orchestra.run.smithi001.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-04T02:18:47.797 INFO:teuthology.orchestra.run.smithi001.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-04T02:18:47.797 INFO:teuthology.orchestra.run.smithi001.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-04T02:18:47.797 INFO:teuthology.orchestra.run.smithi001.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-04T02:18:47.797 INFO:teuthology.orchestra.run.smithi001.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-04T02:18:47.797 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-04T02:18:47.797 INFO:teuthology.orchestra.run.smithi001.stdout: python3-ceph-argparse-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:47.797 INFO:teuthology.orchestra.run.smithi001.stdout: python3-ceph-common-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:47.797 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cephfs-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:47.798 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cephfs-debuginfo-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:47.798 INFO:teuthology.orchestra.run.smithi001.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-04T02:18:47.798 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-04T02:18:47.798 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-04T02:18:47.798 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-04T02:18:47.798 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-04T02:18:47.798 INFO:teuthology.orchestra.run.smithi001.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-04T02:18:47.798 INFO:teuthology.orchestra.run.smithi001.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-04T02:18:47.798 INFO:teuthology.orchestra.run.smithi001.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-04T02:18:47.798 INFO:teuthology.orchestra.run.smithi001.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-04T02:18:47.798 INFO:teuthology.orchestra.run.smithi001.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-04T02:18:47.798 INFO:teuthology.orchestra.run.smithi001.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-04T02:18:47.798 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-04T02:18:47.798 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-04T02:18:47.799 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-04T02:18:47.799 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-04T02:18:47.799 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-04T02:18:47.799 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-04T02:18:47.799 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-04T02:18:47.799 INFO:teuthology.orchestra.run.smithi001.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-04T02:18:47.799 INFO:teuthology.orchestra.run.smithi001.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-04T02:18:47.799 INFO:teuthology.orchestra.run.smithi001.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-04T02:18:47.799 INFO:teuthology.orchestra.run.smithi001.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-04T02:18:47.799 INFO:teuthology.orchestra.run.smithi001.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-04T02:18:47.799 INFO:teuthology.orchestra.run.smithi001.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-04T02:18:47.799 INFO:teuthology.orchestra.run.smithi001.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-04T02:18:47.799 INFO:teuthology.orchestra.run.smithi001.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-04T02:18:47.799 INFO:teuthology.orchestra.run.smithi001.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-04T02:18:47.799 INFO:teuthology.orchestra.run.smithi001.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-04T02:18:47.800 INFO:teuthology.orchestra.run.smithi001.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-04T02:18:47.800 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-04T02:18:47.800 INFO:teuthology.orchestra.run.smithi001.stdout: python3-ply-3.11-14.el9.noarch 2024-05-04T02:18:47.800 INFO:teuthology.orchestra.run.smithi001.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-04T02:18:47.800 INFO:teuthology.orchestra.run.smithi001.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-04T02:18:47.800 INFO:teuthology.orchestra.run.smithi001.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-04T02:18:47.800 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-04T02:18:47.800 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-04T02:18:47.800 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-04T02:18:47.800 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-04T02:18:47.800 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-04T02:18:47.800 INFO:teuthology.orchestra.run.smithi001.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-04T02:18:47.800 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rados-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:47.800 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rados-debuginfo-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:47.801 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rbd-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:47.801 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rbd-debuginfo-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:47.801 INFO:teuthology.orchestra.run.smithi001.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-04T02:18:47.801 INFO:teuthology.orchestra.run.smithi001.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-04T02:18:47.801 INFO:teuthology.orchestra.run.smithi001.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-04T02:18:47.801 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rgw-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:47.801 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rgw-debuginfo-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:47.801 INFO:teuthology.orchestra.run.smithi001.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-04T02:18:47.801 INFO:teuthology.orchestra.run.smithi001.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-04T02:18:47.801 INFO:teuthology.orchestra.run.smithi001.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-04T02:18:47.801 INFO:teuthology.orchestra.run.smithi001.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-04T02:18:47.801 INFO:teuthology.orchestra.run.smithi001.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-04T02:18:47.801 INFO:teuthology.orchestra.run.smithi001.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-04T02:18:47.801 INFO:teuthology.orchestra.run.smithi001.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-04T02:18:47.801 INFO:teuthology.orchestra.run.smithi001.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-04T02:18:47.802 INFO:teuthology.orchestra.run.smithi001.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-04T02:18:47.802 INFO:teuthology.orchestra.run.smithi001.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-04T02:18:47.802 INFO:teuthology.orchestra.run.smithi001.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-04T02:18:47.802 INFO:teuthology.orchestra.run.smithi001.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-04T02:18:47.802 INFO:teuthology.orchestra.run.smithi001.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-04T02:18:47.802 INFO:teuthology.orchestra.run.smithi001.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-04T02:18:47.802 INFO:teuthology.orchestra.run.smithi001.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-04T02:18:47.802 INFO:teuthology.orchestra.run.smithi001.stdout: rbd-fuse-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:47.802 INFO:teuthology.orchestra.run.smithi001.stdout: rbd-fuse-debuginfo-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:47.802 INFO:teuthology.orchestra.run.smithi001.stdout: rbd-mirror-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:47.802 INFO:teuthology.orchestra.run.smithi001.stdout: rbd-mirror-debuginfo-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:47.802 INFO:teuthology.orchestra.run.smithi001.stdout: rbd-nbd-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:47.802 INFO:teuthology.orchestra.run.smithi001.stdout: rbd-nbd-debuginfo-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:47.802 INFO:teuthology.orchestra.run.smithi001.stdout: re2-1:20211101-3.el9.x86_64 2024-05-04T02:18:47.803 INFO:teuthology.orchestra.run.smithi001.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-04T02:18:47.803 INFO:teuthology.orchestra.run.smithi001.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-04T02:18:47.803 INFO:teuthology.orchestra.run.smithi001.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-04T02:18:47.803 INFO:teuthology.orchestra.run.smithi001.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-04T02:18:47.803 INFO:teuthology.orchestra.run.smithi001.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-04T02:18:47.803 INFO:teuthology.orchestra.run.smithi001.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-04T02:18:47.803 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:18:47.803 INFO:teuthology.orchestra.run.smithi001.stdout:Complete! 2024-05-04T02:18:48.406 DEBUG:teuthology.parallel:result is None 2024-05-04T02:18:50.054 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 178/178 2024-05-04T02:18:50.054 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-04T02:18:50.054 INFO:teuthology.orchestra.run.smithi107.stdout:Upgraded: 2024-05-04T02:18:50.054 INFO:teuthology.orchestra.run.smithi107.stdout: librados2-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:50.054 INFO:teuthology.orchestra.run.smithi107.stdout: librbd1-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:50.054 INFO:teuthology.orchestra.run.smithi107.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-04T02:18:50.054 INFO:teuthology.orchestra.run.smithi107.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-04T02:18:50.054 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2024-05-04T02:18:50.055 INFO:teuthology.orchestra.run.smithi107.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-04T02:18:50.055 INFO:teuthology.orchestra.run.smithi107.stdout: automake-1.16.2-8.el9.noarch 2024-05-04T02:18:50.055 INFO:teuthology.orchestra.run.smithi107.stdout: bison-3.7.4-5.el9.x86_64 2024-05-04T02:18:50.055 INFO:teuthology.orchestra.run.smithi107.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-04T02:18:50.055 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:50.055 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-base-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:50.055 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-base-debuginfo-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:50.055 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-common-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:50.055 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-common-debuginfo-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:50.055 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-debuginfo-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:50.055 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-fuse-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:50.055 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-fuse-debuginfo-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:50.055 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-grafana-dashboards-2:19.0.0-3522.gbd4e00a3.el9.noarch 2024-05-04T02:18:50.055 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-immutable-object-cache-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:50.056 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-immutable-object-cache-debuginfo-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:50.056 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mds-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:50.056 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mds-debuginfo-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:50.056 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:50.056 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-cephadm-2:19.0.0-3522.gbd4e00a3.el9.noarch 2024-05-04T02:18:50.056 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-dashboard-2:19.0.0-3522.gbd4e00a3.el9.noarch 2024-05-04T02:18:50.056 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-debuginfo-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:50.056 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3522.gbd4e00a3.el9.noarch 2024-05-04T02:18:50.056 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-modules-core-2:19.0.0-3522.gbd4e00a3.el9.noarch 2024-05-04T02:18:50.056 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-rook-2:19.0.0-3522.gbd4e00a3.el9.noarch 2024-05-04T02:18:50.056 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mon-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:50.056 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mon-debuginfo-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:50.056 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-osd-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:50.056 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-osd-debuginfo-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:50.057 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-prometheus-alerts-2:19.0.0-3522.gbd4e00a3.el9.noarch 2024-05-04T02:18:50.057 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-radosgw-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:50.057 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-radosgw-debuginfo-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:50.057 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-selinux-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:50.057 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-test-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:50.057 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-test-debuginfo-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:50.057 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-volume-2:19.0.0-3522.gbd4e00a3.el9.noarch 2024-05-04T02:18:50.057 INFO:teuthology.orchestra.run.smithi107.stdout: cephadm-2:19.0.0-3522.gbd4e00a3.el9.noarch 2024-05-04T02:18:50.057 INFO:teuthology.orchestra.run.smithi107.stdout: cephfs-mirror-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:50.057 INFO:teuthology.orchestra.run.smithi107.stdout: cephfs-shell-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:50.057 INFO:teuthology.orchestra.run.smithi107.stdout: cephfs-top-2:19.0.0-3522.gbd4e00a3.el9.noarch 2024-05-04T02:18:50.057 INFO:teuthology.orchestra.run.smithi107.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-04T02:18:50.057 INFO:teuthology.orchestra.run.smithi107.stdout: flex-2.6.4-9.el9.x86_64 2024-05-04T02:18:50.057 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-04T02:18:50.058 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-04T02:18:50.058 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-04T02:18:50.058 INFO:teuthology.orchestra.run.smithi107.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-04T02:18:50.058 INFO:teuthology.orchestra.run.smithi107.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-04T02:18:50.058 INFO:teuthology.orchestra.run.smithi107.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-04T02:18:50.058 INFO:teuthology.orchestra.run.smithi107.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-04T02:18:50.058 INFO:teuthology.orchestra.run.smithi107.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-04T02:18:50.058 INFO:teuthology.orchestra.run.smithi107.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-04T02:18:50.058 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs-devel-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:50.058 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs2-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:50.058 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs2-debuginfo-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:50.058 INFO:teuthology.orchestra.run.smithi107.stdout: libcephsqlite-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:50.058 INFO:teuthology.orchestra.run.smithi107.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-04T02:18:50.059 INFO:teuthology.orchestra.run.smithi107.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-04T02:18:50.059 INFO:teuthology.orchestra.run.smithi107.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-04T02:18:50.059 INFO:teuthology.orchestra.run.smithi107.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-04T02:18:50.059 INFO:teuthology.orchestra.run.smithi107.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-04T02:18:50.059 INFO:teuthology.orchestra.run.smithi107.stdout: librados-devel-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:50.059 INFO:teuthology.orchestra.run.smithi107.stdout: librados-devel-debuginfo-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:50.059 INFO:teuthology.orchestra.run.smithi107.stdout: librados2-debuginfo-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:50.059 INFO:teuthology.orchestra.run.smithi107.stdout: libradosstriper1-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:50.059 INFO:teuthology.orchestra.run.smithi107.stdout: librbd1-debuginfo-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:50.059 INFO:teuthology.orchestra.run.smithi107.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-04T02:18:50.059 INFO:teuthology.orchestra.run.smithi107.stdout: librgw2-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:50.059 INFO:teuthology.orchestra.run.smithi107.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-04T02:18:50.059 INFO:teuthology.orchestra.run.smithi107.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-04T02:18:50.059 INFO:teuthology.orchestra.run.smithi107.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-04T02:18:50.060 INFO:teuthology.orchestra.run.smithi107.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-04T02:18:50.060 INFO:teuthology.orchestra.run.smithi107.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-04T02:18:50.060 INFO:teuthology.orchestra.run.smithi107.stdout: lua-5.4.4-4.el9.x86_64 2024-05-04T02:18:50.060 INFO:teuthology.orchestra.run.smithi107.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-04T02:18:50.060 INFO:teuthology.orchestra.run.smithi107.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-04T02:18:50.060 INFO:teuthology.orchestra.run.smithi107.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-04T02:18:50.060 INFO:teuthology.orchestra.run.smithi107.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-04T02:18:50.060 INFO:teuthology.orchestra.run.smithi107.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-04T02:18:50.060 INFO:teuthology.orchestra.run.smithi107.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-04T02:18:50.060 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql-13.14-1.el9.x86_64 2024-05-04T02:18:50.060 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-04T02:18:50.060 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-04T02:18:50.060 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-04T02:18:50.060 INFO:teuthology.orchestra.run.smithi107.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-04T02:18:50.061 INFO:teuthology.orchestra.run.smithi107.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-04T02:18:50.061 INFO:teuthology.orchestra.run.smithi107.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-04T02:18:50.061 INFO:teuthology.orchestra.run.smithi107.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-04T02:18:50.061 INFO:teuthology.orchestra.run.smithi107.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-04T02:18:50.061 INFO:teuthology.orchestra.run.smithi107.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-04T02:18:50.061 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-04T02:18:50.061 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-argparse-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:50.061 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-common-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:50.061 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cephfs-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:50.061 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cephfs-debuginfo-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:50.061 INFO:teuthology.orchestra.run.smithi107.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-04T02:18:50.061 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-04T02:18:50.061 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-04T02:18:50.062 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-04T02:18:50.062 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-04T02:18:50.062 INFO:teuthology.orchestra.run.smithi107.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-04T02:18:50.062 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-04T02:18:50.062 INFO:teuthology.orchestra.run.smithi107.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-04T02:18:50.062 INFO:teuthology.orchestra.run.smithi107.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-04T02:18:50.062 INFO:teuthology.orchestra.run.smithi107.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-04T02:18:50.062 INFO:teuthology.orchestra.run.smithi107.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-04T02:18:50.062 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-04T02:18:50.062 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-04T02:18:50.062 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-04T02:18:50.062 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-04T02:18:50.062 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-04T02:18:50.062 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-04T02:18:50.063 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-04T02:18:50.063 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-04T02:18:50.063 INFO:teuthology.orchestra.run.smithi107.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-04T02:18:50.063 INFO:teuthology.orchestra.run.smithi107.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-04T02:18:50.063 INFO:teuthology.orchestra.run.smithi107.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-04T02:18:50.063 INFO:teuthology.orchestra.run.smithi107.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-04T02:18:50.063 INFO:teuthology.orchestra.run.smithi107.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-04T02:18:50.063 INFO:teuthology.orchestra.run.smithi107.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-04T02:18:50.063 INFO:teuthology.orchestra.run.smithi107.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-04T02:18:50.063 INFO:teuthology.orchestra.run.smithi107.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-04T02:18:50.063 INFO:teuthology.orchestra.run.smithi107.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-04T02:18:50.063 INFO:teuthology.orchestra.run.smithi107.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-04T02:18:50.064 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-04T02:18:50.064 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ply-3.11-14.el9.noarch 2024-05-04T02:18:50.064 INFO:teuthology.orchestra.run.smithi107.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-04T02:18:50.064 INFO:teuthology.orchestra.run.smithi107.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-04T02:18:50.064 INFO:teuthology.orchestra.run.smithi107.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-04T02:18:50.064 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-04T02:18:50.064 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-04T02:18:50.064 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-04T02:18:50.064 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-04T02:18:50.064 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-04T02:18:50.064 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-04T02:18:50.064 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rados-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:50.064 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rados-debuginfo-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:50.064 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rbd-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:50.065 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rbd-debuginfo-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:50.065 INFO:teuthology.orchestra.run.smithi107.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-04T02:18:50.065 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-04T02:18:50.065 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-04T02:18:50.065 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rgw-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:50.065 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rgw-debuginfo-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:50.065 INFO:teuthology.orchestra.run.smithi107.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-04T02:18:50.065 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-04T02:18:50.065 INFO:teuthology.orchestra.run.smithi107.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-04T02:18:50.065 INFO:teuthology.orchestra.run.smithi107.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-04T02:18:50.065 INFO:teuthology.orchestra.run.smithi107.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-04T02:18:50.065 INFO:teuthology.orchestra.run.smithi107.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-04T02:18:50.065 INFO:teuthology.orchestra.run.smithi107.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-04T02:18:50.065 INFO:teuthology.orchestra.run.smithi107.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-04T02:18:50.065 INFO:teuthology.orchestra.run.smithi107.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-04T02:18:50.066 INFO:teuthology.orchestra.run.smithi107.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-04T02:18:50.066 INFO:teuthology.orchestra.run.smithi107.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-04T02:18:50.066 INFO:teuthology.orchestra.run.smithi107.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-04T02:18:50.066 INFO:teuthology.orchestra.run.smithi107.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-04T02:18:50.066 INFO:teuthology.orchestra.run.smithi107.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-04T02:18:50.066 INFO:teuthology.orchestra.run.smithi107.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-04T02:18:50.066 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-fuse-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:50.066 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-fuse-debuginfo-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:50.066 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-mirror-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:50.066 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-mirror-debuginfo-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:50.066 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-nbd-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:50.066 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-nbd-debuginfo-2:19.0.0-3522.gbd4e00a3.el9.x86_64 2024-05-04T02:18:50.066 INFO:teuthology.orchestra.run.smithi107.stdout: re2-1:20211101-3.el9.x86_64 2024-05-04T02:18:50.066 INFO:teuthology.orchestra.run.smithi107.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-04T02:18:50.066 INFO:teuthology.orchestra.run.smithi107.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-04T02:18:50.067 INFO:teuthology.orchestra.run.smithi107.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-04T02:18:50.067 INFO:teuthology.orchestra.run.smithi107.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-04T02:18:50.067 INFO:teuthology.orchestra.run.smithi107.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-04T02:18:50.067 INFO:teuthology.orchestra.run.smithi107.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-04T02:18:50.067 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-04T02:18:50.067 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-05-04T02:18:50.693 DEBUG:teuthology.parallel:result is None 2024-05-04T02:18:50.693 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bd4e00a39d766328b458e4c953f4d722fed96a31 2024-05-04T02:18:50.972 DEBUG:teuthology.orchestra.run.smithi001:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-04T02:18:50.999 INFO:teuthology.orchestra.run.smithi001.stdout:19.0.0-3522.gbd4e00a3.el9 2024-05-04T02:18:51.000 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3522.gbd4e00a3.el9 2024-05-04T02:18:51.000 INFO:teuthology.task.install:The correct ceph version 19.0.0-3522.gbd4e00a3 is installed. 2024-05-04T02:18:51.002 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bd4e00a39d766328b458e4c953f4d722fed96a31 2024-05-04T02:18:51.147 DEBUG:teuthology.orchestra.run.smithi107:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-04T02:18:51.169 INFO:teuthology.orchestra.run.smithi107.stdout:19.0.0-3522.gbd4e00a3.el9 2024-05-04T02:18:51.169 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3522.gbd4e00a3.el9 2024-05-04T02:18:51.169 INFO:teuthology.task.install:The correct ceph version 19.0.0-3522.gbd4e00a3 is installed. 2024-05-04T02:18:51.171 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-04T02:18:51.172 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-05-04T02:18:51.172 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-04T02:18:51.205 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-04T02:18:51.205 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-04T02:18:51.235 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-04T02:18:51.235 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-05-04T02:18:51.235 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/usr/bin/daemon-helper 2024-05-04T02:18:51.273 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-04T02:18:51.349 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-04T02:18:51.349 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/usr/bin/daemon-helper 2024-05-04T02:18:51.372 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-04T02:18:51.436 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-04T02:18:51.436 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-05-04T02:18:51.436 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-04T02:18:51.464 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-04T02:18:51.531 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-04T02:18:51.531 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-04T02:18:51.554 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-04T02:18:51.616 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-04T02:18:51.617 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-05-04T02:18:51.617 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/usr/bin/stdin-killer 2024-05-04T02:18:51.643 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-04T02:18:51.709 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-04T02:18:51.710 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/usr/bin/stdin-killer 2024-05-04T02:18:51.733 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-04T02:18:51.796 INFO:teuthology.run_tasks:Running task ceph... 2024-05-04T02:18:51.884 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-05-04T02:18:51.884 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 777 /var/log/ceph 2024-05-04T02:18:51.887 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 777 /var/log/ceph 2024-05-04T02:18:51.911 INFO:tasks.ceph:Disabling ceph logrotate... 2024-05-04T02:18:51.911 DEBUG:teuthology.orchestra.run.smithi001:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-04T02:18:51.953 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-04T02:18:51.977 INFO:tasks.ceph:Creating extra log directories... 2024-05-04T02:18:51.978 DEBUG:teuthology.orchestra.run.smithi001:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-04T02:18:52.019 DEBUG:teuthology.orchestra.run.smithi107:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-04T02:18:52.050 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-05-04T02:18:52.050 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-05-04T02:18:52.050 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-05-04T02:18:52.050 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-05-04T02:18:52.050 DEBUG:teuthology.orchestra.run.smithi001:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-04T02:18:52.100 DEBUG:teuthology.orchestra.run.smithi001:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-04T02:18:52.208 DEBUG:teuthology.orchestra.run.smithi001:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-05-04T02:18:52.233 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-04T02:18:52.233 DEBUG:teuthology.orchestra.run.smithi107:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-04T02:18:52.248 DEBUG:teuthology.orchestra.run.smithi107:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-04T02:18:52.351 DEBUG:teuthology.orchestra.run.smithi107:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-05-04T02:18:52.400 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-05-04T02:18:52.400 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-05-04T02:18:52.400 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2024-05-03_22:48:16-fs-wip-pdonnell-testing-20240503.163550-debug-distro-default-smithi/7688562', 'branch': 'wip-pdonnell-testing-20240503.163550-debug', 'description': 'fs/verify/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug pg_health session_timeout} ranks/1 tasks/dbench validater/valgrind}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7688562', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'pdonnell-2024-05-03_22:48:16-fs-wip-pdonnell-testing-20240503.163550-debug-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20240503.163550-debug'}, 'ceph': {'cephfs': {'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'sha1': 'bd4e00a39d766328b458e4c953f4d722fed96a31', 'valgrind': {'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}, 'watchdog': {'daemon_restart': 'normal'}}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'ceph-fuse': {'client.0': {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}}, 'install': {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': 'bd4e00a39d766328b458e4c953f4d722fed96a31'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-pdonnell-testing-20240503.163550-debug', 'sha1': 'bd4e00a39d766328b458e4c953f4d722fed96a31'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 65, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 1842, 'sha1': 'bd4e00a39d766328b458e4c953f4d722fed96a31', 'sleep_before_teardown': 0, 'subset': '478/512', 'suite': 'fs', 'suite_branch': 'wip-pdonnell-testing-20240503.163550-debug', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_bd4e00a39d766328b458e4c953f4d722fed96a31/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'bd4e00a39d766328b458e4c953f4d722fed96a31', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi001.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF55OzKoge4QPDEevlgqCVMWMfvVHUB6+YFlVwku1bhkaEPttZJuylFH6nbpUiYo12d6qxlh2cPV0SIkepABmM8=', 'smithi107.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA4xcPEYtr1bBomnLSjGJy+NHsxQ/PBA8j2oF1uVarAT/doN9ZyECMmCs4L6LkrOhYyKr8RcP+DZji6rC9n6C6c='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'debuginfo': True, 'flavor': 'default', 'sha1': 'bd4e00a39d766328b458e4c953f4d722fed96a31'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'sha1': 'bd4e00a39d766328b458e4c953f4d722fed96a31', 'valgrind': {'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}, 'watchdog': {'daemon_restart': 'normal'}, 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['suites/dbench.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '1ae7ad82388e92a475afff437d49054826c019a1', 'timestamp': '2024-05-03_22:48:16', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-05-04T02:18:52.401 DEBUG:teuthology.orchestra.run.smithi001:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-04T02:18:52.403 DEBUG:teuthology.orchestra.run.smithi107:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-04T02:18:52.450 DEBUG:teuthology.orchestra.run.smithi001:> sudo install -d -m0777 -- /var/run/ceph 2024-05-04T02:18:52.458 DEBUG:teuthology.orchestra.run.smithi107:> sudo install -d -m0777 -- /var/run/ceph 2024-05-04T02:18:52.514 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-05-04T02:18:52.514 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/scratch_devs of=/dev/stdout 2024-05-04T02:18:52.536 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-04T02:18:52.537 DEBUG:teuthology.orchestra.run.smithi001:> stat /dev/vg_nvme/lv_1 2024-05-04T02:18:52.592 INFO:teuthology.orchestra.run.smithi001.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-04T02:18:52.592 INFO:teuthology.orchestra.run.smithi001.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-04T02:18:52.592 INFO:teuthology.orchestra.run.smithi001.stdout:Device: 5h/5d Inode: 663 Links: 1 2024-05-04T02:18:52.592 INFO:teuthology.orchestra.run.smithi001.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-04T02:18:52.592 INFO:teuthology.orchestra.run.smithi001.stdout:Context: system_u:object_r:device_t:s0 2024-05-04T02:18:52.593 INFO:teuthology.orchestra.run.smithi001.stdout:Access: 2024-05-04 02:18:36.869670352 +0000 2024-05-04T02:18:52.593 INFO:teuthology.orchestra.run.smithi001.stdout:Modify: 2024-05-04 02:10:46.328745657 +0000 2024-05-04T02:18:52.593 INFO:teuthology.orchestra.run.smithi001.stdout:Change: 2024-05-04 02:10:46.328745657 +0000 2024-05-04T02:18:52.593 INFO:teuthology.orchestra.run.smithi001.stdout: Birth: 2024-05-04 02:10:46.328745657 +0000 2024-05-04T02:18:52.593 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-04T02:18:52.655 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records in 2024-05-04T02:18:52.655 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records out 2024-05-04T02:18:52.655 INFO:teuthology.orchestra.run.smithi001.stderr:512 bytes copied, 0.000101475 s, 5.0 MB/s 2024-05-04T02:18:52.657 DEBUG:teuthology.orchestra.run.smithi001:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-04T02:18:52.713 DEBUG:teuthology.orchestra.run.smithi001:> stat /dev/vg_nvme/lv_2 2024-05-04T02:18:52.769 INFO:teuthology.orchestra.run.smithi001.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-04T02:18:52.769 INFO:teuthology.orchestra.run.smithi001.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-04T02:18:52.769 INFO:teuthology.orchestra.run.smithi001.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-05-04T02:18:52.769 INFO:teuthology.orchestra.run.smithi001.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-04T02:18:52.769 INFO:teuthology.orchestra.run.smithi001.stdout:Context: system_u:object_r:device_t:s0 2024-05-04T02:18:52.769 INFO:teuthology.orchestra.run.smithi001.stdout:Access: 2024-05-04 02:18:36.870670340 +0000 2024-05-04T02:18:52.770 INFO:teuthology.orchestra.run.smithi001.stdout:Modify: 2024-05-04 02:10:46.673741115 +0000 2024-05-04T02:18:52.770 INFO:teuthology.orchestra.run.smithi001.stdout:Change: 2024-05-04 02:10:46.673741115 +0000 2024-05-04T02:18:52.770 INFO:teuthology.orchestra.run.smithi001.stdout: Birth: 2024-05-04 02:10:46.673741115 +0000 2024-05-04T02:18:52.770 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-04T02:18:52.832 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records in 2024-05-04T02:18:52.833 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records out 2024-05-04T02:18:52.833 INFO:teuthology.orchestra.run.smithi001.stderr:512 bytes copied, 9.5947e-05 s, 5.3 MB/s 2024-05-04T02:18:52.834 DEBUG:teuthology.orchestra.run.smithi001:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-04T02:18:52.890 DEBUG:teuthology.orchestra.run.smithi001:> stat /dev/vg_nvme/lv_3 2024-05-04T02:18:52.945 INFO:teuthology.orchestra.run.smithi001.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-04T02:18:52.945 INFO:teuthology.orchestra.run.smithi001.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-04T02:18:52.945 INFO:teuthology.orchestra.run.smithi001.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-05-04T02:18:52.945 INFO:teuthology.orchestra.run.smithi001.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-04T02:18:52.945 INFO:teuthology.orchestra.run.smithi001.stdout:Context: system_u:object_r:device_t:s0 2024-05-04T02:18:52.945 INFO:teuthology.orchestra.run.smithi001.stdout:Access: 2024-05-04 02:18:36.870670340 +0000 2024-05-04T02:18:52.945 INFO:teuthology.orchestra.run.smithi001.stdout:Modify: 2024-05-04 02:10:47.031736402 +0000 2024-05-04T02:18:52.945 INFO:teuthology.orchestra.run.smithi001.stdout:Change: 2024-05-04 02:10:47.031736402 +0000 2024-05-04T02:18:52.945 INFO:teuthology.orchestra.run.smithi001.stdout: Birth: 2024-05-04 02:10:47.031736402 +0000 2024-05-04T02:18:52.946 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-04T02:18:53.007 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records in 2024-05-04T02:18:53.007 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records out 2024-05-04T02:18:53.007 INFO:teuthology.orchestra.run.smithi001.stderr:512 bytes copied, 8.2349e-05 s, 6.2 MB/s 2024-05-04T02:18:53.009 DEBUG:teuthology.orchestra.run.smithi001:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-04T02:18:53.065 DEBUG:teuthology.orchestra.run.smithi001:> stat /dev/vg_nvme/lv_4 2024-05-04T02:18:53.120 INFO:teuthology.orchestra.run.smithi001.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-04T02:18:53.120 INFO:teuthology.orchestra.run.smithi001.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-04T02:18:53.120 INFO:teuthology.orchestra.run.smithi001.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-05-04T02:18:53.120 INFO:teuthology.orchestra.run.smithi001.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-04T02:18:53.120 INFO:teuthology.orchestra.run.smithi001.stdout:Context: system_u:object_r:device_t:s0 2024-05-04T02:18:53.120 INFO:teuthology.orchestra.run.smithi001.stdout:Access: 2024-05-04 02:18:36.870670340 +0000 2024-05-04T02:18:53.120 INFO:teuthology.orchestra.run.smithi001.stdout:Modify: 2024-05-04 02:10:47.362732045 +0000 2024-05-04T02:18:53.120 INFO:teuthology.orchestra.run.smithi001.stdout:Change: 2024-05-04 02:10:47.362732045 +0000 2024-05-04T02:18:53.121 INFO:teuthology.orchestra.run.smithi001.stdout: Birth: 2024-05-04 02:10:47.362732045 +0000 2024-05-04T02:18:53.121 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-04T02:18:53.182 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records in 2024-05-04T02:18:53.183 INFO:teuthology.orchestra.run.smithi001.stderr:1+0 records out 2024-05-04T02:18:53.183 INFO:teuthology.orchestra.run.smithi001.stderr:512 bytes copied, 9.8789e-05 s, 5.2 MB/s 2024-05-04T02:18:53.184 DEBUG:teuthology.orchestra.run.smithi001:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-04T02:18:53.240 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-04T02:18:53.240 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-04T02:18:53.240 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/scratch_devs of=/dev/stdout 2024-05-04T02:18:53.256 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-04T02:18:53.256 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_1 2024-05-04T02:18:53.311 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-04T02:18:53.311 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-04T02:18:53.312 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-05-04T02:18:53.312 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-04T02:18:53.312 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:device_t:s0 2024-05-04T02:18:53.312 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-05-04 02:18:38.861841346 +0000 2024-05-04T02:18:53.312 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-05-04 02:10:39.223616781 +0000 2024-05-04T02:18:53.312 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-05-04 02:10:39.223616781 +0000 2024-05-04T02:18:53.312 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2024-05-04 02:10:39.223616781 +0000 2024-05-04T02:18:53.312 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-04T02:18:53.374 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-05-04T02:18:53.374 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-05-04T02:18:53.374 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000276913 s, 1.8 MB/s 2024-05-04T02:18:53.375 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-04T02:18:53.431 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_2 2024-05-04T02:18:53.487 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-04T02:18:53.487 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-04T02:18:53.487 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5h/5d Inode: 682 Links: 1 2024-05-04T02:18:53.487 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-04T02:18:53.487 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:device_t:s0 2024-05-04T02:18:53.487 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-05-04 02:18:38.861841346 +0000 2024-05-04T02:18:53.488 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-05-04 02:10:39.562610767 +0000 2024-05-04T02:18:53.488 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-05-04 02:10:39.562610767 +0000 2024-05-04T02:18:53.488 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2024-05-04 02:10:39.562610767 +0000 2024-05-04T02:18:53.488 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-04T02:18:53.550 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-05-04T02:18:53.550 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-05-04T02:18:53.550 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000172887 s, 3.0 MB/s 2024-05-04T02:18:53.551 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-04T02:18:53.607 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_3 2024-05-04T02:18:53.662 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-04T02:18:53.662 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-04T02:18:53.662 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-05-04T02:18:53.662 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-04T02:18:53.662 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:device_t:s0 2024-05-04T02:18:53.662 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-05-04 02:18:38.861841346 +0000 2024-05-04T02:18:53.663 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-05-04 02:10:39.907604647 +0000 2024-05-04T02:18:53.663 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-05-04 02:10:39.907604647 +0000 2024-05-04T02:18:53.663 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2024-05-04 02:10:39.907604647 +0000 2024-05-04T02:18:53.663 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-04T02:18:53.739 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-05-04T02:18:53.740 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-05-04T02:18:53.740 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000197913 s, 2.6 MB/s 2024-05-04T02:18:53.741 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-04T02:18:53.797 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_4 2024-05-04T02:18:53.852 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-04T02:18:53.852 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-04T02:18:53.852 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5h/5d Inode: 720 Links: 1 2024-05-04T02:18:53.852 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-04T02:18:53.852 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:device_t:s0 2024-05-04T02:18:53.852 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-05-04 02:18:38.862841330 +0000 2024-05-04T02:18:53.852 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-05-04 02:10:40.242598705 +0000 2024-05-04T02:18:53.853 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-05-04 02:10:40.242598705 +0000 2024-05-04T02:18:53.853 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2024-05-04 02:10:40.242598705 +0000 2024-05-04T02:18:53.853 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-04T02:18:53.914 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-05-04T02:18:53.914 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-05-04T02:18:53.914 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000185892 s, 2.8 MB/s 2024-05-04T02:18:53.918 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-04T02:18:53.973 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-04T02:18:53.973 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi001.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi107.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-04T02:18:53.974 INFO:tasks.ceph:Generating config... 2024-05-04T02:18:53.975 INFO:tasks.ceph:[client] client mount timeout = 600 2024-05-04T02:18:53.975 INFO:tasks.ceph:[client] debug client = 20 2024-05-04T02:18:53.975 INFO:tasks.ceph:[client] debug ms = 1 2024-05-04T02:18:53.975 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-05-04T02:18:53.975 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-05-04T02:18:53.975 INFO:tasks.ceph:[global] mds beacon grace = 60 2024-05-04T02:18:53.975 INFO:tasks.ceph:[global] mds heartbeat grace = 60 2024-05-04T02:18:53.975 INFO:tasks.ceph:[global] osd heartbeat grace = 60 2024-05-04T02:18:53.975 INFO:tasks.ceph:[mds] debug mds = 20 2024-05-04T02:18:53.975 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-05-04T02:18:53.975 INFO:tasks.ceph:[mds] debug ms = 1 2024-05-04T02:18:53.976 INFO:tasks.ceph:[mds] mds debug frag = True 2024-05-04T02:18:53.976 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-05-04T02:18:53.976 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-05-04T02:18:53.976 INFO:tasks.ceph:[mds] mds valgrind exit = True 2024-05-04T02:18:53.976 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-05-04T02:18:53.976 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-05-04T02:18:53.976 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-05-04T02:18:53.976 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-05-04T02:18:53.976 INFO:tasks.ceph:[mgr] debug client = 20 2024-05-04T02:18:53.976 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-05-04T02:18:53.976 INFO:tasks.ceph:[mgr] debug ms = 1 2024-05-04T02:18:53.976 INFO:tasks.ceph:[mon] debug mon = 20 2024-05-04T02:18:53.976 INFO:tasks.ceph:[mon] debug ms = 1 2024-05-04T02:18:53.976 INFO:tasks.ceph:[mon] debug paxos = 20 2024-05-04T02:18:53.977 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-05-04T02:18:53.977 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-05-04T02:18:53.977 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2024-05-04T02:18:53.977 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-05-04T02:18:53.977 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-05-04T02:18:53.977 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-05-04T02:18:53.977 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-05-04T02:18:53.977 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-05-04T02:18:53.977 INFO:tasks.ceph:[osd] debug ms = 1 2024-05-04T02:18:53.977 INFO:tasks.ceph:[osd] debug osd = 20 2024-05-04T02:18:53.977 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-05-04T02:18:53.977 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-05-04T02:18:53.977 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-05-04T02:18:53.977 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-05-04T02:18:53.977 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-05-04T02:18:53.978 INFO:tasks.ceph:[osd] osd fast shutdown = False 2024-05-04T02:18:53.978 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-05-04T02:18:53.978 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-05-04T02:18:53.978 INFO:tasks.ceph:Setting up mon.a... 2024-05-04T02:18:53.978 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-05-04T02:18:54.043 INFO:teuthology.orchestra.run.smithi001.stdout:creating /etc/ceph/ceph.keyring 2024-05-04T02:18:54.046 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-05-04T02:18:54.099 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-04T02:18:54.123 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.1'), ('mon.b', '172.21.15.107'), ('mon.c', '[v2:172.21.15.107:3301,v1:172.21.15.107:6790]')] 2024-05-04T02:18:54.124 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.1,172.21.15.107,[v2:172.21.15.107:3301,v1:172.21.15.107:6790]', 'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-05-04T02:18:54.125 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-05-04T02:18:54.125 DEBUG:teuthology.orchestra.run.smithi001:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-05-04T02:18:54.179 DEBUG:teuthology.orchestra.run.smithi001:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.1 --add b 172.21.15.107 --addv c '[v2:172.21.15.107:3301,v1:172.21.15.107:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-05-04T02:18:54.278 INFO:teuthology.orchestra.run.smithi001.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-05-04T02:18:54.279 INFO:teuthology.orchestra.run.smithi001.stdout:monmaptool: generated fsid b45b4a9a-b84c-4a66-907b-43f0ca45e7c0 2024-05-04T02:18:54.279 INFO:teuthology.orchestra.run.smithi001.stdout:setting min_mon_release = quincy 2024-05-04T02:18:54.279 INFO:teuthology.orchestra.run.smithi001.stdout:epoch 0 2024-05-04T02:18:54.279 INFO:teuthology.orchestra.run.smithi001.stdout:fsid b45b4a9a-b84c-4a66-907b-43f0ca45e7c0 2024-05-04T02:18:54.279 INFO:teuthology.orchestra.run.smithi001.stdout:last_changed 2024-05-04T02:18:54.274978+0000 2024-05-04T02:18:54.279 INFO:teuthology.orchestra.run.smithi001.stdout:created 2024-05-04T02:18:54.274978+0000 2024-05-04T02:18:54.279 INFO:teuthology.orchestra.run.smithi001.stdout:min_mon_release 17 (quincy) 2024-05-04T02:18:54.279 INFO:teuthology.orchestra.run.smithi001.stdout:election_strategy: 1 2024-05-04T02:18:54.279 INFO:teuthology.orchestra.run.smithi001.stdout:0: [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] mon.a 2024-05-04T02:18:54.279 INFO:teuthology.orchestra.run.smithi001.stdout:1: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.b 2024-05-04T02:18:54.279 INFO:teuthology.orchestra.run.smithi001.stdout:2: [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] mon.c 2024-05-04T02:18:54.279 INFO:teuthology.orchestra.run.smithi001.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-05-04T02:18:54.280 DEBUG:teuthology.orchestra.run.smithi001:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-05-04T02:18:54.295 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID b45b4a9a-b84c-4a66-907b-43f0ca45e7c0... 2024-05-04T02:18:54.295 DEBUG:teuthology.orchestra.run.smithi001:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-04T02:18:54.337 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-04T02:18:54.376 INFO:teuthology.orchestra.run.smithi001.stdout:[global] 2024-05-04T02:18:54.377 INFO:teuthology.orchestra.run.smithi001.stdout: chdir = "" 2024-05-04T02:18:54.377 INFO:teuthology.orchestra.run.smithi001.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-04T02:18:54.377 INFO:teuthology.orchestra.run.smithi001.stdout: auth supported = cephx 2024-05-04T02:18:54.377 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:18:54.377 INFO:teuthology.orchestra.run.smithi001.stdout: filestore xattr use omap = true 2024-05-04T02:18:54.377 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:18:54.377 INFO:teuthology.orchestra.run.smithi001.stdout: mon clock drift allowed = 1.000 2024-05-04T02:18:54.377 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:18:54.377 INFO:teuthology.orchestra.run.smithi001.stdout: osd crush chooseleaf type = 0 2024-05-04T02:18:54.378 INFO:teuthology.orchestra.run.smithi001.stdout: auth debug = true 2024-05-04T02:18:54.378 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:18:54.378 INFO:teuthology.orchestra.run.smithi001.stdout: ms die on old message = true 2024-05-04T02:18:54.378 INFO:teuthology.orchestra.run.smithi001.stdout: ms die on bug = true 2024-05-04T02:18:54.378 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:18:54.378 INFO:teuthology.orchestra.run.smithi001.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-04T02:18:54.378 INFO:teuthology.orchestra.run.smithi001.stdout: mon pg warn max object skew = 0 2024-05-04T02:18:54.378 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:18:54.378 INFO:teuthology.orchestra.run.smithi001.stdout: # disable pg_autoscaler by default for new pools 2024-05-04T02:18:54.378 INFO:teuthology.orchestra.run.smithi001.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-04T02:18:54.378 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:18:54.378 INFO:teuthology.orchestra.run.smithi001.stdout: osd pool default size = 2 2024-05-04T02:18:54.378 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:18:54.379 INFO:teuthology.orchestra.run.smithi001.stdout: mon osd allow primary affinity = true 2024-05-04T02:18:54.379 INFO:teuthology.orchestra.run.smithi001.stdout: mon osd allow pg remap = true 2024-05-04T02:18:54.379 INFO:teuthology.orchestra.run.smithi001.stdout: mon warn on legacy crush tunables = false 2024-05-04T02:18:54.379 INFO:teuthology.orchestra.run.smithi001.stdout: mon warn on crush straw calc version zero = false 2024-05-04T02:18:54.379 INFO:teuthology.orchestra.run.smithi001.stdout: mon warn on no sortbitwise = false 2024-05-04T02:18:54.379 INFO:teuthology.orchestra.run.smithi001.stdout: mon warn on osd down out interval zero = false 2024-05-04T02:18:54.379 INFO:teuthology.orchestra.run.smithi001.stdout: mon warn on too few osds = false 2024-05-04T02:18:54.379 INFO:teuthology.orchestra.run.smithi001.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-04T02:18:54.379 INFO:teuthology.orchestra.run.smithi001.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-04T02:18:54.379 INFO:teuthology.orchestra.run.smithi001.stdout: mon_allow_pool_size_one = true 2024-05-04T02:18:54.379 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:18:54.379 INFO:teuthology.orchestra.run.smithi001.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-04T02:18:54.379 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:18:54.380 INFO:teuthology.orchestra.run.smithi001.stdout: osd default data pool replay window = 5 2024-05-04T02:18:54.380 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:18:54.380 INFO:teuthology.orchestra.run.smithi001.stdout: mon allow pool delete = true 2024-05-04T02:18:54.380 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:18:54.380 INFO:teuthology.orchestra.run.smithi001.stdout: mon cluster log file level = debug 2024-05-04T02:18:54.380 INFO:teuthology.orchestra.run.smithi001.stdout: debug asserts on shutdown = true 2024-05-04T02:18:54.380 INFO:teuthology.orchestra.run.smithi001.stdout: mon health detail to clog = false 2024-05-04T02:18:54.380 INFO:teuthology.orchestra.run.smithi001.stdout: mon host = "172.21.15.1,172.21.15.107,[v2:172.21.15.107:3301,v1:172.21.15.107:6790]" 2024-05-04T02:18:54.380 INFO:teuthology.orchestra.run.smithi001.stdout: mds beacon grace = 60 2024-05-04T02:18:54.380 INFO:teuthology.orchestra.run.smithi001.stdout: mds heartbeat grace = 60 2024-05-04T02:18:54.380 INFO:teuthology.orchestra.run.smithi001.stdout: osd heartbeat grace = 60 2024-05-04T02:18:54.380 INFO:teuthology.orchestra.run.smithi001.stdout: fsid = b45b4a9a-b84c-4a66-907b-43f0ca45e7c0 2024-05-04T02:18:54.380 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:18:54.380 INFO:teuthology.orchestra.run.smithi001.stdout:[osd] 2024-05-04T02:18:54.381 INFO:teuthology.orchestra.run.smithi001.stdout: osd journal size = 100 2024-05-04T02:18:54.381 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:18:54.381 INFO:teuthology.orchestra.run.smithi001.stdout: osd scrub load threshold = 5.0 2024-05-04T02:18:54.381 INFO:teuthology.orchestra.run.smithi001.stdout: osd scrub max interval = 600 2024-05-04T02:18:54.381 INFO:teuthology.orchestra.run.smithi001.stdout: osd mclock profile = high_recovery_ops 2024-05-04T02:18:54.381 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:18:54.381 INFO:teuthology.orchestra.run.smithi001.stdout: osd recover clone overlap = true 2024-05-04T02:18:54.381 INFO:teuthology.orchestra.run.smithi001.stdout: osd recovery max chunk = 1048576 2024-05-04T02:18:54.381 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:18:54.381 INFO:teuthology.orchestra.run.smithi001.stdout: osd debug shutdown = true 2024-05-04T02:18:54.381 INFO:teuthology.orchestra.run.smithi001.stdout: osd debug op order = true 2024-05-04T02:18:54.381 INFO:teuthology.orchestra.run.smithi001.stdout: osd debug verify stray on activate = true 2024-05-04T02:18:54.381 INFO:teuthology.orchestra.run.smithi001.stdout: osd debug trim objects = true 2024-05-04T02:18:54.382 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:18:54.382 INFO:teuthology.orchestra.run.smithi001.stdout: osd open classes on start = true 2024-05-04T02:18:54.382 INFO:teuthology.orchestra.run.smithi001.stdout: osd debug pg log writeout = true 2024-05-04T02:18:54.382 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:18:54.382 INFO:teuthology.orchestra.run.smithi001.stdout: osd deep scrub update digest min age = 30 2024-05-04T02:18:54.382 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:18:54.382 INFO:teuthology.orchestra.run.smithi001.stdout: osd map max advance = 10 2024-05-04T02:18:54.382 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:18:54.382 INFO:teuthology.orchestra.run.smithi001.stdout: journal zero on create = true 2024-05-04T02:18:54.382 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:18:54.382 INFO:teuthology.orchestra.run.smithi001.stdout: filestore ondisk finisher threads = 3 2024-05-04T02:18:54.382 INFO:teuthology.orchestra.run.smithi001.stdout: filestore apply finisher threads = 3 2024-05-04T02:18:54.383 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:18:54.383 INFO:teuthology.orchestra.run.smithi001.stdout: bdev debug aio = true 2024-05-04T02:18:54.383 INFO:teuthology.orchestra.run.smithi001.stdout: osd debug misdirected ops = true 2024-05-04T02:18:54.383 INFO:teuthology.orchestra.run.smithi001.stdout: bluestore block size = 96636764160 2024-05-04T02:18:54.383 INFO:teuthology.orchestra.run.smithi001.stdout: bluestore compression mode = aggressive 2024-05-04T02:18:54.383 INFO:teuthology.orchestra.run.smithi001.stdout: bluestore fsck on mount = True 2024-05-04T02:18:54.383 INFO:teuthology.orchestra.run.smithi001.stdout: debug bluefs = 20 2024-05-04T02:18:54.383 INFO:teuthology.orchestra.run.smithi001.stdout: debug bluestore = 20 2024-05-04T02:18:54.383 INFO:teuthology.orchestra.run.smithi001.stdout: debug ms = 1 2024-05-04T02:18:54.383 INFO:teuthology.orchestra.run.smithi001.stdout: debug osd = 20 2024-05-04T02:18:54.383 INFO:teuthology.orchestra.run.smithi001.stdout: debug rocksdb = 10 2024-05-04T02:18:54.383 INFO:teuthology.orchestra.run.smithi001.stdout: mon osd backfillfull_ratio = 0.85 2024-05-04T02:18:54.383 INFO:teuthology.orchestra.run.smithi001.stdout: mon osd full ratio = 0.9 2024-05-04T02:18:54.383 INFO:teuthology.orchestra.run.smithi001.stdout: mon osd nearfull ratio = 0.8 2024-05-04T02:18:54.384 INFO:teuthology.orchestra.run.smithi001.stdout: osd failsafe full ratio = 0.95 2024-05-04T02:18:54.384 INFO:teuthology.orchestra.run.smithi001.stdout: osd fast shutdown = False 2024-05-04T02:18:54.384 INFO:teuthology.orchestra.run.smithi001.stdout: osd objectstore = bluestore 2024-05-04T02:18:54.384 INFO:teuthology.orchestra.run.smithi001.stdout: osd op complaint time = 180 2024-05-04T02:18:54.384 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:18:54.384 INFO:teuthology.orchestra.run.smithi001.stdout:[mgr] 2024-05-04T02:18:54.384 INFO:teuthology.orchestra.run.smithi001.stdout: debug ms = 1 2024-05-04T02:18:54.384 INFO:teuthology.orchestra.run.smithi001.stdout: debug mgr = 20 2024-05-04T02:18:54.384 INFO:teuthology.orchestra.run.smithi001.stdout: debug mon = 20 2024-05-04T02:18:54.384 INFO:teuthology.orchestra.run.smithi001.stdout: debug auth = 20 2024-05-04T02:18:54.384 INFO:teuthology.orchestra.run.smithi001.stdout: mon reweight min pgs per osd = 4 2024-05-04T02:18:54.384 INFO:teuthology.orchestra.run.smithi001.stdout: mon reweight min bytes per osd = 10 2024-05-04T02:18:54.384 INFO:teuthology.orchestra.run.smithi001.stdout: mgr/telemetry/nag = false 2024-05-04T02:18:54.384 INFO:teuthology.orchestra.run.smithi001.stdout: debug client = 20 2024-05-04T02:18:54.385 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:18:54.385 INFO:teuthology.orchestra.run.smithi001.stdout:[mon] 2024-05-04T02:18:54.385 INFO:teuthology.orchestra.run.smithi001.stdout: debug ms = 1 2024-05-04T02:18:54.385 INFO:teuthology.orchestra.run.smithi001.stdout: debug mon = 20 2024-05-04T02:18:54.385 INFO:teuthology.orchestra.run.smithi001.stdout: debug paxos = 20 2024-05-04T02:18:54.385 INFO:teuthology.orchestra.run.smithi001.stdout: debug auth = 20 2024-05-04T02:18:54.385 INFO:teuthology.orchestra.run.smithi001.stdout: mon data avail warn = 5 2024-05-04T02:18:54.385 INFO:teuthology.orchestra.run.smithi001.stdout: mon mgr mkfs grace = 240 2024-05-04T02:18:54.385 INFO:teuthology.orchestra.run.smithi001.stdout: mon reweight min pgs per osd = 4 2024-05-04T02:18:54.385 INFO:teuthology.orchestra.run.smithi001.stdout: mon osd reporter subtree level = osd 2024-05-04T02:18:54.385 INFO:teuthology.orchestra.run.smithi001.stdout: mon osd prime pg temp = true 2024-05-04T02:18:54.385 INFO:teuthology.orchestra.run.smithi001.stdout: mon reweight min bytes per osd = 10 2024-05-04T02:18:54.385 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:18:54.385 INFO:teuthology.orchestra.run.smithi001.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-04T02:18:54.386 INFO:teuthology.orchestra.run.smithi001.stdout: auth mon ticket ttl = 660 # 11m 2024-05-04T02:18:54.386 INFO:teuthology.orchestra.run.smithi001.stdout: auth service ticket ttl = 240 # 4m 2024-05-04T02:18:54.386 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:18:54.386 INFO:teuthology.orchestra.run.smithi001.stdout: # don't complain about insecure global_id in the test suite 2024-05-04T02:18:54.386 INFO:teuthology.orchestra.run.smithi001.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-04T02:18:54.386 INFO:teuthology.orchestra.run.smithi001.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-04T02:18:54.386 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:18:54.386 INFO:teuthology.orchestra.run.smithi001.stdout: # 1m isn't quite enough 2024-05-04T02:18:54.386 INFO:teuthology.orchestra.run.smithi001.stdout: mon_down_mkfs_grace = 2m 2024-05-04T02:18:54.386 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:18:54.386 INFO:teuthology.orchestra.run.smithi001.stdout: mon_warn_on_filestore_osds = false 2024-05-04T02:18:54.386 INFO:teuthology.orchestra.run.smithi001.stdout: mon down mkfs grace = 300 2024-05-04T02:18:54.386 INFO:teuthology.orchestra.run.smithi001.stdout: mon op complaint time = 120 2024-05-04T02:18:54.387 INFO:teuthology.orchestra.run.smithi001.stdout: mon osd crush smoke test = False 2024-05-04T02:18:54.387 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:18:54.387 INFO:teuthology.orchestra.run.smithi001.stdout:[client] 2024-05-04T02:18:54.387 INFO:teuthology.orchestra.run.smithi001.stdout: rgw cache enabled = true 2024-05-04T02:18:54.387 INFO:teuthology.orchestra.run.smithi001.stdout: rgw enable ops log = true 2024-05-04T02:18:54.387 INFO:teuthology.orchestra.run.smithi001.stdout: rgw enable usage log = true 2024-05-04T02:18:54.387 INFO:teuthology.orchestra.run.smithi001.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-04T02:18:54.387 INFO:teuthology.orchestra.run.smithi001.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-04T02:18:54.387 INFO:teuthology.orchestra.run.smithi001.stdout: client mount timeout = 600 2024-05-04T02:18:54.387 INFO:teuthology.orchestra.run.smithi001.stdout: debug client = 20 2024-05-04T02:18:54.387 INFO:teuthology.orchestra.run.smithi001.stdout: debug ms = 1 2024-05-04T02:18:54.387 INFO:teuthology.orchestra.run.smithi001.stdout: rados mon op timeout = 900 2024-05-04T02:18:54.387 INFO:teuthology.orchestra.run.smithi001.stdout: rados osd op timeout = 900 2024-05-04T02:18:54.387 INFO:teuthology.orchestra.run.smithi001.stdout:[mon.a] 2024-05-04T02:18:54.388 INFO:teuthology.orchestra.run.smithi001.stdout:[mon.b] 2024-05-04T02:18:54.388 INFO:teuthology.orchestra.run.smithi001.stdout:[mon.c] 2024-05-04T02:18:54.388 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.a] 2024-05-04T02:18:54.388 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.c] 2024-05-04T02:18:54.388 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.e] 2024-05-04T02:18:54.388 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.b] 2024-05-04T02:18:54.388 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.d] 2024-05-04T02:18:54.388 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.f] 2024-05-04T02:18:54.388 INFO:teuthology.orchestra.run.smithi001.stdout:[mds] 2024-05-04T02:18:54.388 INFO:teuthology.orchestra.run.smithi001.stdout: debug mds = 20 2024-05-04T02:18:54.388 INFO:teuthology.orchestra.run.smithi001.stdout: debug mds balancer = 20 2024-05-04T02:18:54.388 INFO:teuthology.orchestra.run.smithi001.stdout: debug ms = 1 2024-05-04T02:18:54.388 INFO:teuthology.orchestra.run.smithi001.stdout: mds debug frag = True 2024-05-04T02:18:54.389 INFO:teuthology.orchestra.run.smithi001.stdout: mds debug scatterstat = True 2024-05-04T02:18:54.389 INFO:teuthology.orchestra.run.smithi001.stdout: mds op complaint time = 180 2024-05-04T02:18:54.389 INFO:teuthology.orchestra.run.smithi001.stdout: mds valgrind exit = True 2024-05-04T02:18:54.389 INFO:teuthology.orchestra.run.smithi001.stdout: mds verify scatter = True 2024-05-04T02:18:54.389 INFO:teuthology.orchestra.run.smithi001.stdout: osd op complaint time = 180 2024-05-04T02:18:54.389 INFO:teuthology.orchestra.run.smithi001.stdout: rados mon op timeout = 900 2024-05-04T02:18:54.389 INFO:teuthology.orchestra.run.smithi001.stdout: rados osd op timeout = 900 2024-05-04T02:18:54.391 INFO:teuthology.orchestra.run.smithi107.stdout:[global] 2024-05-04T02:18:54.391 INFO:teuthology.orchestra.run.smithi107.stdout: chdir = "" 2024-05-04T02:18:54.391 INFO:teuthology.orchestra.run.smithi107.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-04T02:18:54.391 INFO:teuthology.orchestra.run.smithi107.stdout: auth supported = cephx 2024-05-04T02:18:54.391 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-04T02:18:54.391 INFO:teuthology.orchestra.run.smithi107.stdout: filestore xattr use omap = true 2024-05-04T02:18:54.391 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-04T02:18:54.391 INFO:teuthology.orchestra.run.smithi107.stdout: mon clock drift allowed = 1.000 2024-05-04T02:18:54.392 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-04T02:18:54.392 INFO:teuthology.orchestra.run.smithi107.stdout: osd crush chooseleaf type = 0 2024-05-04T02:18:54.392 INFO:teuthology.orchestra.run.smithi107.stdout: auth debug = true 2024-05-04T02:18:54.392 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-04T02:18:54.392 INFO:teuthology.orchestra.run.smithi107.stdout: ms die on old message = true 2024-05-04T02:18:54.392 INFO:teuthology.orchestra.run.smithi107.stdout: ms die on bug = true 2024-05-04T02:18:54.392 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-04T02:18:54.392 INFO:teuthology.orchestra.run.smithi107.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-04T02:18:54.392 INFO:teuthology.orchestra.run.smithi107.stdout: mon pg warn max object skew = 0 2024-05-04T02:18:54.392 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-04T02:18:54.392 INFO:teuthology.orchestra.run.smithi107.stdout: # disable pg_autoscaler by default for new pools 2024-05-04T02:18:54.392 INFO:teuthology.orchestra.run.smithi107.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-04T02:18:54.392 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-04T02:18:54.392 INFO:teuthology.orchestra.run.smithi107.stdout: osd pool default size = 2 2024-05-04T02:18:54.392 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-04T02:18:54.393 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd allow primary affinity = true 2024-05-04T02:18:54.393 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd allow pg remap = true 2024-05-04T02:18:54.393 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on legacy crush tunables = false 2024-05-04T02:18:54.393 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on crush straw calc version zero = false 2024-05-04T02:18:54.393 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on no sortbitwise = false 2024-05-04T02:18:54.393 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on osd down out interval zero = false 2024-05-04T02:18:54.393 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on too few osds = false 2024-05-04T02:18:54.393 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-04T02:18:54.393 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-04T02:18:54.393 INFO:teuthology.orchestra.run.smithi107.stdout: mon_allow_pool_size_one = true 2024-05-04T02:18:54.393 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-04T02:18:54.393 INFO:teuthology.orchestra.run.smithi107.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-04T02:18:54.393 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-04T02:18:54.393 INFO:teuthology.orchestra.run.smithi107.stdout: osd default data pool replay window = 5 2024-05-04T02:18:54.393 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-04T02:18:54.394 INFO:teuthology.orchestra.run.smithi107.stdout: mon allow pool delete = true 2024-05-04T02:18:54.394 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-04T02:18:54.394 INFO:teuthology.orchestra.run.smithi107.stdout: mon cluster log file level = debug 2024-05-04T02:18:54.394 INFO:teuthology.orchestra.run.smithi107.stdout: debug asserts on shutdown = true 2024-05-04T02:18:54.394 INFO:teuthology.orchestra.run.smithi107.stdout: mon health detail to clog = false 2024-05-04T02:18:54.394 INFO:teuthology.orchestra.run.smithi107.stdout: mon host = "172.21.15.1,172.21.15.107,[v2:172.21.15.107:3301,v1:172.21.15.107:6790]" 2024-05-04T02:18:54.394 INFO:teuthology.orchestra.run.smithi107.stdout: mds beacon grace = 60 2024-05-04T02:18:54.394 INFO:teuthology.orchestra.run.smithi107.stdout: mds heartbeat grace = 60 2024-05-04T02:18:54.394 INFO:teuthology.orchestra.run.smithi107.stdout: osd heartbeat grace = 60 2024-05-04T02:18:54.394 INFO:teuthology.orchestra.run.smithi107.stdout: fsid = b45b4a9a-b84c-4a66-907b-43f0ca45e7c0 2024-05-04T02:18:54.394 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-04T02:18:54.394 INFO:teuthology.orchestra.run.smithi107.stdout:[osd] 2024-05-04T02:18:54.394 INFO:teuthology.orchestra.run.smithi107.stdout: osd journal size = 100 2024-05-04T02:18:54.395 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-04T02:18:54.395 INFO:teuthology.orchestra.run.smithi107.stdout: osd scrub load threshold = 5.0 2024-05-04T02:18:54.395 INFO:teuthology.orchestra.run.smithi107.stdout: osd scrub max interval = 600 2024-05-04T02:18:54.395 INFO:teuthology.orchestra.run.smithi107.stdout: osd mclock profile = high_recovery_ops 2024-05-04T02:18:54.395 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-04T02:18:54.395 INFO:teuthology.orchestra.run.smithi107.stdout: osd recover clone overlap = true 2024-05-04T02:18:54.395 INFO:teuthology.orchestra.run.smithi107.stdout: osd recovery max chunk = 1048576 2024-05-04T02:18:54.395 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-04T02:18:54.395 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug shutdown = true 2024-05-04T02:18:54.395 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug op order = true 2024-05-04T02:18:54.395 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug verify stray on activate = true 2024-05-04T02:18:54.395 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug trim objects = true 2024-05-04T02:18:54.395 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-04T02:18:54.395 INFO:teuthology.orchestra.run.smithi107.stdout: osd open classes on start = true 2024-05-04T02:18:54.396 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug pg log writeout = true 2024-05-04T02:18:54.396 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-04T02:18:54.396 INFO:teuthology.orchestra.run.smithi107.stdout: osd deep scrub update digest min age = 30 2024-05-04T02:18:54.396 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-04T02:18:54.396 INFO:teuthology.orchestra.run.smithi107.stdout: osd map max advance = 10 2024-05-04T02:18:54.396 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-04T02:18:54.396 INFO:teuthology.orchestra.run.smithi107.stdout: journal zero on create = true 2024-05-04T02:18:54.396 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-04T02:18:54.396 INFO:teuthology.orchestra.run.smithi107.stdout: filestore ondisk finisher threads = 3 2024-05-04T02:18:54.396 INFO:teuthology.orchestra.run.smithi107.stdout: filestore apply finisher threads = 3 2024-05-04T02:18:54.396 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-04T02:18:54.396 INFO:teuthology.orchestra.run.smithi107.stdout: bdev debug aio = true 2024-05-04T02:18:54.396 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug misdirected ops = true 2024-05-04T02:18:54.396 INFO:teuthology.orchestra.run.smithi107.stdout: bluestore block size = 96636764160 2024-05-04T02:18:54.396 INFO:teuthology.orchestra.run.smithi107.stdout: bluestore compression mode = aggressive 2024-05-04T02:18:54.396 INFO:teuthology.orchestra.run.smithi107.stdout: bluestore fsck on mount = True 2024-05-04T02:18:54.397 INFO:teuthology.orchestra.run.smithi107.stdout: debug bluefs = 20 2024-05-04T02:18:54.397 INFO:teuthology.orchestra.run.smithi107.stdout: debug bluestore = 20 2024-05-04T02:18:54.397 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2024-05-04T02:18:54.397 INFO:teuthology.orchestra.run.smithi107.stdout: debug osd = 20 2024-05-04T02:18:54.397 INFO:teuthology.orchestra.run.smithi107.stdout: debug rocksdb = 10 2024-05-04T02:18:54.397 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd backfillfull_ratio = 0.85 2024-05-04T02:18:54.397 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd full ratio = 0.9 2024-05-04T02:18:54.397 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd nearfull ratio = 0.8 2024-05-04T02:18:54.397 INFO:teuthology.orchestra.run.smithi107.stdout: osd failsafe full ratio = 0.95 2024-05-04T02:18:54.397 INFO:teuthology.orchestra.run.smithi107.stdout: osd fast shutdown = False 2024-05-04T02:18:54.397 INFO:teuthology.orchestra.run.smithi107.stdout: osd objectstore = bluestore 2024-05-04T02:18:54.397 INFO:teuthology.orchestra.run.smithi107.stdout: osd op complaint time = 180 2024-05-04T02:18:54.397 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-04T02:18:54.397 INFO:teuthology.orchestra.run.smithi107.stdout:[mgr] 2024-05-04T02:18:54.397 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2024-05-04T02:18:54.398 INFO:teuthology.orchestra.run.smithi107.stdout: debug mgr = 20 2024-05-04T02:18:54.398 INFO:teuthology.orchestra.run.smithi107.stdout: debug mon = 20 2024-05-04T02:18:54.398 INFO:teuthology.orchestra.run.smithi107.stdout: debug auth = 20 2024-05-04T02:18:54.398 INFO:teuthology.orchestra.run.smithi107.stdout: mon reweight min pgs per osd = 4 2024-05-04T02:18:54.398 INFO:teuthology.orchestra.run.smithi107.stdout: mon reweight min bytes per osd = 10 2024-05-04T02:18:54.398 INFO:teuthology.orchestra.run.smithi107.stdout: mgr/telemetry/nag = false 2024-05-04T02:18:54.398 INFO:teuthology.orchestra.run.smithi107.stdout: debug client = 20 2024-05-04T02:18:54.398 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-04T02:18:54.398 INFO:teuthology.orchestra.run.smithi107.stdout:[mon] 2024-05-04T02:18:54.398 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2024-05-04T02:18:54.398 INFO:teuthology.orchestra.run.smithi107.stdout: debug mon = 20 2024-05-04T02:18:54.398 INFO:teuthology.orchestra.run.smithi107.stdout: debug paxos = 20 2024-05-04T02:18:54.398 INFO:teuthology.orchestra.run.smithi107.stdout: debug auth = 20 2024-05-04T02:18:54.398 INFO:teuthology.orchestra.run.smithi107.stdout: mon data avail warn = 5 2024-05-04T02:18:54.399 INFO:teuthology.orchestra.run.smithi107.stdout: mon mgr mkfs grace = 240 2024-05-04T02:18:54.399 INFO:teuthology.orchestra.run.smithi107.stdout: mon reweight min pgs per osd = 4 2024-05-04T02:18:54.399 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd reporter subtree level = osd 2024-05-04T02:18:54.399 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd prime pg temp = true 2024-05-04T02:18:54.399 INFO:teuthology.orchestra.run.smithi107.stdout: mon reweight min bytes per osd = 10 2024-05-04T02:18:54.399 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-04T02:18:54.399 INFO:teuthology.orchestra.run.smithi107.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-04T02:18:54.399 INFO:teuthology.orchestra.run.smithi107.stdout: auth mon ticket ttl = 660 # 11m 2024-05-04T02:18:54.399 INFO:teuthology.orchestra.run.smithi107.stdout: auth service ticket ttl = 240 # 4m 2024-05-04T02:18:54.399 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-04T02:18:54.399 INFO:teuthology.orchestra.run.smithi107.stdout: # don't complain about insecure global_id in the test suite 2024-05-04T02:18:54.399 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-04T02:18:54.399 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-04T02:18:54.399 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-04T02:18:54.399 INFO:teuthology.orchestra.run.smithi107.stdout: # 1m isn't quite enough 2024-05-04T02:18:54.399 INFO:teuthology.orchestra.run.smithi107.stdout: mon_down_mkfs_grace = 2m 2024-05-04T02:18:54.400 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-04T02:18:54.400 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_filestore_osds = false 2024-05-04T02:18:54.400 INFO:teuthology.orchestra.run.smithi107.stdout: mon down mkfs grace = 300 2024-05-04T02:18:54.400 INFO:teuthology.orchestra.run.smithi107.stdout: mon op complaint time = 120 2024-05-04T02:18:54.400 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd crush smoke test = False 2024-05-04T02:18:54.400 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-05-04T02:18:54.400 INFO:teuthology.orchestra.run.smithi107.stdout:[client] 2024-05-04T02:18:54.400 INFO:teuthology.orchestra.run.smithi107.stdout: rgw cache enabled = true 2024-05-04T02:18:54.400 INFO:teuthology.orchestra.run.smithi107.stdout: rgw enable ops log = true 2024-05-04T02:18:54.400 INFO:teuthology.orchestra.run.smithi107.stdout: rgw enable usage log = true 2024-05-04T02:18:54.400 INFO:teuthology.orchestra.run.smithi107.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-04T02:18:54.400 INFO:teuthology.orchestra.run.smithi107.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-04T02:18:54.400 INFO:teuthology.orchestra.run.smithi107.stdout: client mount timeout = 600 2024-05-04T02:18:54.400 INFO:teuthology.orchestra.run.smithi107.stdout: debug client = 20 2024-05-04T02:18:54.400 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2024-05-04T02:18:54.400 INFO:teuthology.orchestra.run.smithi107.stdout: rados mon op timeout = 900 2024-05-04T02:18:54.400 INFO:teuthology.orchestra.run.smithi107.stdout: rados osd op timeout = 900 2024-05-04T02:18:54.401 INFO:teuthology.orchestra.run.smithi107.stdout:[mon.a] 2024-05-04T02:18:54.401 INFO:teuthology.orchestra.run.smithi107.stdout:[mon.b] 2024-05-04T02:18:54.401 INFO:teuthology.orchestra.run.smithi107.stdout:[mon.c] 2024-05-04T02:18:54.401 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.a] 2024-05-04T02:18:54.401 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.c] 2024-05-04T02:18:54.401 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.e] 2024-05-04T02:18:54.401 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.b] 2024-05-04T02:18:54.401 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.d] 2024-05-04T02:18:54.401 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.f] 2024-05-04T02:18:54.401 INFO:teuthology.orchestra.run.smithi107.stdout:[mds] 2024-05-04T02:18:54.401 INFO:teuthology.orchestra.run.smithi107.stdout: debug mds = 20 2024-05-04T02:18:54.401 INFO:teuthology.orchestra.run.smithi107.stdout: debug mds balancer = 20 2024-05-04T02:18:54.401 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2024-05-04T02:18:54.401 INFO:teuthology.orchestra.run.smithi107.stdout: mds debug frag = True 2024-05-04T02:18:54.401 INFO:teuthology.orchestra.run.smithi107.stdout: mds debug scatterstat = True 2024-05-04T02:18:54.401 INFO:teuthology.orchestra.run.smithi107.stdout: mds op complaint time = 180 2024-05-04T02:18:54.402 INFO:teuthology.orchestra.run.smithi107.stdout: mds valgrind exit = True 2024-05-04T02:18:54.402 INFO:teuthology.orchestra.run.smithi107.stdout: mds verify scatter = True 2024-05-04T02:18:54.402 INFO:teuthology.orchestra.run.smithi107.stdout: osd op complaint time = 180 2024-05-04T02:18:54.402 INFO:teuthology.orchestra.run.smithi107.stdout: rados mon op timeout = 900 2024-05-04T02:18:54.402 INFO:teuthology.orchestra.run.smithi107.stdout: rados osd op timeout = 900 2024-05-04T02:18:54.402 INFO:tasks.ceph:Creating admin key on mon.a... 2024-05-04T02:18:54.402 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-05-04T02:18:54.495 INFO:tasks.ceph:Copying monmap to all nodes... 2024-05-04T02:18:54.495 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-05-04T02:18:54.495 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-05-04T02:18:54.511 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-05-04T02:18:54.511 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-05-04T02:18:54.566 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi001.front.sepia.ceph.com 2024-05-04T02:18:54.566 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-05-04T02:18:54.566 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-04T02:18:54.566 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-04T02:18:54.639 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-05-04T02:18:54.639 DEBUG:teuthology.orchestra.run.smithi001:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-04T02:18:54.694 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi107.front.sepia.ceph.com 2024-05-04T02:18:54.694 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-04T02:18:54.694 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-04T02:18:54.694 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-04T02:18:54.726 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-04T02:18:54.726 DEBUG:teuthology.orchestra.run.smithi107:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-04T02:18:54.781 INFO:tasks.ceph:Setting up mon nodes... 2024-05-04T02:18:54.781 INFO:tasks.ceph:Setting up mgr nodes... 2024-05-04T02:18:54.782 DEBUG:teuthology.orchestra.run.smithi001:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-05-04T02:18:54.841 INFO:teuthology.orchestra.run.smithi001.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-05-04T02:18:54.844 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-05-04T02:18:54.916 INFO:teuthology.orchestra.run.smithi107.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-05-04T02:18:54.919 INFO:tasks.ceph:Setting up mds nodes... 2024-05-04T02:18:54.920 DEBUG:teuthology.orchestra.run.smithi001:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-05-04T02:18:54.979 INFO:teuthology.orchestra.run.smithi001.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-05-04T02:18:54.982 DEBUG:teuthology.orchestra.run.smithi001:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-05-04T02:18:55.006 DEBUG:teuthology.orchestra.run.smithi001:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-05-04T02:18:55.106 INFO:teuthology.orchestra.run.smithi001.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-05-04T02:18:55.109 DEBUG:teuthology.orchestra.run.smithi001:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-05-04T02:18:55.133 DEBUG:teuthology.orchestra.run.smithi001:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2024-05-04T02:18:55.232 INFO:teuthology.orchestra.run.smithi001.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2024-05-04T02:18:55.235 DEBUG:teuthology.orchestra.run.smithi001:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2024-05-04T02:18:55.259 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-05-04T02:18:55.319 INFO:teuthology.orchestra.run.smithi107.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-05-04T02:18:55.322 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-05-04T02:18:55.346 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-05-04T02:18:55.442 INFO:teuthology.orchestra.run.smithi107.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-05-04T02:18:55.445 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-05-04T02:18:55.467 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2024-05-04T02:18:55.566 INFO:teuthology.orchestra.run.smithi107.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2024-05-04T02:18:55.567 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2024-05-04T02:18:55.590 INFO:tasks.ceph_client:Setting up client nodes... 2024-05-04T02:18:55.591 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-04T02:18:55.642 INFO:teuthology.orchestra.run.smithi001.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-05-04T02:18:55.656 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-05-04T02:18:55.656 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi001.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi107.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-04T02:18:55.656 DEBUG:teuthology.orchestra.run.smithi001:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-05-04T02:18:55.681 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-04T02:18:55.681 INFO:tasks.ceph:role: osd.0 2024-05-04T02:18:55.682 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi001.front.sepia.ceph.com 2024-05-04T02:18:55.682 DEBUG:teuthology.orchestra.run.smithi001:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-04T02:18:55.746 INFO:teuthology.orchestra.run.smithi001.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-04T02:18:55.746 INFO:teuthology.orchestra.run.smithi001.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-04T02:18:55.746 INFO:teuthology.orchestra.run.smithi001.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-04T02:18:55.746 INFO:teuthology.orchestra.run.smithi001.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-04T02:18:55.746 INFO:teuthology.orchestra.run.smithi001.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-04T02:18:55.746 INFO:teuthology.orchestra.run.smithi001.stdout: = sunit=0 swidth=0 blks 2024-05-04T02:18:55.747 INFO:teuthology.orchestra.run.smithi001.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-04T02:18:55.747 INFO:teuthology.orchestra.run.smithi001.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-04T02:18:55.747 INFO:teuthology.orchestra.run.smithi001.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-04T02:18:55.747 INFO:teuthology.orchestra.run.smithi001.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-04T02:18:55.778 INFO:teuthology.orchestra.run.smithi001.stdout:Discarding blocks...Done. 2024-05-04T02:18:55.780 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi001.front.sepia.ceph.com -o noatime 2024-05-04T02:18:55.780 DEBUG:teuthology.orchestra.run.smithi001:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-05-04T02:18:55.848 DEBUG:teuthology.orchestra.run.smithi001:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-05-04T02:18:55.918 DEBUG:teuthology.orchestra.run.smithi001:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-05-04T02:18:55.984 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-04T02:18:55.984 INFO:tasks.ceph:role: osd.1 2024-05-04T02:18:55.984 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi001.front.sepia.ceph.com 2024-05-04T02:18:55.985 DEBUG:teuthology.orchestra.run.smithi001:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-04T02:18:56.047 INFO:teuthology.orchestra.run.smithi001.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-04T02:18:56.048 INFO:teuthology.orchestra.run.smithi001.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-04T02:18:56.048 INFO:teuthology.orchestra.run.smithi001.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-04T02:18:56.048 INFO:teuthology.orchestra.run.smithi001.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-04T02:18:56.048 INFO:teuthology.orchestra.run.smithi001.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-04T02:18:56.048 INFO:teuthology.orchestra.run.smithi001.stdout: = sunit=0 swidth=0 blks 2024-05-04T02:18:56.048 INFO:teuthology.orchestra.run.smithi001.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-04T02:18:56.048 INFO:teuthology.orchestra.run.smithi001.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-04T02:18:56.048 INFO:teuthology.orchestra.run.smithi001.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-04T02:18:56.048 INFO:teuthology.orchestra.run.smithi001.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-04T02:18:56.080 INFO:teuthology.orchestra.run.smithi001.stdout:Discarding blocks...Done. 2024-05-04T02:18:56.082 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi001.front.sepia.ceph.com -o noatime 2024-05-04T02:18:56.083 DEBUG:teuthology.orchestra.run.smithi001:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-05-04T02:18:56.151 DEBUG:teuthology.orchestra.run.smithi001:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-05-04T02:18:56.221 DEBUG:teuthology.orchestra.run.smithi001:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-05-04T02:18:56.285 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-04T02:18:56.285 INFO:tasks.ceph:role: osd.2 2024-05-04T02:18:56.285 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi001.front.sepia.ceph.com 2024-05-04T02:18:56.285 DEBUG:teuthology.orchestra.run.smithi001:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-04T02:18:56.351 INFO:teuthology.orchestra.run.smithi001.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-04T02:18:56.351 INFO:teuthology.orchestra.run.smithi001.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-04T02:18:56.351 INFO:teuthology.orchestra.run.smithi001.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-04T02:18:56.352 INFO:teuthology.orchestra.run.smithi001.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-04T02:18:56.352 INFO:teuthology.orchestra.run.smithi001.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-04T02:18:56.352 INFO:teuthology.orchestra.run.smithi001.stdout: = sunit=0 swidth=0 blks 2024-05-04T02:18:56.352 INFO:teuthology.orchestra.run.smithi001.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-04T02:18:56.352 INFO:teuthology.orchestra.run.smithi001.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-04T02:18:56.352 INFO:teuthology.orchestra.run.smithi001.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-04T02:18:56.353 INFO:teuthology.orchestra.run.smithi001.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-04T02:18:56.383 INFO:teuthology.orchestra.run.smithi001.stdout:Discarding blocks...Done. 2024-05-04T02:18:56.385 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi001.front.sepia.ceph.com -o noatime 2024-05-04T02:18:56.385 DEBUG:teuthology.orchestra.run.smithi001:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-05-04T02:18:56.459 DEBUG:teuthology.orchestra.run.smithi001:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-05-04T02:18:56.529 DEBUG:teuthology.orchestra.run.smithi001:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-05-04T02:18:56.593 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-04T02:18:56.593 INFO:tasks.ceph:role: osd.3 2024-05-04T02:18:56.593 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi001.front.sepia.ceph.com 2024-05-04T02:18:56.593 DEBUG:teuthology.orchestra.run.smithi001:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-04T02:18:56.656 INFO:teuthology.orchestra.run.smithi001.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-04T02:18:56.656 INFO:teuthology.orchestra.run.smithi001.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-04T02:18:56.656 INFO:teuthology.orchestra.run.smithi001.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-04T02:18:56.656 INFO:teuthology.orchestra.run.smithi001.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-04T02:18:56.656 INFO:teuthology.orchestra.run.smithi001.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-04T02:18:56.657 INFO:teuthology.orchestra.run.smithi001.stdout: = sunit=0 swidth=0 blks 2024-05-04T02:18:56.657 INFO:teuthology.orchestra.run.smithi001.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-04T02:18:56.657 INFO:teuthology.orchestra.run.smithi001.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-04T02:18:56.657 INFO:teuthology.orchestra.run.smithi001.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-04T02:18:56.657 INFO:teuthology.orchestra.run.smithi001.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-04T02:18:56.689 INFO:teuthology.orchestra.run.smithi001.stdout:Discarding blocks...Done. 2024-05-04T02:18:56.691 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi001.front.sepia.ceph.com -o noatime 2024-05-04T02:18:56.691 DEBUG:teuthology.orchestra.run.smithi001:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-05-04T02:18:56.759 DEBUG:teuthology.orchestra.run.smithi001:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-05-04T02:18:56.827 DEBUG:teuthology.orchestra.run.smithi001:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-04T02:18:56.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:18:56.924+0000 7f764d00e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-05-04T02:18:56.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:18:56.924+0000 7f764d00e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-05-04T02:18:56.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:18:56.924+0000 7f764d00e640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-04T02:18:56.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:18:56.924+0000 7f764d00e640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-04T02:18:56.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:18:56.924+0000 7f764d00e640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-04T02:18:56.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:18:56.925+0000 7f764d00e640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-05-04T02:18:59.780 DEBUG:teuthology.orchestra.run.smithi001:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-04T02:18:59.810 DEBUG:teuthology.orchestra.run.smithi001:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-04T02:18:59.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:18:59.912+0000 7f7d2d612640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-05-04T02:18:59.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:18:59.913+0000 7f7d2d612640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-05-04T02:18:59.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:18:59.913+0000 7f7d2d612640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-04T02:18:59.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:18:59.913+0000 7f7d2d612640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-04T02:18:59.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:18:59.913+0000 7f7d2d612640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-04T02:18:59.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:18:59.913+0000 7f7d2d612640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-05-04T02:19:02.767 DEBUG:teuthology.orchestra.run.smithi001:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-04T02:19:02.795 DEBUG:teuthology.orchestra.run.smithi001:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-04T02:19:02.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:02.895+0000 7f9dff49d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-05-04T02:19:02.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:02.896+0000 7f9dff49d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-05-04T02:19:02.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:02.896+0000 7f9dff49d640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-04T02:19:02.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:02.896+0000 7f9dff49d640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-04T02:19:02.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:02.896+0000 7f9dff49d640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-04T02:19:02.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:02.896+0000 7f9dff49d640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-05-04T02:19:05.752 DEBUG:teuthology.orchestra.run.smithi001:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-04T02:19:05.780 DEBUG:teuthology.orchestra.run.smithi001:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-04T02:19:05.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:05.879+0000 7f5e092ee640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-05-04T02:19:05.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:05.880+0000 7f5e092ee640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-05-04T02:19:05.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:05.880+0000 7f5e092ee640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-04T02:19:05.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:05.880+0000 7f5e092ee640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-04T02:19:05.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:05.880+0000 7f5e092ee640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-04T02:19:05.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:05.880+0000 7f5e092ee640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-05-04T02:19:08.731 DEBUG:teuthology.orchestra.run.smithi001:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-04T02:19:08.760 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-05-04T02:19:08.788 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-04T02:19:08.789 INFO:tasks.ceph:role: osd.4 2024-05-04T02:19:08.789 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi107.front.sepia.ceph.com 2024-05-04T02:19:08.789 DEBUG:teuthology.orchestra.run.smithi107:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-04T02:19:08.864 INFO:teuthology.orchestra.run.smithi107.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-04T02:19:08.864 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-04T02:19:08.864 INFO:teuthology.orchestra.run.smithi107.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-04T02:19:08.864 INFO:teuthology.orchestra.run.smithi107.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-04T02:19:08.864 INFO:teuthology.orchestra.run.smithi107.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-04T02:19:08.864 INFO:teuthology.orchestra.run.smithi107.stdout: = sunit=0 swidth=0 blks 2024-05-04T02:19:08.864 INFO:teuthology.orchestra.run.smithi107.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-04T02:19:08.864 INFO:teuthology.orchestra.run.smithi107.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-04T02:19:08.864 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-04T02:19:08.864 INFO:teuthology.orchestra.run.smithi107.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-04T02:19:09.363 INFO:teuthology.orchestra.run.smithi107.stdout:Discarding blocks...Done. 2024-05-04T02:19:09.366 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi107.front.sepia.ceph.com -o noatime 2024-05-04T02:19:09.366 DEBUG:teuthology.orchestra.run.smithi107:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-05-04T02:19:09.510 DEBUG:teuthology.orchestra.run.smithi107:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-05-04T02:19:09.543 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-05-04T02:19:09.609 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-04T02:19:09.609 INFO:tasks.ceph:role: osd.5 2024-05-04T02:19:09.609 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi107.front.sepia.ceph.com 2024-05-04T02:19:09.609 DEBUG:teuthology.orchestra.run.smithi107:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-04T02:19:09.680 INFO:teuthology.orchestra.run.smithi107.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-04T02:19:09.680 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-04T02:19:09.680 INFO:teuthology.orchestra.run.smithi107.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-04T02:19:09.680 INFO:teuthology.orchestra.run.smithi107.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-04T02:19:09.680 INFO:teuthology.orchestra.run.smithi107.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-04T02:19:09.680 INFO:teuthology.orchestra.run.smithi107.stdout: = sunit=0 swidth=0 blks 2024-05-04T02:19:09.680 INFO:teuthology.orchestra.run.smithi107.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-04T02:19:09.680 INFO:teuthology.orchestra.run.smithi107.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-04T02:19:09.680 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-04T02:19:09.680 INFO:teuthology.orchestra.run.smithi107.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-04T02:19:10.139 INFO:teuthology.orchestra.run.smithi107.stdout:Discarding blocks...Done. 2024-05-04T02:19:10.141 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi107.front.sepia.ceph.com -o noatime 2024-05-04T02:19:10.141 DEBUG:teuthology.orchestra.run.smithi107:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-05-04T02:19:10.233 DEBUG:teuthology.orchestra.run.smithi107:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-05-04T02:19:10.260 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-05-04T02:19:10.324 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-04T02:19:10.324 INFO:tasks.ceph:role: osd.6 2024-05-04T02:19:10.324 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi107.front.sepia.ceph.com 2024-05-04T02:19:10.324 DEBUG:teuthology.orchestra.run.smithi107:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-04T02:19:10.394 INFO:teuthology.orchestra.run.smithi107.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-04T02:19:10.395 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-04T02:19:10.395 INFO:teuthology.orchestra.run.smithi107.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-04T02:19:10.395 INFO:teuthology.orchestra.run.smithi107.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-04T02:19:10.395 INFO:teuthology.orchestra.run.smithi107.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-04T02:19:10.395 INFO:teuthology.orchestra.run.smithi107.stdout: = sunit=0 swidth=0 blks 2024-05-04T02:19:10.395 INFO:teuthology.orchestra.run.smithi107.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-04T02:19:10.395 INFO:teuthology.orchestra.run.smithi107.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-04T02:19:10.395 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-04T02:19:10.395 INFO:teuthology.orchestra.run.smithi107.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-04T02:19:10.880 INFO:teuthology.orchestra.run.smithi107.stdout:Discarding blocks...Done. 2024-05-04T02:19:10.882 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi107.front.sepia.ceph.com -o noatime 2024-05-04T02:19:10.882 DEBUG:teuthology.orchestra.run.smithi107:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-05-04T02:19:11.019 DEBUG:teuthology.orchestra.run.smithi107:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-05-04T02:19:11.048 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-05-04T02:19:11.112 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-04T02:19:11.112 INFO:tasks.ceph:role: osd.7 2024-05-04T02:19:11.112 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi107.front.sepia.ceph.com 2024-05-04T02:19:11.112 DEBUG:teuthology.orchestra.run.smithi107:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-04T02:19:11.183 INFO:teuthology.orchestra.run.smithi107.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-04T02:19:11.183 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-04T02:19:11.183 INFO:teuthology.orchestra.run.smithi107.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-04T02:19:11.183 INFO:teuthology.orchestra.run.smithi107.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-04T02:19:11.183 INFO:teuthology.orchestra.run.smithi107.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-04T02:19:11.183 INFO:teuthology.orchestra.run.smithi107.stdout: = sunit=0 swidth=0 blks 2024-05-04T02:19:11.183 INFO:teuthology.orchestra.run.smithi107.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-04T02:19:11.183 INFO:teuthology.orchestra.run.smithi107.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-04T02:19:11.183 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-04T02:19:11.183 INFO:teuthology.orchestra.run.smithi107.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-04T02:19:11.699 INFO:teuthology.orchestra.run.smithi107.stdout:Discarding blocks...Done. 2024-05-04T02:19:11.701 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi107.front.sepia.ceph.com -o noatime 2024-05-04T02:19:11.701 DEBUG:teuthology.orchestra.run.smithi107:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-05-04T02:19:11.847 DEBUG:teuthology.orchestra.run.smithi107:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-05-04T02:19:11.879 DEBUG:teuthology.orchestra.run.smithi107:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-04T02:19:11.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:11.993+0000 7f0a9520c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-05-04T02:19:11.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:11.993+0000 7f0a9520c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-05-04T02:19:11.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:11.993+0000 7f0a9520c640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-04T02:19:11.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:11.993+0000 7f0a9520c640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-04T02:19:11.996 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:11.993+0000 7f0a9520c640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-04T02:19:11.997 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:11.995+0000 7f0a9520c640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-05-04T02:19:14.845 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-04T02:19:14.872 DEBUG:teuthology.orchestra.run.smithi107:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-04T02:19:14.971 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:14.968+0000 7f8578e9a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-05-04T02:19:14.971 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:14.968+0000 7f8578e9a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-05-04T02:19:14.971 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:14.968+0000 7f8578e9a640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-04T02:19:14.971 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:14.968+0000 7f8578e9a640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-04T02:19:14.971 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:14.968+0000 7f8578e9a640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-04T02:19:14.972 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:14.969+0000 7f8578e9a640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-05-04T02:19:17.814 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-04T02:19:17.839 DEBUG:teuthology.orchestra.run.smithi107:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-04T02:19:17.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:17.933+0000 7f4cda013640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-05-04T02:19:17.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:17.933+0000 7f4cda013640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-05-04T02:19:17.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:17.933+0000 7f4cda013640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-04T02:19:17.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:17.933+0000 7f4cda013640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-04T02:19:17.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:17.933+0000 7f4cda013640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-04T02:19:17.936 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:17.933+0000 7f4cda013640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-05-04T02:19:20.795 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-05-04T02:19:20.821 DEBUG:teuthology.orchestra.run.smithi107:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-04T02:19:20.917 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:20.914+0000 7f4848a1f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-05-04T02:19:20.917 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:20.914+0000 7f4848a1f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-05-04T02:19:20.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:20.914+0000 7f4848a1f640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-04T02:19:20.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:20.914+0000 7f4848a1f640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-04T02:19:20.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:20.914+0000 7f4848a1f640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-04T02:19:20.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:20.915+0000 7f4848a1f640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-05-04T02:19:22.402 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:19:22.405 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:19:23.768 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-05-04T02:19:23.795 INFO:tasks.ceph:Reading keys from all nodes... 2024-05-04T02:19:23.795 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-05-04T02:19:23.795 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-05-04T02:19:23.825 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-05-04T02:19:23.825 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-05-04T02:19:23.894 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-05-04T02:19:23.895 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-05-04T02:19:23.963 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-05-04T02:19:23.963 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2024-05-04T02:19:24.032 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-05-04T02:19:24.032 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-05-04T02:19:24.099 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-05-04T02:19:24.099 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-05-04T02:19:24.166 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-05-04T02:19:24.166 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-05-04T02:19:24.233 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-05-04T02:19:24.233 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-05-04T02:19:24.299 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-04T02:19:24.299 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-05-04T02:19:24.327 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-04T02:19:24.328 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-05-04T02:19:24.395 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-04T02:19:24.395 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-05-04T02:19:24.460 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-04T02:19:24.461 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2024-05-04T02:19:24.526 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-04T02:19:24.526 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-05-04T02:19:24.591 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-04T02:19:24.591 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-05-04T02:19:24.656 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-04T02:19:24.656 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-05-04T02:19:24.722 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-04T02:19:24.722 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-05-04T02:19:24.787 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-05-04T02:19:24.787 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-05-04T02:19:24.805 INFO:tasks.ceph:Adding keys to all mons... 2024-05-04T02:19:24.805 DEBUG:teuthology.orchestra.run.smithi001:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-04T02:19:24.847 DEBUG:teuthology.orchestra.run.smithi107:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-04T02:19:24.870 INFO:teuthology.orchestra.run.smithi107.stdout:[mgr.y] 2024-05-04T02:19:24.870 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQAOmzVmZCQWMhAAkRLj9TDOCbdCbfGzk4hl3w== 2024-05-04T02:19:24.870 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.a] 2024-05-04T02:19:24.870 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQAOmzVmIDROOhAA3cyTXqXr/Hf+NgDv3P2e0Q== 2024-05-04T02:19:24.870 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.c] 2024-05-04T02:19:24.870 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQAPmzVm3yBDBhAAq1fS4goRxc5PDoyYo5kv9g== 2024-05-04T02:19:24.870 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.e] 2024-05-04T02:19:24.870 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQAPmzVmAnvHDRAAIkOl5tHNv7rQEe9+RNR8JA== 2024-05-04T02:19:24.870 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.0] 2024-05-04T02:19:24.870 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQAQmzVm6/0nNxAAZFCEr+AgV3AFPvZVpTYlow== 2024-05-04T02:19:24.871 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.1] 2024-05-04T02:19:24.871 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQATmzVm/o92NhAAMbXZSHRf0a+u+az4eAsGwQ== 2024-05-04T02:19:24.871 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.2] 2024-05-04T02:19:24.871 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQAWmzVmSRtzNRAADD5kA/+rwZlKJdYdyBnIHw== 2024-05-04T02:19:24.871 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.3] 2024-05-04T02:19:24.871 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQAZmzVm65B+NBAAsn71okYdDubo1eEIYNhGIQ== 2024-05-04T02:19:24.871 INFO:teuthology.orchestra.run.smithi107.stdout:[mgr.x] 2024-05-04T02:19:24.871 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQAOmzVmV5uQNhAA2npwXBp7+9S716+EHMIhVA== 2024-05-04T02:19:24.871 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.b] 2024-05-04T02:19:24.871 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQAPmzVmoAb4EhAAWKVsxHKvjP7BuTXlsWe5bQ== 2024-05-04T02:19:24.871 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.d] 2024-05-04T02:19:24.871 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQAPmzVmHnNGGhAACyVLrTJs5TX3OnZT28ux0A== 2024-05-04T02:19:24.871 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.f] 2024-05-04T02:19:24.871 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQAPmzVm6h2XIRAAJZSEaktXSmQVQWtBwzJs4A== 2024-05-04T02:19:24.872 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.4] 2024-05-04T02:19:24.872 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQAfmzVma2lDOxAAMD1MFeU95y3Ce+1tvVNibg== 2024-05-04T02:19:24.872 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.5] 2024-05-04T02:19:24.872 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQAimzVmoUnMORAAXH4qdW8i5+uJJYynMUxFPA== 2024-05-04T02:19:24.872 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.6] 2024-05-04T02:19:24.872 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQAlmzVmhDivNxAAT9tCQzhE2V9tGYrplIJCJA== 2024-05-04T02:19:24.872 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.7] 2024-05-04T02:19:24.872 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQAomzVmoiqWNhAAKi/uYwyDCDeNoLh5aWgrJA== 2024-05-04T02:19:24.872 INFO:teuthology.orchestra.run.smithi107.stdout:[client.0] 2024-05-04T02:19:24.872 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQAPmzVmsa09JhAATRPryciACpqSxjZnF8n5oA== 2024-05-04T02:19:24.873 INFO:teuthology.orchestra.run.smithi001.stdout:[mgr.y] 2024-05-04T02:19:24.874 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQAOmzVmZCQWMhAAkRLj9TDOCbdCbfGzk4hl3w== 2024-05-04T02:19:24.874 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.a] 2024-05-04T02:19:24.874 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQAOmzVmIDROOhAA3cyTXqXr/Hf+NgDv3P2e0Q== 2024-05-04T02:19:24.874 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.c] 2024-05-04T02:19:24.874 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQAPmzVm3yBDBhAAq1fS4goRxc5PDoyYo5kv9g== 2024-05-04T02:19:24.874 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.e] 2024-05-04T02:19:24.874 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQAPmzVmAnvHDRAAIkOl5tHNv7rQEe9+RNR8JA== 2024-05-04T02:19:24.874 INFO:teuthology.orchestra.run.smithi001.stdout:[osd.0] 2024-05-04T02:19:24.874 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQAQmzVm6/0nNxAAZFCEr+AgV3AFPvZVpTYlow== 2024-05-04T02:19:24.874 INFO:teuthology.orchestra.run.smithi001.stdout:[osd.1] 2024-05-04T02:19:24.874 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQATmzVm/o92NhAAMbXZSHRf0a+u+az4eAsGwQ== 2024-05-04T02:19:24.875 INFO:teuthology.orchestra.run.smithi001.stdout:[osd.2] 2024-05-04T02:19:24.875 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQAWmzVmSRtzNRAADD5kA/+rwZlKJdYdyBnIHw== 2024-05-04T02:19:24.875 INFO:teuthology.orchestra.run.smithi001.stdout:[osd.3] 2024-05-04T02:19:24.875 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQAZmzVm65B+NBAAsn71okYdDubo1eEIYNhGIQ== 2024-05-04T02:19:24.875 INFO:teuthology.orchestra.run.smithi001.stdout:[mgr.x] 2024-05-04T02:19:24.875 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQAOmzVmV5uQNhAA2npwXBp7+9S716+EHMIhVA== 2024-05-04T02:19:24.875 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.b] 2024-05-04T02:19:24.875 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQAPmzVmoAb4EhAAWKVsxHKvjP7BuTXlsWe5bQ== 2024-05-04T02:19:24.875 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.d] 2024-05-04T02:19:24.875 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQAPmzVmHnNGGhAACyVLrTJs5TX3OnZT28ux0A== 2024-05-04T02:19:24.875 INFO:teuthology.orchestra.run.smithi001.stdout:[mds.f] 2024-05-04T02:19:24.875 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQAPmzVm6h2XIRAAJZSEaktXSmQVQWtBwzJs4A== 2024-05-04T02:19:24.875 INFO:teuthology.orchestra.run.smithi001.stdout:[osd.4] 2024-05-04T02:19:24.875 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQAfmzVma2lDOxAAMD1MFeU95y3Ce+1tvVNibg== 2024-05-04T02:19:24.876 INFO:teuthology.orchestra.run.smithi001.stdout:[osd.5] 2024-05-04T02:19:24.876 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQAimzVmoUnMORAAXH4qdW8i5+uJJYynMUxFPA== 2024-05-04T02:19:24.876 INFO:teuthology.orchestra.run.smithi001.stdout:[osd.6] 2024-05-04T02:19:24.876 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQAlmzVmhDivNxAAT9tCQzhE2V9tGYrplIJCJA== 2024-05-04T02:19:24.876 INFO:teuthology.orchestra.run.smithi001.stdout:[osd.7] 2024-05-04T02:19:24.876 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQAomzVmoiqWNhAAKi/uYwyDCDeNoLh5aWgrJA== 2024-05-04T02:19:24.876 INFO:teuthology.orchestra.run.smithi001.stdout:[client.0] 2024-05-04T02:19:24.876 INFO:teuthology.orchestra.run.smithi001.stdout: key = AQAPmzVmsa09JhAATRPryciACpqSxjZnF8n5oA== 2024-05-04T02:19:24.876 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-04T02:19:24.916 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-04T02:19:24.979 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-04T02:19:24.981 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-04T02:19:25.044 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-04T02:19:25.046 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-04T02:19:25.108 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-04T02:19:25.110 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-04T02:19:25.172 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-04T02:19:25.174 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-04T02:19:25.232 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-04T02:19:25.235 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-04T02:19:25.293 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-04T02:19:25.295 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-04T02:19:25.354 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-04T02:19:25.356 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-04T02:19:25.415 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-04T02:19:25.417 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-04T02:19:25.475 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-04T02:19:25.477 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-04T02:19:25.539 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-04T02:19:25.541 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-04T02:19:25.602 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-04T02:19:25.605 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-04T02:19:25.666 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-04T02:19:25.668 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-04T02:19:25.727 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-04T02:19:25.729 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-04T02:19:25.788 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-04T02:19:25.790 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-04T02:19:25.849 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-04T02:19:25.851 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-04T02:19:25.909 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-04T02:19:25.912 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-04T02:19:25.973 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-05-04T02:19:25.973 DEBUG:teuthology.orchestra.run.smithi001:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-05-04T02:19:25.997 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-04T02:19:26.105 DEBUG:teuthology.orchestra.run.smithi001:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-05-04T02:19:26.129 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-05-04T02:19:26.153 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-04T02:19:26.257 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-05-04T02:19:26.280 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-05-04T02:19:26.344 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-04T02:19:26.449 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-05-04T02:19:26.472 DEBUG:teuthology.orchestra.run.smithi001:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-04T02:19:26.474 DEBUG:teuthology.orchestra.run.smithi107:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-04T02:19:26.529 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-05-04T02:19:26.529 DEBUG:tasks.ceph_manager:running mon.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.a.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-05-04T02:19:26.529 INFO:tasks.ceph.mon.a:Restarting daemon 2024-05-04T02:19:26.530 DEBUG:teuthology.orchestra.run.smithi001:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a 2024-05-04T02:19:26.532 INFO:tasks.ceph.mon.a:Started 2024-05-04T02:19:26.532 DEBUG:tasks.ceph_manager:running mon.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.b.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-05-04T02:19:26.532 INFO:tasks.ceph.mon.b:Restarting daemon 2024-05-04T02:19:26.532 DEBUG:teuthology.orchestra.run.smithi107:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b 2024-05-04T02:19:26.569 INFO:tasks.ceph.mon.b:Started 2024-05-04T02:19:26.569 DEBUG:tasks.ceph_manager:running mon.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.c.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-05-04T02:19:26.569 INFO:tasks.ceph.mon.c:Restarting daemon 2024-05-04T02:19:26.570 DEBUG:teuthology.orchestra.run.smithi107:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c 2024-05-04T02:19:26.571 INFO:tasks.ceph.mon.c:Started 2024-05-04T02:19:26.571 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-05-04T02:19:26.572 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-05-04T02:19:26.572 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i y 2024-05-04T02:19:26.574 INFO:tasks.ceph.mgr.y:Started 2024-05-04T02:19:26.574 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-05-04T02:19:26.574 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i x 2024-05-04T02:19:26.576 INFO:tasks.ceph.mgr.x:Started 2024-05-04T02:19:26.576 INFO:tasks.ceph:Setting crush tunables to default 2024-05-04T02:19:26.576 DEBUG:teuthology.orchestra.run.smithi001:> sudo ceph --cluster ceph osd crush tunables default 2024-05-04T02:19:26.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:26.706+0000 7fce87813640 1 Processor -- start 2024-05-04T02:19:26.708 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:26.706+0000 7fce87813640 1 -- start start 2024-05-04T02:19:26.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:26.708+0000 7fce87813640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce8015e560 0x7fce8015acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:19:26.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:26.708+0000 7fce87813640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fce80154220 0x7fce800708b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:19:26.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:26.708+0000 7fce87813640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce8006f600 con 0x7fce8006f0a0 2024-05-04T02:19:26.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:26.708+0000 7fce87813640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7fce8015d830 con 0x7fce80154220 2024-05-04T02:19:26.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:26.708+0000 7fce87813640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fce8006f8e0 con 0x7fce8015e560 2024-05-04T02:19:26.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:26.708+0000 7fce84dae640 1 -- >> v1:172.21.15.1:6789/0 conn(0x7fce8006f0a0 legacy=0x7fce800cc9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.1:6789/0 2024-05-04T02:19:26.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:26.708+0000 7fce85db0640 1 -- >> v2:172.21.15.1:3300/0 conn(0x7fce80154220 msgr2=0x7fce800708b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.1:3300/0 2024-05-04T02:19:26.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:26.708+0000 7fce85db0640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fce80154220 0x7fce800708b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-04T02:19:26.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:26.708+0000 7fce855af640 1 -- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce8015e560 msgr2=0x7fce8015acc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.107:3301/0 2024-05-04T02:19:26.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:26.708+0000 7fce855af640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce8015e560 0x7fce8015acc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-04T02:19:26.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:26.909+0000 7fce85db0640 1 -- >> v2:172.21.15.1:3300/0 conn(0x7fce80154220 msgr2=0x7fce800708b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.1:3300/0 2024-05-04T02:19:26.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:26.909+0000 7fce84dae640 1 -- >> v1:172.21.15.1:6789/0 conn(0x7fce8006f0a0 legacy=0x7fce800cc9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.1:6789/0 2024-05-04T02:19:26.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:26.909+0000 7fce85db0640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fce80154220 0x7fce800708b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-04T02:19:26.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:26.909+0000 7fce855af640 1 -- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce8015e560 msgr2=0x7fce8015acc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.107:3301/0 2024-05-04T02:19:26.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:26.909+0000 7fce855af640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce8015e560 0x7fce8015acc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-04T02:19:27.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:27.310+0000 7fce84dae640 1 -- >> v1:172.21.15.1:6789/0 conn(0x7fce8006f0a0 legacy=0x7fce800cc9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.1:6789/0 2024-05-04T02:19:27.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:27.310+0000 7fce85db0640 1 -- >> v2:172.21.15.1:3300/0 conn(0x7fce80154220 msgr2=0x7fce800708b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.1:3300/0 2024-05-04T02:19:27.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:27.310+0000 7fce85db0640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fce80154220 0x7fce800708b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-04T02:19:27.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:27.310+0000 7fce855af640 1 -- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce8015e560 msgr2=0x7fce8015acc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.107:3301/0 2024-05-04T02:19:27.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:27.310+0000 7fce855af640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce8015e560 0x7fce8015acc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-04T02:19:28.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:28.111+0000 7fce85db0640 1 -- >> v2:172.21.15.1:3300/0 conn(0x7fce80154220 msgr2=0x7fce800708b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.1:3300/0 2024-05-04T02:19:28.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:28.111+0000 7fce84dae640 1 -- >> v1:172.21.15.1:6789/0 conn(0x7fce8006f0a0 legacy=0x7fce800cc9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.1:6789/0 2024-05-04T02:19:28.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:28.111+0000 7fce85db0640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fce80154220 0x7fce800708b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-04T02:19:28.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:28.111+0000 7fce855af640 1 -- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce8015e560 msgr2=0x7fce8015acc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.107:3301/0 2024-05-04T02:19:28.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:28.111+0000 7fce855af640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce8015e560 0x7fce8015acc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-04T02:19:29.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:29.708+0000 7fce7effd640 1 -- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce8015e560 msgr2=0x7fce8015acc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-04T02:19:29.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:29.708+0000 7fce7effd640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce8015e560 0x7fce8015acc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:29.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:29.708+0000 7fce7effd640 1 -- >> v2:172.21.15.1:3300/0 conn(0x7fce80154220 msgr2=0x7fce800708b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-04T02:19:29.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:29.708+0000 7fce7effd640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fce80154220 0x7fce800708b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:29.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:29.708+0000 7fce7effd640 1 -- >> v1:172.21.15.1:6789/0 conn(0x7fce8006f0a0 legacy=0x7fce800cc9c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-04T02:19:29.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:29.708+0000 7fce7effd640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fce6c0036b0 0x7fce6c005b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:19:29.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:29.708+0000 7fce7effd640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce8015da80 con 0x7fce6c006260 2024-05-04T02:19:29.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:29.708+0000 7fce7effd640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fce8015d830 con 0x7fce6c0036b0 2024-05-04T02:19:29.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:29.708+0000 7fce855af640 1 -- >> v2:172.21.15.107:3300/0 conn(0x7fce6c0036b0 msgr2=0x7fce6c005b80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.107:3300/0 2024-05-04T02:19:29.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:29.708+0000 7fce84dae640 1 -- >> v1:172.21.15.107:6789/0 conn(0x7fce6c006260 legacy=0x7fce6c008770 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.107:6789/0 2024-05-04T02:19:29.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:29.708+0000 7fce855af640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fce6c0036b0 0x7fce6c005b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-04T02:19:29.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:29.909+0000 7fce855af640 1 -- >> v2:172.21.15.107:3300/0 conn(0x7fce6c0036b0 msgr2=0x7fce6c005b80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.107:3300/0 2024-05-04T02:19:29.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:29.909+0000 7fce84dae640 1 -- >> v1:172.21.15.107:6789/0 conn(0x7fce6c006260 legacy=0x7fce6c008770 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.107:6789/0 2024-05-04T02:19:29.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:29.909+0000 7fce855af640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fce6c0036b0 0x7fce6c005b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-04T02:19:30.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:30.309+0000 7fce84dae640 1 -- >> v1:172.21.15.107:6789/0 conn(0x7fce6c006260 legacy=0x7fce6c008770 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.107:6789/0 2024-05-04T02:19:30.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:30.309+0000 7fce855af640 1 -- >> v2:172.21.15.107:3300/0 conn(0x7fce6c0036b0 msgr2=0x7fce6c005b80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.107:3300/0 2024-05-04T02:19:30.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:30.309+0000 7fce855af640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fce6c0036b0 0x7fce6c005b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-04T02:19:31.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:31.110+0000 7fce855af640 1 -- >> v2:172.21.15.107:3300/0 conn(0x7fce6c0036b0 msgr2=0x7fce6c005b80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.107:3300/0 2024-05-04T02:19:31.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:31.110+0000 7fce84dae640 1 -- >> v1:172.21.15.107:6789/0 conn(0x7fce6c006260 legacy=0x7fce6c008770 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.107:6789/0 2024-05-04T02:19:31.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:31.110+0000 7fce855af640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fce6c0036b0 0x7fce6c005b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-04T02:19:32.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:32.707+0000 7fce7effd640 1 -- >> v2:172.21.15.107:3300/0 conn(0x7fce6c0036b0 msgr2=0x7fce6c005b80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-04T02:19:32.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:32.707+0000 7fce7effd640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fce6c0036b0 0x7fce6c005b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:32.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:32.707+0000 7fce7effd640 1 -- >> v1:172.21.15.107:6789/0 conn(0x7fce6c006260 legacy=0x7fce6c008770 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-04T02:19:32.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:32.707+0000 7fce85db0640 1 -- reap_dead start 2024-05-04T02:19:32.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:32.707+0000 7fce7effd640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce6c009ff0 0x7fce6c005b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:19:32.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:32.707+0000 7fce7effd640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fce6c00a400 0x7fce6c0086a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:19:32.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:32.707+0000 7fce7effd640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fce6c00a830 0x7fce6c008ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:19:32.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:32.707+0000 7fce7effd640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7fce8015d830 con 0x7fce6c00a400 2024-05-04T02:19:32.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:32.707+0000 7fce7effd640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fce8006f8e0 con 0x7fce6c00a830 2024-05-04T02:19:32.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:32.707+0000 7fce7effd640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fce6c00ae90 con 0x7fce6c009ff0 2024-05-04T02:19:32.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:32.707+0000 7fce84dae640 1 -- >> v2:172.21.15.1:3300/0 conn(0x7fce6c00a400 msgr2=0x7fce6c0086a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.1:3300/0 2024-05-04T02:19:32.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:32.707+0000 7fce84dae640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fce6c00a400 0x7fce6c0086a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-04T02:19:32.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:32.707+0000 7fce855af640 1 -- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce6c009ff0 msgr2=0x7fce6c005b80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.107:3301/0 2024-05-04T02:19:32.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:32.707+0000 7fce85db0640 1 -- >> v2:172.21.15.107:3300/0 conn(0x7fce6c00a830 msgr2=0x7fce6c008ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.107:3300/0 2024-05-04T02:19:32.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:32.707+0000 7fce855af640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce6c009ff0 0x7fce6c005b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-04T02:19:32.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:32.707+0000 7fce85db0640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fce6c00a830 0x7fce6c008ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-04T02:19:32.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:32.908+0000 7fce84dae640 1 -- >> v2:172.21.15.1:3300/0 conn(0x7fce6c00a400 msgr2=0x7fce6c0086a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.1:3300/0 2024-05-04T02:19:32.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:32.908+0000 7fce84dae640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fce6c00a400 0x7fce6c0086a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-04T02:19:32.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:32.908+0000 7fce855af640 1 -- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce6c009ff0 msgr2=0x7fce6c005b80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.107:3301/0 2024-05-04T02:19:32.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:32.908+0000 7fce85db0640 1 -- >> v2:172.21.15.107:3300/0 conn(0x7fce6c00a830 msgr2=0x7fce6c008ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.107:3300/0 2024-05-04T02:19:32.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:32.908+0000 7fce855af640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce6c009ff0 0x7fce6c005b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-04T02:19:32.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:32.908+0000 7fce85db0640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fce6c00a830 0x7fce6c008ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-04T02:19:33.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:33.309+0000 7fce84dae640 1 -- >> v2:172.21.15.1:3300/0 conn(0x7fce6c00a400 msgr2=0x7fce6c0086a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.1:3300/0 2024-05-04T02:19:33.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:33.309+0000 7fce84dae640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fce6c00a400 0x7fce6c0086a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-04T02:19:33.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:33.309+0000 7fce855af640 1 -- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce6c009ff0 msgr2=0x7fce6c005b80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.107:3301/0 2024-05-04T02:19:33.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:33.309+0000 7fce85db0640 1 -- >> v2:172.21.15.107:3300/0 conn(0x7fce6c00a830 msgr2=0x7fce6c008ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.107:3300/0 2024-05-04T02:19:33.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:33.309+0000 7fce855af640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce6c009ff0 0x7fce6c005b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-04T02:19:33.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:33.309+0000 7fce85db0640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fce6c00a830 0x7fce6c008ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-04T02:19:34.042 INFO:tasks.ceph.mon.b.smithi107.stderr:==00:00:00:07.370 34877== Warning: unimplemented fcntl command: 1036 2024-05-04T02:19:34.043 INFO:tasks.ceph.mon.c.smithi107.stderr:==00:00:00:07.371 34878== Warning: unimplemented fcntl command: 1036 2024-05-04T02:19:34.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:34.110+0000 7fce84dae640 1 -- >> v2:172.21.15.1:3300/0 conn(0x7fce6c00a400 msgr2=0x7fce6c0086a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.1:3300/0 2024-05-04T02:19:34.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:34.110+0000 7fce84dae640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fce6c00a400 0x7fce6c0086a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-04T02:19:34.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:34.110+0000 7fce85db0640 1 -- >> v2:172.21.15.107:3300/0 conn(0x7fce6c00a830 msgr2=0x7fce6c008ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.107:3300/0 2024-05-04T02:19:34.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:34.110+0000 7fce855af640 1 -- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce6c009ff0 msgr2=0x7fce6c005b80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.107:3301/0 2024-05-04T02:19:34.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:34.110+0000 7fce85db0640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fce6c00a830 0x7fce6c008ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-04T02:19:34.113 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:34.110+0000 7fce855af640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce6c009ff0 0x7fce6c005b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-04T02:19:34.321 INFO:tasks.ceph.mon.a.smithi001.stderr:==00:00:00:07.678 35030== Warning: unimplemented fcntl command: 1036 2024-05-04T02:19:34.385 INFO:tasks.ceph.mon.b.smithi107.stderr:==00:00:00:07.712 34877== Warning: unimplemented fcntl command: 1036 2024-05-04T02:19:34.385 INFO:tasks.ceph.mon.c.smithi107.stderr:==00:00:00:07.712 34878== Warning: unimplemented fcntl command: 1036 2024-05-04T02:19:34.671 INFO:tasks.ceph.mon.a.smithi001.stderr:==00:00:00:08.027 35030== Warning: unimplemented fcntl command: 1036 2024-05-04T02:19:35.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:35.707+0000 7fce7effd640 1 -- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce6c009ff0 msgr2=0x7fce6c005b80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-04T02:19:35.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:35.707+0000 7fce7effd640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce6c009ff0 0x7fce6c005b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:35.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:35.707+0000 7fce7effd640 1 -- >> v2:172.21.15.107:3300/0 conn(0x7fce6c00a830 msgr2=0x7fce6c008ea0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-04T02:19:35.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:35.707+0000 7fce7effd640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fce6c00a830 0x7fce6c008ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:35.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:35.707+0000 7fce7effd640 1 -- >> v2:172.21.15.1:3300/0 conn(0x7fce6c00a400 msgr2=0x7fce6c0086a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-04T02:19:35.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:35.707+0000 7fce7effd640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fce6c00a400 0x7fce6c0086a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:35.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:35.707+0000 7fce7effd640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce8006f600 con 0x7fce6c009580 2024-05-04T02:19:35.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:35.707+0000 7fce855af640 1 -- >> v1:172.21.15.1:6789/0 conn(0x7fce6c009580 legacy=0x7fce6c00f250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.1:6789/0 2024-05-04T02:19:35.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:35.707+0000 7fce7effd640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce8015da80 con 0x7fce6c009a20 2024-05-04T02:19:35.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:35.707+0000 7fce84dae640 1 -- >> v1:172.21.15.107:6789/0 conn(0x7fce6c009a20 legacy=0x7fce6c012980 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.107:6789/0 2024-05-04T02:19:35.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:35.908+0000 7fce855af640 1 -- >> v1:172.21.15.1:6789/0 conn(0x7fce6c009580 legacy=0x7fce6c00f250 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.1:6789/0 2024-05-04T02:19:36.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:36.150+0000 7fce84dae640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fce6c009a20 0x7fce6c012980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.1:42878/0 (socket says 172.21.15.1:42878) 2024-05-04T02:19:36.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:36.150+0000 7fce84dae640 1 -- 172.21.15.1:0/3761097339 learned_addr learned my addr 172.21.15.1:0/3761097339 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-05-04T02:19:36.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:36.321+0000 7fce84dae640 1 -- 172.21.15.1:0/3761097339 >> v1:172.21.15.107:6789/0 conn(0x7fce6c009a20 legacy=0x7fce6c012980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-05-04T02:19:36.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:36.321+0000 7fce84dae640 1 -- 172.21.15.1:0/3761097339 >> v1:172.21.15.107:6789/0 conn(0x7fce6c009a20 legacy=0x7fce6c012980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-04T02:19:36.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:36.321+0000 7fce84dae640 1 --1- 172.21.15.1:0/3761097339 >> v1:172.21.15.107:6789/0 conn(0x7fce6c009a20 0x7fce6c012980 :-1 s=OPENED pgs=1 cs=1 l=1).handle_message read tag failed 2024-05-04T02:19:36.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:36.321+0000 7fce84dae640 1 --1- 172.21.15.1:0/3761097339 >> v1:172.21.15.107:6789/0 conn(0x7fce6c009a20 0x7fce6c012980 :-1 s=OPENED pgs=1 cs=1 l=1).fault on lossy channel, failing 2024-05-04T02:19:36.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:36.644+0000 7fce855af640 1 -- 172.21.15.1:0/3761097339 >> v1:172.21.15.1:6789/0 conn(0x7fce6c009580 legacy=0x7fce6c00f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-04T02:19:36.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:36.644+0000 7fce855af640 1 -- 172.21.15.1:0/3761097339 >> v1:172.21.15.1:6789/0 conn(0x7fce6c009580 legacy=0x7fce6c00f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-04T02:19:36.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:36.644+0000 7fce855af640 1 --1- 172.21.15.1:0/3761097339 >> v1:172.21.15.1:6789/0 conn(0x7fce6c009580 0x7fce6c00f250 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=0).handle_connect_reply_1 read connect reply failed 2024-05-04T02:19:38.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:38.707+0000 7fce7effd640 1 -- 172.21.15.1:0/3761097339 >> v1:172.21.15.107:6789/0 conn(0x7fce6c009a20 legacy=0x7fce6c012980 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-04T02:19:38.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:38.707+0000 7fce7effd640 1 -- 172.21.15.1:0/3761097339 >> v1:172.21.15.1:6789/0 conn(0x7fce6c009580 legacy=0x7fce6c00f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:19:38.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:38.707+0000 7fce85db0640 1 -- 172.21.15.1:0/3761097339 reap_dead start 2024-05-04T02:19:38.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:38.707+0000 7fce7effd640 1 --2- 172.21.15.1:0/3761097339 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce6c009580 0x7fce6c0086a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:19:38.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:38.708+0000 7fce7effd640 1 --2- 172.21.15.1:0/3761097339 >> v2:172.21.15.1:3300/0 conn(0x7fce6c008d90 0x7fce6c005ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:19:38.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:38.708+0000 7fce7effd640 1 -- 172.21.15.1:0/3761097339 --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce6c016230 con 0x7fce6c009a20 2024-05-04T02:19:38.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:38.708+0000 7fce7effd640 1 -- 172.21.15.1:0/3761097339 --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7fce8015d830 con 0x7fce6c008d90 2024-05-04T02:19:38.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:38.708+0000 7fce7effd640 1 -- 172.21.15.1:0/3761097339 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fce8006f8e0 con 0x7fce6c009580 2024-05-04T02:19:38.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:38.708+0000 7fce84dae640 1 --2- 172.21.15.1:0/3761097339 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce6c009580 0x7fce6c0086a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:19:38.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:38.710+0000 7fce84dae640 1 -- 172.21.15.1:0/3761097339 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce6c009580 msgr2=0x7fce6c0086a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-04T02:19:38.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:38.710+0000 7fce84dae640 1 -- 172.21.15.1:0/3761097339 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce6c009580 msgr2=0x7fce6c0086a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-04T02:19:38.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:38.710+0000 7fce84dae640 1 --2- 172.21.15.1:0/3761097339 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce6c009580 0x7fce6c0086a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-04T02:19:38.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:38.710+0000 7fce84dae640 1 --2- 172.21.15.1:0/3761097339 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce6c009580 0x7fce6c0086a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-04T02:19:38.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:38.911+0000 7fce84dae640 1 --2- 172.21.15.1:0/3761097339 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce6c009580 0x7fce6c0086a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:19:38.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:38.912+0000 7fce84dae640 1 -- 172.21.15.1:0/3761097339 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce6c009580 msgr2=0x7fce6c0086a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-04T02:19:38.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:38.912+0000 7fce84dae640 1 -- 172.21.15.1:0/3761097339 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce6c009580 msgr2=0x7fce6c0086a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-04T02:19:38.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:38.912+0000 7fce84dae640 1 --2- 172.21.15.1:0/3761097339 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce6c009580 0x7fce6c0086a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-04T02:19:38.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:38.912+0000 7fce84dae640 1 --2- 172.21.15.1:0/3761097339 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce6c009580 0x7fce6c0086a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-04T02:19:39.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:39.147+0000 7fce85db0640 1 --2- 172.21.15.1:0/3761097339 >> v2:172.21.15.1:3300/0 conn(0x7fce6c008d90 0x7fce6c005ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:19:39.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:39.164+0000 7fce85db0640 1 -- 172.21.15.1:0/3761097339 >> v2:172.21.15.1:3300/0 conn(0x7fce6c008d90 msgr2=0x7fce6c005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-04T02:19:39.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:39.164+0000 7fce85db0640 1 -- 172.21.15.1:0/3761097339 >> v2:172.21.15.1:3300/0 conn(0x7fce6c008d90 msgr2=0x7fce6c005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-04T02:19:39.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:39.164+0000 7fce85db0640 1 --2- 172.21.15.1:0/3761097339 >> v2:172.21.15.1:3300/0 conn(0x7fce6c008d90 0x7fce6c005ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-04T02:19:39.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:39.164+0000 7fce85db0640 1 --2- 172.21.15.1:0/3761097339 >> v2:172.21.15.1:3300/0 conn(0x7fce6c008d90 0x7fce6c005ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-04T02:19:39.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:39.324+0000 7fce84dae640 1 --2- 172.21.15.1:0/3761097339 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce6c009580 0x7fce6c0086a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:19:39.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:39.337+0000 7fce84dae640 1 -- 172.21.15.1:0/3761097339 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce6c009580 msgr2=0x7fce6c0086a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-04T02:19:39.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:39.337+0000 7fce84dae640 1 -- 172.21.15.1:0/3761097339 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce6c009580 msgr2=0x7fce6c0086a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-04T02:19:39.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:39.337+0000 7fce84dae640 1 --2- 172.21.15.1:0/3761097339 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce6c009580 0x7fce6c0086a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-04T02:19:39.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:39.337+0000 7fce84dae640 1 --2- 172.21.15.1:0/3761097339 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce6c009580 0x7fce6c0086a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-04T02:19:39.373 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:39.370+0000 7fce85db0640 1 --2- 172.21.15.1:0/3761097339 >> v2:172.21.15.1:3300/0 conn(0x7fce6c008d90 0x7fce6c005ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:19:39.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:39.375+0000 7fce85db0640 1 -- 172.21.15.1:0/3761097339 >> v2:172.21.15.1:3300/0 conn(0x7fce6c008d90 msgr2=0x7fce6c005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-04T02:19:39.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:39.375+0000 7fce85db0640 1 -- 172.21.15.1:0/3761097339 >> v2:172.21.15.1:3300/0 conn(0x7fce6c008d90 msgr2=0x7fce6c005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-04T02:19:39.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:39.375+0000 7fce85db0640 1 --2- 172.21.15.1:0/3761097339 >> v2:172.21.15.1:3300/0 conn(0x7fce6c008d90 0x7fce6c005ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-04T02:19:39.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:39.375+0000 7fce85db0640 1 --2- 172.21.15.1:0/3761097339 >> v2:172.21.15.1:3300/0 conn(0x7fce6c008d90 0x7fce6c005ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-04T02:19:39.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:39.776+0000 7fce85db0640 1 --2- 172.21.15.1:0/3761097339 >> v2:172.21.15.1:3300/0 conn(0x7fce6c008d90 0x7fce6c005ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:19:39.780 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:39.777+0000 7fce85db0640 1 -- 172.21.15.1:0/3761097339 >> v2:172.21.15.1:3300/0 conn(0x7fce6c008d90 msgr2=0x7fce6c005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-04T02:19:39.780 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:39.777+0000 7fce85db0640 1 -- 172.21.15.1:0/3761097339 >> v2:172.21.15.1:3300/0 conn(0x7fce6c008d90 msgr2=0x7fce6c005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-04T02:19:39.780 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:39.777+0000 7fce85db0640 1 --2- 172.21.15.1:0/3761097339 >> v2:172.21.15.1:3300/0 conn(0x7fce6c008d90 0x7fce6c005ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-04T02:19:39.780 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:39.777+0000 7fce85db0640 1 --2- 172.21.15.1:0/3761097339 >> v2:172.21.15.1:3300/0 conn(0x7fce6c008d90 0x7fce6c005ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-04T02:19:40.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:40.139+0000 7fce84dae640 1 --2- 172.21.15.1:0/3761097339 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce6c009580 0x7fce6c0086a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:19:40.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:40.141+0000 7fce84dae640 1 -- 172.21.15.1:0/3761097339 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce6c009580 msgr2=0x7fce6c0086a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-04T02:19:40.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:40.141+0000 7fce84dae640 1 -- 172.21.15.1:0/3761097339 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce6c009580 msgr2=0x7fce6c0086a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-04T02:19:40.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:40.141+0000 7fce84dae640 1 --2- 172.21.15.1:0/3761097339 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce6c009580 0x7fce6c0086a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-04T02:19:40.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:40.141+0000 7fce84dae640 1 --2- 172.21.15.1:0/3761097339 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce6c009580 0x7fce6c0086a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-04T02:19:40.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:40.579+0000 7fce85db0640 1 --2- 172.21.15.1:0/3761097339 >> v2:172.21.15.1:3300/0 conn(0x7fce6c008d90 0x7fce6c005ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:19:40.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:40.580+0000 7fce85db0640 1 -- 172.21.15.1:0/3761097339 >> v2:172.21.15.1:3300/0 conn(0x7fce6c008d90 msgr2=0x7fce6c005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-04T02:19:40.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:40.580+0000 7fce85db0640 1 -- 172.21.15.1:0/3761097339 >> v2:172.21.15.1:3300/0 conn(0x7fce6c008d90 msgr2=0x7fce6c005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-04T02:19:40.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:40.580+0000 7fce85db0640 1 --2- 172.21.15.1:0/3761097339 >> v2:172.21.15.1:3300/0 conn(0x7fce6c008d90 0x7fce6c005ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-04T02:19:40.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:40.580+0000 7fce85db0640 1 --2- 172.21.15.1:0/3761097339 >> v2:172.21.15.1:3300/0 conn(0x7fce6c008d90 0x7fce6c005ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-04T02:19:41.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:41.709+0000 7fce7effd640 1 -- 172.21.15.1:0/3761097339 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce6c009580 msgr2=0x7fce6c0086a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-04T02:19:41.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:41.709+0000 7fce7effd640 1 --2- 172.21.15.1:0/3761097339 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce6c009580 0x7fce6c0086a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:41.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:41.709+0000 7fce7effd640 1 -- 172.21.15.1:0/3761097339 >> v2:172.21.15.1:3300/0 conn(0x7fce6c008d90 msgr2=0x7fce6c005ad0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-04T02:19:41.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:41.709+0000 7fce7effd640 1 --2- 172.21.15.1:0/3761097339 >> v2:172.21.15.1:3300/0 conn(0x7fce6c008d90 0x7fce6c005ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:41.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:41.709+0000 7fce7effd640 1 -- 172.21.15.1:0/3761097339 >> v1:172.21.15.107:6789/0 conn(0x7fce6c009a20 legacy=0x7fce6c013150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:19:41.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:41.709+0000 7fce7effd640 1 --2- 172.21.15.1:0/3761097339 >> v2:172.21.15.107:3300/0 conn(0x7fce6c013900 0x7fce6c011980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:19:41.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:41.709+0000 7fce7effd640 1 -- 172.21.15.1:0/3761097339 --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce6c012990 con 0x7fce6c013d10 2024-05-04T02:19:41.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:41.709+0000 7fce7effd640 1 -- 172.21.15.1:0/3761097339 --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fce8015d830 con 0x7fce6c013900 2024-05-04T02:19:41.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:41.710+0000 7fce855af640 1 --2- 172.21.15.1:0/3761097339 >> v2:172.21.15.107:3300/0 conn(0x7fce6c013900 0x7fce6c011980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:19:41.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:41.713+0000 7fce855af640 1 -- 172.21.15.1:0/3761097339 >> v2:172.21.15.107:3300/0 conn(0x7fce6c013900 msgr2=0x7fce6c011980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-04T02:19:41.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:41.713+0000 7fce855af640 1 -- 172.21.15.1:0/3761097339 >> v2:172.21.15.107:3300/0 conn(0x7fce6c013900 msgr2=0x7fce6c011980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-04T02:19:41.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:41.713+0000 7fce855af640 1 --2- 172.21.15.1:0/3761097339 >> v2:172.21.15.107:3300/0 conn(0x7fce6c013900 0x7fce6c011980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-04T02:19:41.716 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:41.713+0000 7fce855af640 1 --2- 172.21.15.1:0/3761097339 >> v2:172.21.15.107:3300/0 conn(0x7fce6c013900 0x7fce6c011980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-04T02:19:41.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:41.916+0000 7fce855af640 1 --2- 172.21.15.1:0/3761097339 >> v2:172.21.15.107:3300/0 conn(0x7fce6c013900 0x7fce6c011980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:19:41.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:41.917+0000 7fce855af640 1 -- 172.21.15.1:0/3761097339 >> v2:172.21.15.107:3300/0 conn(0x7fce6c013900 msgr2=0x7fce6c011980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-04T02:19:41.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:41.917+0000 7fce855af640 1 -- 172.21.15.1:0/3761097339 >> v2:172.21.15.107:3300/0 conn(0x7fce6c013900 msgr2=0x7fce6c011980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-04T02:19:41.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:41.917+0000 7fce855af640 1 --2- 172.21.15.1:0/3761097339 >> v2:172.21.15.107:3300/0 conn(0x7fce6c013900 0x7fce6c011980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-04T02:19:41.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:41.917+0000 7fce855af640 1 --2- 172.21.15.1:0/3761097339 >> v2:172.21.15.107:3300/0 conn(0x7fce6c013900 0x7fce6c011980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-04T02:19:42.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:42.319+0000 7fce855af640 1 --2- 172.21.15.1:0/3761097339 >> v2:172.21.15.107:3300/0 conn(0x7fce6c013900 0x7fce6c011980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:19:42.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:42.322+0000 7fce855af640 1 -- 172.21.15.1:0/3761097339 >> v2:172.21.15.107:3300/0 conn(0x7fce6c013900 msgr2=0x7fce6c011980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-04T02:19:42.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:42.322+0000 7fce855af640 1 -- 172.21.15.1:0/3761097339 >> v2:172.21.15.107:3300/0 conn(0x7fce6c013900 msgr2=0x7fce6c011980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-04T02:19:42.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:42.322+0000 7fce855af640 1 --2- 172.21.15.1:0/3761097339 >> v2:172.21.15.107:3300/0 conn(0x7fce6c013900 0x7fce6c011980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-04T02:19:42.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:42.323+0000 7fce855af640 1 --2- 172.21.15.1:0/3761097339 >> v2:172.21.15.107:3300/0 conn(0x7fce6c013900 0x7fce6c011980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-04T02:19:43.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:43.125+0000 7fce855af640 1 --2- 172.21.15.1:0/3761097339 >> v2:172.21.15.107:3300/0 conn(0x7fce6c013900 0x7fce6c011980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:19:43.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:43.126+0000 7fce855af640 1 -- 172.21.15.1:0/3761097339 >> v2:172.21.15.107:3300/0 conn(0x7fce6c013900 msgr2=0x7fce6c011980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-04T02:19:43.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:43.126+0000 7fce855af640 1 -- 172.21.15.1:0/3761097339 >> v2:172.21.15.107:3300/0 conn(0x7fce6c013900 msgr2=0x7fce6c011980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-04T02:19:43.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:43.126+0000 7fce855af640 1 --2- 172.21.15.1:0/3761097339 >> v2:172.21.15.107:3300/0 conn(0x7fce6c013900 0x7fce6c011980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-04T02:19:43.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:43.126+0000 7fce855af640 1 --2- 172.21.15.1:0/3761097339 >> v2:172.21.15.107:3300/0 conn(0x7fce6c013900 0x7fce6c011980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-04T02:19:44.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:44.709+0000 7fce7effd640 1 -- 172.21.15.1:0/3761097339 >> v2:172.21.15.107:3300/0 conn(0x7fce6c013900 msgr2=0x7fce6c011980 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-04T02:19:44.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:44.709+0000 7fce7effd640 1 --2- 172.21.15.1:0/3761097339 >> v2:172.21.15.107:3300/0 conn(0x7fce6c013900 0x7fce6c011980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:44.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:44.709+0000 7fce7effd640 1 -- 172.21.15.1:0/3761097339 >> v1:172.21.15.1:6789/0 conn(0x7fce6c013d10 legacy=0x7fce6c011ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:19:44.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:44.709+0000 7fce85db0640 1 -- 172.21.15.1:0/3761097339 reap_dead start 2024-05-04T02:19:44.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:44.709+0000 7fce7effd640 1 --2- 172.21.15.1:0/3761097339 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce6c008d60 0x7fce6c008680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:19:44.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:44.709+0000 7fce7effd640 1 -- 172.21.15.1:0/3761097339 --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce6c0125d0 con 0x7fce6c013900 2024-05-04T02:19:44.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:44.709+0000 7fce7effd640 1 -- 172.21.15.1:0/3761097339 --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce6c009a20 con 0x7fce6c009580 2024-05-04T02:19:44.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:44.709+0000 7fce7effd640 1 -- 172.21.15.1:0/3761097339 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fce8015d830 con 0x7fce6c008d60 2024-05-04T02:19:44.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:44.710+0000 7fce85db0640 1 --2- 172.21.15.1:0/3761097339 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce6c008d60 0x7fce6c008680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:19:44.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:44.711+0000 7fce85db0640 1 -- 172.21.15.1:0/3761097339 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce6c008d60 msgr2=0x7fce6c008680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-04T02:19:44.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:44.711+0000 7fce85db0640 1 -- 172.21.15.1:0/3761097339 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce6c008d60 msgr2=0x7fce6c008680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-04T02:19:44.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:44.711+0000 7fce85db0640 1 --2- 172.21.15.1:0/3761097339 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce6c008d60 0x7fce6c008680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-04T02:19:44.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:44.711+0000 7fce85db0640 1 --2- 172.21.15.1:0/3761097339 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce6c008d60 0x7fce6c008680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-04T02:19:45.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:45.069+0000 7fce85db0640 1 --2- 172.21.15.1:0/3761097339 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce6c008d60 0x7fce6c008680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:19:45.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:45.122+0000 7fce85db0640 1 -- 172.21.15.1:0/3761097339 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce6c008d60 msgr2=0x7fce6c008680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-04T02:19:45.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:45.122+0000 7fce85db0640 1 -- 172.21.15.1:0/3761097339 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce6c008d60 msgr2=0x7fce6c008680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-04T02:19:45.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:45.122+0000 7fce85db0640 1 --2- 172.21.15.1:0/3761097339 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce6c008d60 0x7fce6c008680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-04T02:19:45.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:45.122+0000 7fce85db0640 1 --2- 172.21.15.1:0/3761097339 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce6c008d60 0x7fce6c008680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-04T02:19:45.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:45.523+0000 7fce85db0640 1 --2- 172.21.15.1:0/3761097339 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce6c008d60 0x7fce6c008680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:19:45.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:45.524+0000 7fce85db0640 1 -- 172.21.15.1:0/3761097339 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce6c008d60 msgr2=0x7fce6c008680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-04T02:19:45.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:45.524+0000 7fce85db0640 1 -- 172.21.15.1:0/3761097339 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce6c008d60 msgr2=0x7fce6c008680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-04T02:19:45.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:45.524+0000 7fce85db0640 1 --2- 172.21.15.1:0/3761097339 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce6c008d60 0x7fce6c008680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-04T02:19:45.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:45.525+0000 7fce85db0640 1 --2- 172.21.15.1:0/3761097339 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce6c008d60 0x7fce6c008680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-04T02:19:45.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:45.538+0000 7fce7ffff640 1 -- 172.21.15.1:0/3761097339 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2175488363 0 0) 0x7fce6c0125d0 con 0x7fce6c013900 2024-05-04T02:19:45.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:45.538+0000 7fce7ffff640 1 -- 172.21.15.1:0/3761097339 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce68003520 con 0x7fce6c013900 2024-05-04T02:19:45.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:45.592+0000 7fce7ffff640 1 -- 172.21.15.1:0/3761097339 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 536315001 0 0) 0x7fce6c009a20 con 0x7fce6c009580 2024-05-04T02:19:45.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:45.592+0000 7fce7ffff640 1 -- 172.21.15.1:0/3761097339 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce6c0125d0 con 0x7fce6c009580 2024-05-04T02:19:45.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:45.599+0000 7fce7ffff640 1 -- 172.21.15.1:0/3761097339 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2000912119 0 0) 0x7fce68003520 con 0x7fce6c013900 2024-05-04T02:19:45.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:45.599+0000 7fce7ffff640 1 -- 172.21.15.1:0/3761097339 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce6c008d60 msgr2=0x7fce6c008680 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-04T02:19:45.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:45.599+0000 7fce7ffff640 1 --2- 172.21.15.1:0/3761097339 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce6c008d60 0x7fce6c008680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:45.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:45.599+0000 7fce7ffff640 1 -- 172.21.15.1:0/3761097339 >> v1:172.21.15.107:6789/0 conn(0x7fce6c009580 legacy=0x7fce6c013150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:19:45.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:45.599+0000 7fce7ffff640 1 -- 172.21.15.1:0/3761097339 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce6c009bf0 con 0x7fce6c013900 2024-05-04T02:19:45.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:45.599+0000 7fce7ffff640 1 -- 172.21.15.1:0/3761097339 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1418761865 0 0) 0x7fce740045a0 con 0x7fce6c013900 2024-05-04T02:19:45.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:45.599+0000 7fce7ffff640 1 -- 172.21.15.1:0/3761097339 >> v1:172.21.15.1:6789/0 conn(0x7fce6c013900 legacy=0x7fce6c011270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:19:45.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:45.599+0000 7fce7ffff640 1 --2- 172.21.15.1:0/3761097339 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fce68003b70 0x7fce68003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:19:45.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:45.599+0000 7fce7ffff640 1 --2- 172.21.15.1:0/3761097339 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fce68004800 0x7fce68004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:19:45.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:45.599+0000 7fce7ffff640 1 --2- 172.21.15.1:0/3761097339 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce6c008d60 0x7fce6800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:19:45.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:45.599+0000 7fce7ffff640 1 -- 172.21.15.1:0/3761097339 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fce8015d830 con 0x7fce68004800 2024-05-04T02:19:45.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:45.599+0000 7fce7ffff640 1 -- 172.21.15.1:0/3761097339 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fce68005570 con 0x7fce68003b70 2024-05-04T02:19:45.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:45.599+0000 7fce7ffff640 1 -- 172.21.15.1:0/3761097339 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fce6800bf00 con 0x7fce6c008d60 2024-05-04T02:19:45.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:45.600+0000 7fce85db0640 1 --2- 172.21.15.1:0/3761097339 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce6c008d60 0x7fce6800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:19:45.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:45.618+0000 7fce84dae640 1 --2- 172.21.15.1:0/3761097339 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fce68004800 0x7fce68004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:19:45.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:45.649+0000 7fce855af640 1 --2- 172.21.15.1:0/3761097339 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fce68003b70 0x7fce68003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:19:45.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:45.661+0000 7fce85db0640 1 -- 172.21.15.1:0/3761097339 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fce68003b70 msgr2=0x7fce68003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:19:45.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:45.661+0000 7fce85db0640 1 --2- 172.21.15.1:0/3761097339 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fce68003b70 0x7fce68003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:45.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:45.661+0000 7fce85db0640 1 -- 172.21.15.1:0/3761097339 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fce68004800 msgr2=0x7fce68004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:19:45.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:45.661+0000 7fce85db0640 1 --2- 172.21.15.1:0/3761097339 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fce68004800 0x7fce68004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:45.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:45.661+0000 7fce85db0640 1 -- 172.21.15.1:0/3761097339 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce68003520 con 0x7fce6c008d60 2024-05-04T02:19:45.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:45.667+0000 7fce85db0640 1 --2- 172.21.15.1:0/3761097339 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce6c008d60 0x7fce6800b9c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fce800cef90 tx=0x7fce68005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8636dc26debb02c server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:19:45.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:45.719+0000 7fce7ffff640 1 -- 172.21.15.1:0/3761097339 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce70031070 con 0x7fce6c008d60 2024-05-04T02:19:45.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:45.719+0000 7fce7ffff640 1 -- 172.21.15.1:0/3761097339 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce7002bd90 con 0x7fce6c008d60 2024-05-04T02:19:45.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:45.719+0000 7fce7ffff640 1 -- 172.21.15.1:0/3761097339 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce70009a00 con 0x7fce6c008d60 2024-05-04T02:19:45.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:45.720+0000 7fce87813640 1 -- 172.21.15.1:0/3761097339 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce6c008d60 msgr2=0x7fce6800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:19:45.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:45.720+0000 7fce87813640 1 --2- 172.21.15.1:0/3761097339 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce6c008d60 0x7fce6800b9c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fce800cef90 tx=0x7fce68005830 comp rx=0 tx=0).stop 2024-05-04T02:19:45.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:45.720+0000 7fce85db0640 1 -- 172.21.15.1:0/3761097339 reap_dead start 2024-05-04T02:19:45.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:45.720+0000 7fce87813640 1 -- 172.21.15.1:0/3761097339 shutdown_connections 2024-05-04T02:19:45.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:45.720+0000 7fce87813640 1 -- 172.21.15.1:0/3761097339 >> 172.21.15.1:0/3761097339 conn(0x7fce800cb8e0 msgr2=0x7fce800ce5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:19:45.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:45.720+0000 7fce87813640 1 -- 172.21.15.1:0/3761097339 shutdown_connections 2024-05-04T02:19:45.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:45.720+0000 7fce87813640 1 -- 172.21.15.1:0/3761097339 wait complete. 2024-05-04T02:19:45.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:45.722+0000 7fce87813640 1 Processor -- start 2024-05-04T02:19:45.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:45.722+0000 7fce87813640 1 -- start start 2024-05-04T02:19:45.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:45.723+0000 7fce87813640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce8015aad0 0x7fce801f38d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:19:45.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:45.723+0000 7fce87813640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fce80155eb0 0x7fce80159c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:19:45.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:45.723+0000 7fce87813640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fce8015a140 0x7fce8014df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:19:45.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:45.723+0000 7fce87813640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fce80154630 con 0x7fce8015a140 2024-05-04T02:19:45.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:45.723+0000 7fce87813640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fce8015e040 con 0x7fce80155eb0 2024-05-04T02:19:45.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:45.723+0000 7fce87813640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fce800cc3b0 con 0x7fce8015aad0 2024-05-04T02:19:45.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:45.729+0000 7fce84dae640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fce80155eb0 0x7fce80159c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:19:45.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:45.729+0000 7fce84dae640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fce80155eb0 0x7fce80159c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.1:43138/0 (socket says 172.21.15.1:43138) 2024-05-04T02:19:45.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:45.729+0000 7fce84dae640 1 -- 172.21.15.1:0/280818856 learned_addr learned my addr 172.21.15.1:0/280818856 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:19:45.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:45.745+0000 7fce84dae640 1 -- 172.21.15.1:0/280818856 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce8015aad0 msgr2=0x7fce801f38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:19:45.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:45.745+0000 7fce84dae640 1 --2- 172.21.15.1:0/280818856 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce8015aad0 0x7fce801f38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:45.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:45.745+0000 7fce84dae640 1 -- 172.21.15.1:0/280818856 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fce8015a140 msgr2=0x7fce8014df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:19:45.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:45.745+0000 7fce84dae640 1 --2- 172.21.15.1:0/280818856 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fce8015a140 0x7fce8014df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:45.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:45.745+0000 7fce84dae640 1 -- 172.21.15.1:0/280818856 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce801508b0 con 0x7fce80155eb0 2024-05-04T02:19:45.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:45.753+0000 7fce84dae640 1 --2- 172.21.15.1:0/280818856 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fce80155eb0 0x7fce80159c00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fce6c00ae60 tx=0x7fce74007430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:19:45.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:45.765+0000 7fce7dffb640 1 -- 172.21.15.1:0/280818856 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce74017640 con 0x7fce80155eb0 2024-05-04T02:19:45.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:45.765+0000 7fce7dffb640 1 -- 172.21.15.1:0/280818856 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce740177e0 con 0x7fce80155eb0 2024-05-04T02:19:45.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:45.765+0000 7fce7dffb640 1 -- 172.21.15.1:0/280818856 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce74017bd0 con 0x7fce80155eb0 2024-05-04T02:19:45.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:45.765+0000 7fce87813640 1 -- 172.21.15.1:0/280818856 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce80158bf0 con 0x7fce80155eb0 2024-05-04T02:19:45.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:45.765+0000 7fce87813640 1 -- 172.21.15.1:0/280818856 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce801591b0 con 0x7fce80155eb0 2024-05-04T02:19:45.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:45.766+0000 7fce87813640 1 -- 172.21.15.1:0/280818856 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce80063fb0 con 0x7fce80155eb0 2024-05-04T02:19:46.060 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:46.057+0000 7fce7dffb640 1 -- 172.21.15.1:0/280818856 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fce74013070 con 0x7fce80155eb0 2024-05-04T02:19:46.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:46.064+0000 7fce7dffb640 1 -- 172.21.15.1:0/280818856 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fce7401f540 con 0x7fce80155eb0 2024-05-04T02:19:46.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:46.064+0000 7fce7dffb640 1 -- 172.21.15.1:0/280818856 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fce7401b030 con 0x7fce80155eb0 2024-05-04T02:19:46.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:46.132+0000 7fce87813640 1 -- 172.21.15.1:0/280818856 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fce80076740 con 0x7fce80155eb0 2024-05-04T02:19:46.205 INFO:tasks.ceph.mgr.y.smithi001.stderr:2024-05-04T02:19:46.203+0000 7f5048624040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-04T02:19:46.214 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-04T02:19:46.212+0000 7f0b43a14040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-04T02:19:46.366 INFO:tasks.ceph.mgr.y.smithi001.stderr:2024-05-04T02:19:46.364+0000 7f5048624040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-04T02:19:46.371 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-04T02:19:46.368+0000 7f0b43a14040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-04T02:19:46.423 INFO:tasks.ceph.mgr.y.smithi001.stderr:2024-05-04T02:19:46.421+0000 7f5048624040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-04T02:19:46.423 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-04T02:19:46.421+0000 7f0b43a14040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-04T02:19:46.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:46.575+0000 7fce7dffb640 1 -- 172.21.15.1:0/280818856 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7fce740288f0 con 0x7fce80155eb0 2024-05-04T02:19:46.578 INFO:teuthology.orchestra.run.smithi001.stderr:adjusted tunables profile to default 2024-05-04T02:19:46.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:46.576+0000 7fce87813640 1 -- 172.21.15.1:0/280818856 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fce80155eb0 msgr2=0x7fce80159c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:19:46.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:46.576+0000 7fce87813640 1 --2- 172.21.15.1:0/280818856 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fce80155eb0 0x7fce80159c00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fce6c00ae60 tx=0x7fce74007430 comp rx=0 tx=0).stop 2024-05-04T02:19:46.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:46.576+0000 7fce87813640 1 -- 172.21.15.1:0/280818856 shutdown_connections 2024-05-04T02:19:46.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:46.576+0000 7fce87813640 1 --2- 172.21.15.1:0/280818856 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fce8015a140 0x7fce8014df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:46.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:46.576+0000 7fce87813640 1 --2- 172.21.15.1:0/280818856 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fce80155eb0 0x7fce80159c00 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:46.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:46.576+0000 7fce87813640 1 --2- 172.21.15.1:0/280818856 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fce8015aad0 0x7fce801f38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:46.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:46.576+0000 7fce87813640 1 -- 172.21.15.1:0/280818856 >> 172.21.15.1:0/280818856 conn(0x7fce800cb8e0 msgr2=0x7fce80151f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:19:46.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:46.576+0000 7fce87813640 1 -- 172.21.15.1:0/280818856 shutdown_connections 2024-05-04T02:19:46.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:46.576+0000 7fce87813640 1 -- 172.21.15.1:0/280818856 wait complete. 2024-05-04T02:19:46.590 INFO:tasks.ceph:check_enable_crimson: False 2024-05-04T02:19:46.591 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-05-04T02:19:46.591 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-05-04T02:19:46.591 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-05-04T02:19:46.616 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-05-04T02:19:46.616 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-05-04T02:19:46.676 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-04T02:19:46.673+0000 7f0b43a14040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-04T02:19:46.682 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-05-04T02:19:46.682 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-05-04T02:19:46.699 INFO:tasks.ceph.mgr.y.smithi001.stderr:2024-05-04T02:19:46.697+0000 7f5048624040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-04T02:19:46.722 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-04T02:19:46.720+0000 7f0b43a14040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-04T02:19:46.723 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-05-04T02:19:46.723 DEBUG:teuthology.orchestra.run.smithi001:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-05-04T02:19:46.749 INFO:tasks.ceph.mgr.y.smithi001.stderr:2024-05-04T02:19:46.747+0000 7f5048624040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-04T02:19:46.773 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-04T02:19:46.773 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-05-04T02:19:46.797 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-04T02:19:46.797 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-05-04T02:19:46.860 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-04T02:19:46.861 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-05-04T02:19:46.924 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-05-04T02:19:46.924 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-05-04T02:19:46.988 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd new d8ad7964-7bd6-4ba9-ae4f-b55d7566b18c 0 2024-05-04T02:19:47.138 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.135+0000 7fb47a015640 1 Processor -- start 2024-05-04T02:19:47.138 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.135+0000 7fb47a015640 1 -- start start 2024-05-04T02:19:47.139 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.136+0000 7fb47a015640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb4740c9be0 0x7fb4741536b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:19:47.139 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.136+0000 7fb47a015640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb4740c9170 0x7fb4740ca6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:19:47.139 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.136+0000 7fb47a015640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb4740c4740 0x7fb47406e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:19:47.139 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.136+0000 7fb47a015640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7fb4740cac30 con 0x7fb4740c4740 2024-05-04T02:19:47.139 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.136+0000 7fb47a015640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fb47406ed30 con 0x7fb4740c9be0 2024-05-04T02:19:47.139 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.136+0000 7fb47a015640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fb474159fd0 con 0x7fb4740c9170 2024-05-04T02:19:47.140 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.137+0000 7fb46affd640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb4740c9170 0x7fb4740ca6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:19:47.140 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.137+0000 7fb4737fe640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb4740c9be0 0x7fb4741536b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:19:47.140 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.137+0000 7fb473fff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb4740c4740 0x7fb47406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:19:47.140 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.137+0000 7fb46affd640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb4740c9170 0x7fb4740ca6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.107:58344/0 (socket says 172.21.15.107:58344) 2024-05-04T02:19:47.141 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.137+0000 7fb46affd640 1 -- 172.21.15.107:0/3738326182 learned_addr learned my addr 172.21.15.107:0/3738326182 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-04T02:19:47.143 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.140+0000 7fb4737fe640 1 -- 172.21.15.107:0/3738326182 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb4740c9170 msgr2=0x7fb4740ca6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:19:47.143 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.140+0000 7fb4737fe640 1 --2- 172.21.15.107:0/3738326182 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb4740c9170 0x7fb4740ca6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:47.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.140+0000 7fb4737fe640 1 -- 172.21.15.107:0/3738326182 >> v2:172.21.15.1:3300/0 conn(0x7fb4740c4740 msgr2=0x7fb47406e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:19:47.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.140+0000 7fb4737fe640 1 --2- 172.21.15.107:0/3738326182 >> v2:172.21.15.1:3300/0 conn(0x7fb4740c4740 0x7fb47406e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:47.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.140+0000 7fb4737fe640 1 -- 172.21.15.107:0/3738326182 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4740c9720 con 0x7fb4740c9be0 2024-05-04T02:19:47.144 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.140+0000 7fb473fff640 1 --2- 172.21.15.107:0/3738326182 >> v2:172.21.15.1:3300/0 conn(0x7fb4740c4740 0x7fb47406e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-04T02:19:47.145 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.142+0000 7fb4737fe640 1 --2- 172.21.15.107:0/3738326182 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb4740c9be0 0x7fb4741536b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb4740714b0 tx=0x7fb46402a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ec6165c82b48fed server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:19:47.149 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.147+0000 7fb472ffd640 1 -- 172.21.15.107:0/3738326182 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb464037070 con 0x7fb4740c9be0 2024-05-04T02:19:47.149 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.147+0000 7fb472ffd640 1 -- 172.21.15.107:0/3738326182 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb464032440 con 0x7fb4740c9be0 2024-05-04T02:19:47.149 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.147+0000 7fb472ffd640 1 -- 172.21.15.107:0/3738326182 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb464032810 con 0x7fb4740c9be0 2024-05-04T02:19:47.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.147+0000 7fb47a015640 1 -- 172.21.15.107:0/3738326182 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb4740c9be0 msgr2=0x7fb4741536b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:19:47.150 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.147+0000 7fb47a015640 1 --2- 172.21.15.107:0/3738326182 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb4740c9be0 0x7fb4741536b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb4740714b0 tx=0x7fb46402a1a0 comp rx=0 tx=0).stop 2024-05-04T02:19:47.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.148+0000 7fb47a015640 1 -- 172.21.15.107:0/3738326182 shutdown_connections 2024-05-04T02:19:47.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.148+0000 7fb47a015640 1 --2- 172.21.15.107:0/3738326182 >> v2:172.21.15.1:3300/0 conn(0x7fb4740c4740 0x7fb47406e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:47.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.148+0000 7fb47a015640 1 --2- 172.21.15.107:0/3738326182 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb4740c9170 0x7fb4740ca6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:47.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.148+0000 7fb47a015640 1 --2- 172.21.15.107:0/3738326182 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb4740c9be0 0x7fb4741536b0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:47.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.148+0000 7fb47a015640 1 -- 172.21.15.107:0/3738326182 >> 172.21.15.107:0/3738326182 conn(0x7fb474073220 msgr2=0x7fb4740706c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:19:47.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.148+0000 7fb47a015640 1 -- 172.21.15.107:0/3738326182 shutdown_connections 2024-05-04T02:19:47.151 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.148+0000 7fb47a015640 1 -- 172.21.15.107:0/3738326182 wait complete. 2024-05-04T02:19:47.152 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.150+0000 7fb47a015640 1 Processor -- start 2024-05-04T02:19:47.152 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.150+0000 7fb47a015640 1 -- start start 2024-05-04T02:19:47.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.151+0000 7fb47a015640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb4740c4740 0x7fb474153ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:19:47.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.151+0000 7fb47a015640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb4740c9170 0x7fb474158130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:19:47.154 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.151+0000 7fb47a015640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb4740c9be0 0x7fb474155870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:19:47.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.151+0000 7fb47a015640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb4740ca320 con 0x7fb4740c9170 2024-05-04T02:19:47.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.151+0000 7fb47a015640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fb4740ca1a0 con 0x7fb4740c9be0 2024-05-04T02:19:47.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.151+0000 7fb47a015640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fb4740ca4a0 con 0x7fb4740c4740 2024-05-04T02:19:47.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.152+0000 7fb473fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb4740c9be0 0x7fb474155870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:19:47.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.152+0000 7fb4737fe640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb4740c4740 0x7fb474153ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:19:47.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.152+0000 7fb46affd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb4740c9170 0x7fb474158130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:19:47.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.152+0000 7fb473fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb4740c9be0 0x7fb474155870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:38888/0 (socket says 172.21.15.107:38888) 2024-05-04T02:19:47.155 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.152+0000 7fb473fff640 1 -- 172.21.15.107:0/280361023 learned_addr learned my addr 172.21.15.107:0/280361023 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-04T02:19:47.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.156+0000 7fb473fff640 1 -- 172.21.15.107:0/280361023 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb4740c4740 msgr2=0x7fb474153ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:19:47.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.156+0000 7fb473fff640 1 --2- 172.21.15.107:0/280361023 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb4740c4740 0x7fb474153ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:47.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.156+0000 7fb473fff640 1 -- 172.21.15.107:0/280361023 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb4740c9170 msgr2=0x7fb474158130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:19:47.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.156+0000 7fb473fff640 1 --2- 172.21.15.107:0/280361023 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb4740c9170 0x7fb474158130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:47.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.156+0000 7fb473fff640 1 -- 172.21.15.107:0/280361023 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb474158670 con 0x7fb4740c9be0 2024-05-04T02:19:47.159 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.156+0000 7fb4737fe640 1 --2- 172.21.15.107:0/280361023 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb4740c4740 0x7fb474153ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-04T02:19:47.161 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.159+0000 7fb473fff640 1 --2- 172.21.15.107:0/280361023 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb4740c9be0 0x7fb474155870 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb46c00eef0 tx=0x7fb46c00b480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:19:47.165 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.162+0000 7fb470ff9640 1 -- 172.21.15.107:0/280361023 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb46c018020 con 0x7fb4740c9be0 2024-05-04T02:19:47.165 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.163+0000 7fb470ff9640 1 -- 172.21.15.107:0/280361023 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb46c014400 con 0x7fb4740c9be0 2024-05-04T02:19:47.165 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.163+0000 7fb470ff9640 1 -- 172.21.15.107:0/280361023 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb46c0147d0 con 0x7fb4740c9be0 2024-05-04T02:19:47.165 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.163+0000 7fb47a015640 1 -- 172.21.15.107:0/280361023 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4741f2830 con 0x7fb4740c9be0 2024-05-04T02:19:47.165 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.163+0000 7fb47a015640 1 -- 172.21.15.107:0/280361023 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb474157650 con 0x7fb4740c9be0 2024-05-04T02:19:47.166 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.164+0000 7fb47a015640 1 -- 172.21.15.107:0/280361023 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4741f2b40 con 0x7fb4740c9be0 2024-05-04T02:19:47.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.286+0000 7fb470ff9640 1 -- 172.21.15.107:0/280361023 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb46c005d10 con 0x7fb4740c9be0 2024-05-04T02:19:47.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.286+0000 7fb470ff9640 1 -- 172.21.15.107:0/280361023 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7fb46c01d880 con 0x7fb4740c9be0 2024-05-04T02:19:47.289 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.286+0000 7fb470ff9640 1 -- 172.21.15.107:0/280361023 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fb46c022030 con 0x7fb4740c9be0 2024-05-04T02:19:47.365 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.362+0000 7fb47a015640 1 -- 172.21.15.107:0/280361023 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d8ad7964-7bd6-4ba9-ae4f-b55d7566b18c", "id": 0} v 0) -- 0x7fb474076740 con 0x7fb4740c9be0 2024-05-04T02:19:47.448 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-04T02:19:47.445+0000 7f0b43a14040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-04T02:19:47.538 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-04T02:19:47.535+0000 7f0b43a14040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-04T02:19:47.544 INFO:tasks.ceph.mgr.y.smithi001.stderr:2024-05-04T02:19:47.542+0000 7f5048624040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-04T02:19:47.583 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-04T02:19:47.580+0000 7f0b43a14040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-04T02:19:47.592 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.589+0000 7fb470ff9640 1 -- 172.21.15.107:0/280361023 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d8ad7964-7bd6-4ba9-ae4f-b55d7566b18c", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7fb46c01daf0 con 0x7fb4740c9be0 2024-05-04T02:19:47.592 INFO:teuthology.orchestra.run.smithi107.stdout:0 2024-05-04T02:19:47.593 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.590+0000 7fb47a015640 1 -- 172.21.15.107:0/280361023 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb4740c9be0 msgr2=0x7fb474155870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:19:47.593 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.590+0000 7fb47a015640 1 --2- 172.21.15.107:0/280361023 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb4740c9be0 0x7fb474155870 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb46c00eef0 tx=0x7fb46c00b480 comp rx=0 tx=0).stop 2024-05-04T02:19:47.593 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.590+0000 7fb47a015640 1 -- 172.21.15.107:0/280361023 shutdown_connections 2024-05-04T02:19:47.594 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.590+0000 7fb47a015640 1 --2- 172.21.15.107:0/280361023 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb4740c9be0 0x7fb474155870 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:47.594 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.590+0000 7fb47a015640 1 --2- 172.21.15.107:0/280361023 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb4740c9170 0x7fb474158130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:47.594 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.590+0000 7fb47a015640 1 --2- 172.21.15.107:0/280361023 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb4740c4740 0x7fb474153ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:47.594 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.590+0000 7fb47a015640 1 -- 172.21.15.107:0/280361023 >> 172.21.15.107:0/280361023 conn(0x7fb474073220 msgr2=0x7fb4741e4b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:19:47.594 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.590+0000 7fb47a015640 1 -- 172.21.15.107:0/280361023 shutdown_connections 2024-05-04T02:19:47.594 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.590+0000 7fb47a015640 1 -- 172.21.15.107:0/280361023 wait complete. 2024-05-04T02:19:47.604 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd new ce155f6d-7e0c-47c8-a0e0-fb53ff0c7726 1 2024-05-04T02:19:47.654 INFO:tasks.ceph.mgr.y.smithi001.stderr:2024-05-04T02:19:47.652+0000 7f5048624040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-04T02:19:47.706 INFO:tasks.ceph.mgr.y.smithi001.stderr:2024-05-04T02:19:47.704+0000 7f5048624040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-04T02:19:47.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.709+0000 7fbb66c89640 1 Processor -- start 2024-05-04T02:19:47.711 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.709+0000 7fbb66c89640 1 -- start start 2024-05-04T02:19:47.713 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.710+0000 7fbb66c89640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbb600b45f0 0x7fbb6006e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:19:47.713 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.710+0000 7fbb66c89640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb6006dd70 con 0x7fbb6006f6e0 2024-05-04T02:19:47.713 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.710+0000 7fbb66c89640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb600b3870 con 0x7fbb6006cf80 2024-05-04T02:19:47.713 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.710+0000 7fbb66c89640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fbb6006d470 con 0x7fbb600b45f0 2024-05-04T02:19:47.713 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.711+0000 7fbb65226640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbb600b45f0 0x7fbb6006e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:19:47.713 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.711+0000 7fbb5ffff640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fbb6006f6e0 0x7fbb60162c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.107:35234/0 (socket says 172.21.15.107:35234) 2024-05-04T02:19:47.713 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.711+0000 7fbb64a25640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fbb6006cf80 0x7fbb600b19c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:34554/0 (socket says 172.21.15.107:34554) 2024-05-04T02:19:47.714 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.711+0000 7fbb5ffff640 1 -- 172.21.15.107:0/1890479736 learned_addr learned my addr 172.21.15.107:0/1890479736 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-04T02:19:47.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.713+0000 7fbb5f7fe640 1 -- 172.21.15.107:0/1890479736 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 230080804 0 0) 0x7fbb600b3870 con 0x7fbb6006cf80 2024-05-04T02:19:47.715 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.713+0000 7fbb5f7fe640 1 -- 172.21.15.107:0/1890479736 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb50003520 con 0x7fbb6006cf80 2024-05-04T02:19:47.716 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.714+0000 7fbb65226640 1 -- 172.21.15.107:0/1890479736 >> v1:172.21.15.107:6789/0 conn(0x7fbb6006cf80 legacy=0x7fbb600b19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:19:47.716 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.714+0000 7fbb65226640 1 -- 172.21.15.107:0/1890479736 >> v1:172.21.15.1:6789/0 conn(0x7fbb6006f6e0 legacy=0x7fbb60162c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:19:47.716 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.714+0000 7fbb65226640 1 -- 172.21.15.107:0/1890479736 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb6006d750 con 0x7fbb600b45f0 2024-05-04T02:19:47.718 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.716+0000 7fbb65226640 1 --2- 172.21.15.107:0/1890479736 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbb600b45f0 0x7fbb6006e7d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fbb58009dc0 tx=0x7fbb5802a760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=979dbaaa8a1f9bd9 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:19:47.723 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.721+0000 7fbb5f7fe640 1 -- 172.21.15.107:0/1890479736 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb58007740 con 0x7fbb600b45f0 2024-05-04T02:19:47.724 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.721+0000 7fbb5f7fe640 1 -- 172.21.15.107:0/1890479736 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb580078e0 con 0x7fbb600b45f0 2024-05-04T02:19:47.724 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.721+0000 7fbb5f7fe640 1 -- 172.21.15.107:0/1890479736 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb58007cb0 con 0x7fbb600b45f0 2024-05-04T02:19:47.724 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.722+0000 7fbb66c89640 1 -- 172.21.15.107:0/1890479736 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbb600b45f0 msgr2=0x7fbb6006e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:19:47.725 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.722+0000 7fbb66c89640 1 --2- 172.21.15.107:0/1890479736 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbb600b45f0 0x7fbb6006e7d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fbb58009dc0 tx=0x7fbb5802a760 comp rx=0 tx=0).stop 2024-05-04T02:19:47.725 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.722+0000 7fbb66c89640 1 -- 172.21.15.107:0/1890479736 shutdown_connections 2024-05-04T02:19:47.725 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.722+0000 7fbb66c89640 1 --2- 172.21.15.107:0/1890479736 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbb600b45f0 0x7fbb6006e7d0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:47.725 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.722+0000 7fbb66c89640 1 -- 172.21.15.107:0/1890479736 >> 172.21.15.107:0/1890479736 conn(0x7fbb60070c80 msgr2=0x7fbb600ce810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:19:47.725 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.722+0000 7fbb66c89640 1 -- 172.21.15.107:0/1890479736 shutdown_connections 2024-05-04T02:19:47.725 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.722+0000 7fbb66c89640 1 -- 172.21.15.107:0/1890479736 wait complete. 2024-05-04T02:19:47.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.724+0000 7fbb66c89640 1 Processor -- start 2024-05-04T02:19:47.726 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.724+0000 7fbb66c89640 1 -- start start 2024-05-04T02:19:47.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.725+0000 7fbb66c89640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbb6006cf80 0x7fbb600afaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:19:47.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.725+0000 7fbb66c89640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbb6006f6e0 0x7fbb600b0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:19:47.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.725+0000 7fbb66c89640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb600b45f0 0x7fbb600ce5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:19:47.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.725+0000 7fbb66c89640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fbb600b40d0 con 0x7fbb600b45f0 2024-05-04T02:19:47.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.725+0000 7fbb66c89640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fbb600b3df0 con 0x7fbb6006f6e0 2024-05-04T02:19:47.728 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.725+0000 7fbb66c89640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fbb600b20d0 con 0x7fbb6006cf80 2024-05-04T02:19:47.729 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.726+0000 7fbb64a25640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbb6006cf80 0x7fbb600afaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:19:47.729 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.726+0000 7fbb65226640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb600b45f0 0x7fbb600ce5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:19:47.729 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.726+0000 7fbb5ffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbb6006f6e0 0x7fbb600b0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:19:47.729 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.726+0000 7fbb64a25640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbb6006cf80 0x7fbb600afaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.107:58366/0 (socket says 172.21.15.107:58366) 2024-05-04T02:19:47.729 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.726+0000 7fbb64a25640 1 -- 172.21.15.107:0/1480435549 learned_addr learned my addr 172.21.15.107:0/1480435549 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-04T02:19:47.732 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.730+0000 7fbb64a25640 1 -- 172.21.15.107:0/1480435549 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbb6006f6e0 msgr2=0x7fbb600b0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:19:47.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.730+0000 7fbb64a25640 1 --2- 172.21.15.107:0/1480435549 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbb6006f6e0 0x7fbb600b0180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:47.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.730+0000 7fbb64a25640 1 -- 172.21.15.107:0/1480435549 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb600b45f0 msgr2=0x7fbb600ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:19:47.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.730+0000 7fbb64a25640 1 --2- 172.21.15.107:0/1480435549 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb600b45f0 0x7fbb600ce5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:47.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.730+0000 7fbb64a25640 1 -- 172.21.15.107:0/1480435549 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb600b0fa0 con 0x7fbb6006cf80 2024-05-04T02:19:47.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.730+0000 7fbb5ffff640 1 --2- 172.21.15.107:0/1480435549 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbb6006f6e0 0x7fbb600b0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-04T02:19:47.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.733+0000 7fbb64a25640 1 --2- 172.21.15.107:0/1480435549 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbb6006cf80 0x7fbb600afaa0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fbb5400c3c0 tx=0x7fbb5400c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:19:47.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.737+0000 7fbb5d7fa640 1 -- 172.21.15.107:0/1480435549 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb540074e0 con 0x7fbb6006cf80 2024-05-04T02:19:47.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.737+0000 7fbb5d7fa640 1 -- 172.21.15.107:0/1480435549 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb54007680 con 0x7fbb6006cf80 2024-05-04T02:19:47.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.737+0000 7fbb5d7fa640 1 -- 172.21.15.107:0/1480435549 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb54004a20 con 0x7fbb6006cf80 2024-05-04T02:19:47.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.737+0000 7fbb66c89640 1 -- 172.21.15.107:0/1480435549 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb600b1280 con 0x7fbb6006cf80 2024-05-04T02:19:47.740 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.737+0000 7fbb66c89640 1 -- 172.21.15.107:0/1480435549 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb6015d880 con 0x7fbb6006cf80 2024-05-04T02:19:47.741 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.738+0000 7fbb66c89640 1 -- 172.21.15.107:0/1480435549 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb6015dae0 con 0x7fbb6006cf80 2024-05-04T02:19:47.767 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.765+0000 7fbb5d7fa640 1 -- 172.21.15.107:0/1480435549 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fbb54004bc0 con 0x7fbb6006cf80 2024-05-04T02:19:47.768 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.765+0000 7fbb5d7fa640 1 -- 172.21.15.107:0/1480435549 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7fbb540128b0 con 0x7fbb6006cf80 2024-05-04T02:19:47.784 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-04T02:19:47.781+0000 7f0b43a14040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-04T02:19:47.848 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-04T02:19:47.846+0000 7f0b43a14040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-04T02:19:47.884 INFO:tasks.ceph.mgr.y.smithi001.stderr:2024-05-04T02:19:47.882+0000 7f5048624040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-04T02:19:47.902 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-04T02:19:47.900+0000 7f0b43a14040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-04T02:19:47.934 INFO:tasks.ceph.mgr.y.smithi001.stderr:2024-05-04T02:19:47.932+0000 7f5048624040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-04T02:19:47.967 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:47.964+0000 7fbb5d7fa640 1 -- 172.21.15.107:0/1480435549 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fbb54012ab0 con 0x7fbb6006cf80 2024-05-04T02:19:47.990 INFO:tasks.ceph.mgr.y.smithi001.stderr:2024-05-04T02:19:47.988+0000 7f5048624040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-04T02:19:48.019 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-04T02:19:48.016+0000 7f0b43a14040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-04T02:19:48.039 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.037+0000 7fbb66c89640 1 -- 172.21.15.107:0/1480435549 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ce155f6d-7e0c-47c8-a0e0-fb53ff0c7726", "id": 1} v 0) -- 0x7fbb600b1450 con 0x7fbb6006cf80 2024-05-04T02:19:48.109 INFO:tasks.ceph.mgr.y.smithi001.stderr:2024-05-04T02:19:48.107+0000 7f5048624040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-04T02:19:48.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.190+0000 7fbb5d7fa640 1 -- 172.21.15.107:0/1480435549 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ce155f6d-7e0c-47c8-a0e0-fb53ff0c7726", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7fbb54012d40 con 0x7fbb6006cf80 2024-05-04T02:19:48.193 INFO:teuthology.orchestra.run.smithi107.stdout:1 2024-05-04T02:19:48.194 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.191+0000 7fbb66c89640 1 -- 172.21.15.107:0/1480435549 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbb6006cf80 msgr2=0x7fbb600afaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:19:48.194 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.191+0000 7fbb66c89640 1 --2- 172.21.15.107:0/1480435549 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbb6006cf80 0x7fbb600afaa0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fbb5400c3c0 tx=0x7fbb5400c880 comp rx=0 tx=0).stop 2024-05-04T02:19:48.194 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.191+0000 7fbb66c89640 1 -- 172.21.15.107:0/1480435549 shutdown_connections 2024-05-04T02:19:48.194 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.191+0000 7fbb66c89640 1 --2- 172.21.15.107:0/1480435549 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbb600b45f0 0x7fbb600ce5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:48.194 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.191+0000 7fbb66c89640 1 --2- 172.21.15.107:0/1480435549 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbb6006f6e0 0x7fbb600b0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:48.194 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.191+0000 7fbb66c89640 1 --2- 172.21.15.107:0/1480435549 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbb6006cf80 0x7fbb600afaa0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:48.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.191+0000 7fbb66c89640 1 -- 172.21.15.107:0/1480435549 >> 172.21.15.107:0/1480435549 conn(0x7fbb60070c80 msgr2=0x7fbb601e3730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:19:48.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.191+0000 7fbb66c89640 1 -- 172.21.15.107:0/1480435549 shutdown_connections 2024-05-04T02:19:48.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.191+0000 7fbb66c89640 1 -- 172.21.15.107:0/1480435549 wait complete. 2024-05-04T02:19:48.205 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd new 7847c281-5da0-4d7d-b888-7f49d99a50b9 2 2024-05-04T02:19:48.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.310+0000 7f3be031b640 1 Processor -- start 2024-05-04T02:19:48.313 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.310+0000 7f3be031b640 1 -- start start 2024-05-04T02:19:48.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.311+0000 7f3be031b640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f3bd81533f0 0x7f3bd8159230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:19:48.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.311+0000 7f3be031b640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f3bd80c9920 0x7f3bd80c9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:19:48.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.311+0000 7f3be031b640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3bd806e4a0 con 0x7f3bd806e090 2024-05-04T02:19:48.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.311+0000 7f3be031b640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f3bd806fa80 con 0x7f3bd81533f0 2024-05-04T02:19:48.314 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.311+0000 7f3be031b640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f3bd80c5a60 con 0x7f3bd80c9920 2024-05-04T02:19:48.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.312+0000 7f3bde0b7640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f3bd81533f0 0x7f3bd8159230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:19:48.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.312+0000 7f3bde8b8640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f3bd80c9920 0x7f3bd80c9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:19:48.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.313+0000 7f3bde8b8640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f3bd80c9920 0x7f3bd80c9d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:38910/0 (socket says 172.21.15.107:38910) 2024-05-04T02:19:48.315 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.313+0000 7f3bde8b8640 1 -- 172.21.15.107:0/3518267058 learned_addr learned my addr 172.21.15.107:0/3518267058 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-04T02:19:48.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.316+0000 7f3bde8b8640 1 -- 172.21.15.107:0/3518267058 >> v2:172.21.15.1:3300/0 conn(0x7f3bd81533f0 msgr2=0x7f3bd8159230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:19:48.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.316+0000 7f3bde8b8640 1 --2- 172.21.15.107:0/3518267058 >> v2:172.21.15.1:3300/0 conn(0x7f3bd81533f0 0x7f3bd8159230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:48.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.316+0000 7f3bde8b8640 1 -- 172.21.15.107:0/3518267058 >> v1:172.21.15.107:6789/0 conn(0x7f3bd806e090 legacy=0x7f3bd80c3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:19:48.319 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.316+0000 7f3bde8b8640 1 -- 172.21.15.107:0/3518267058 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bd806e720 con 0x7f3bd80c9920 2024-05-04T02:19:48.325 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.322+0000 7f3bde8b8640 1 --2- 172.21.15.107:0/3518267058 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3bd80c9920 0x7f3bd80c9d30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3bd80749f0 tx=0x7f3bd002a7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=501cee42764a3f7f server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:19:48.333 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.330+0000 7f3bdd0b5640 1 -- 172.21.15.107:0/3518267058 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bd0036070 con 0x7f3bd80c9920 2024-05-04T02:19:48.333 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.330+0000 7f3bdd0b5640 1 -- 172.21.15.107:0/3518267058 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bd0031600 con 0x7f3bd80c9920 2024-05-04T02:19:48.333 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.330+0000 7f3bdd0b5640 1 -- 172.21.15.107:0/3518267058 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bd00319f0 con 0x7f3bd80c9920 2024-05-04T02:19:48.334 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.332+0000 7f3be031b640 1 -- 172.21.15.107:0/3518267058 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3bd80c9920 msgr2=0x7f3bd80c9d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:19:48.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.332+0000 7f3be031b640 1 --2- 172.21.15.107:0/3518267058 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3bd80c9920 0x7f3bd80c9d30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3bd80749f0 tx=0x7f3bd002a7c0 comp rx=0 tx=0).stop 2024-05-04T02:19:48.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.332+0000 7f3be031b640 1 -- 172.21.15.107:0/3518267058 shutdown_connections 2024-05-04T02:19:48.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.332+0000 7f3be031b640 1 --2- 172.21.15.107:0/3518267058 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3bd80c9920 0x7f3bd80c9d30 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:48.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.332+0000 7f3be031b640 1 --2- 172.21.15.107:0/3518267058 >> v2:172.21.15.1:3300/0 conn(0x7f3bd81533f0 0x7f3bd8159230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:48.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.332+0000 7f3be031b640 1 -- 172.21.15.107:0/3518267058 >> 172.21.15.107:0/3518267058 conn(0x7f3bd8070c80 msgr2=0x7f3bd80ce810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:19:48.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.332+0000 7f3be031b640 1 -- 172.21.15.107:0/3518267058 shutdown_connections 2024-05-04T02:19:48.335 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.332+0000 7f3be031b640 1 -- 172.21.15.107:0/3518267058 wait complete. 2024-05-04T02:19:48.338 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.335+0000 7f3be031b640 1 Processor -- start 2024-05-04T02:19:48.338 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.335+0000 7f3be031b640 1 -- start start 2024-05-04T02:19:48.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.337+0000 7f3be031b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3bd806e090 0x7f3bd814c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:19:48.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.337+0000 7f3be031b640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3bd80c9920 0x7f3bd815abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:19:48.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.337+0000 7f3be031b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3bd81533f0 0x7f3bd806d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:19:48.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.337+0000 7f3be031b640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd806ecc0 con 0x7f3bd81533f0 2024-05-04T02:19:48.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.337+0000 7f3be031b640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd806f5f0 con 0x7f3bd806e090 2024-05-04T02:19:48.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.337+0000 7f3be031b640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f3bd806efa0 con 0x7f3bd80c9920 2024-05-04T02:19:48.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.337+0000 7f3bdd8b6640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3bd80c9920 0x7f3bd815abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:19:48.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.337+0000 7f3bde0b7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3bd806e090 0x7f3bd814c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:19:48.340 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.337+0000 7f3bde8b8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3bd81533f0 0x7f3bd806d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:19:48.341 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.338+0000 7f3bde0b7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3bd806e090 0x7f3bd814c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:38922/0 (socket says 172.21.15.107:38922) 2024-05-04T02:19:48.341 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.338+0000 7f3bde0b7640 1 -- 172.21.15.107:0/1800829330 learned_addr learned my addr 172.21.15.107:0/1800829330 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-04T02:19:48.344 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.342+0000 7f3bdd8b6640 1 -- 172.21.15.107:0/1800829330 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3bd806e090 msgr2=0x7f3bd814c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:19:48.344 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.342+0000 7f3bdd8b6640 1 --2- 172.21.15.107:0/1800829330 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3bd806e090 0x7f3bd814c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:48.344 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.342+0000 7f3bdd8b6640 1 -- 172.21.15.107:0/1800829330 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3bd81533f0 msgr2=0x7f3bd806d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:19:48.344 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.342+0000 7f3bdd8b6640 1 --2- 172.21.15.107:0/1800829330 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3bd81533f0 0x7f3bd806d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:48.344 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.342+0000 7f3bdd8b6640 1 -- 172.21.15.107:0/1800829330 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bd815b130 con 0x7f3bd80c9920 2024-05-04T02:19:48.347 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.345+0000 7f3bdd8b6640 1 --2- 172.21.15.107:0/1800829330 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3bd80c9920 0x7f3bd815abf0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3bc800c3c0 tx=0x7f3bc800c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:19:48.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.348+0000 7f3bceffd640 1 -- 172.21.15.107:0/1800829330 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc8017070 con 0x7f3bd80c9920 2024-05-04T02:19:48.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.348+0000 7f3bceffd640 1 -- 172.21.15.107:0/1800829330 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bc80052f0 con 0x7f3bd80c9920 2024-05-04T02:19:48.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.349+0000 7f3be031b640 1 -- 172.21.15.107:0/1800829330 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bd81f19d0 con 0x7f3bd80c9920 2024-05-04T02:19:48.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.349+0000 7f3bceffd640 1 -- 172.21.15.107:0/1800829330 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc8003830 con 0x7f3bd80c9920 2024-05-04T02:19:48.351 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.349+0000 7f3be031b640 1 -- 172.21.15.107:0/1800829330 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bd814ce30 con 0x7f3bd80c9920 2024-05-04T02:19:48.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.350+0000 7f3be031b640 1 -- 172.21.15.107:0/1800829330 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bd8076740 con 0x7f3bd80c9920 2024-05-04T02:19:48.438 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-04T02:19:48.435+0000 7f0b43a14040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-04T02:19:48.457 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.454+0000 7f3bceffd640 1 -- 172.21.15.107:0/1800829330 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3bc801a070 con 0x7f3bd80c9920 2024-05-04T02:19:48.457 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.454+0000 7f3bceffd640 1 -- 172.21.15.107:0/1800829330 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f3bc801b3b0 con 0x7f3bd80c9920 2024-05-04T02:19:48.457 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.454+0000 7f3bceffd640 1 -- 172.21.15.107:0/1800829330 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f3bc8021020 con 0x7f3bd80c9920 2024-05-04T02:19:48.529 INFO:tasks.ceph.mgr.y.smithi001.stderr:2024-05-04T02:19:48.527+0000 7f5048624040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-04T02:19:48.531 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.528+0000 7f3be031b640 1 -- 172.21.15.107:0/1800829330 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "osd new", "uuid": "7847c281-5da0-4d7d-b888-7f49d99a50b9", "id": 2} v 0) -- 0x7f3bd80ca460 con 0x7f3bd80c9920 2024-05-04T02:19:48.582 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-04T02:19:48.579+0000 7f0b43a14040 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-04T02:19:48.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.605+0000 7f3bceffd640 1 -- 172.21.15.107:0/1800829330 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7847c281-5da0-4d7d-b888-7f49d99a50b9", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f3bd806e4a0 con 0x7f3bd80c9920 2024-05-04T02:19:48.608 INFO:teuthology.orchestra.run.smithi107.stdout:2 2024-05-04T02:19:48.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.606+0000 7f3be031b640 1 -- 172.21.15.107:0/1800829330 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3bd80c9920 msgr2=0x7f3bd815abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:19:48.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.606+0000 7f3be031b640 1 --2- 172.21.15.107:0/1800829330 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3bd80c9920 0x7f3bd815abf0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3bc800c3c0 tx=0x7f3bc800c880 comp rx=0 tx=0).stop 2024-05-04T02:19:48.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.606+0000 7f3be031b640 1 -- 172.21.15.107:0/1800829330 shutdown_connections 2024-05-04T02:19:48.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.606+0000 7f3be031b640 1 --2- 172.21.15.107:0/1800829330 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3bd81533f0 0x7f3bd806d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:48.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.606+0000 7f3be031b640 1 --2- 172.21.15.107:0/1800829330 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3bd80c9920 0x7f3bd815abf0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:48.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.606+0000 7f3be031b640 1 --2- 172.21.15.107:0/1800829330 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3bd806e090 0x7f3bd814c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:48.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.606+0000 7f3be031b640 1 -- 172.21.15.107:0/1800829330 >> 172.21.15.107:0/1800829330 conn(0x7f3bd8070c80 msgr2=0x7f3bd8151620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:19:48.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.606+0000 7f3be031b640 1 -- 172.21.15.107:0/1800829330 shutdown_connections 2024-05-04T02:19:48.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.606+0000 7f3be031b640 1 -- 172.21.15.107:0/1800829330 wait complete. 2024-05-04T02:19:48.620 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd new 26386eba-d106-4abe-8d6b-7dccdd106cb3 3 2024-05-04T02:19:48.691 INFO:tasks.ceph.mgr.y.smithi001.stderr:2024-05-04T02:19:48.689+0000 7f5048624040 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-04T02:19:48.730 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.728+0000 7f8b94dd5640 1 Processor -- start 2024-05-04T02:19:48.730 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.728+0000 7f8b94dd5640 1 -- start start 2024-05-04T02:19:48.731 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.729+0000 7f8b94dd5640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8b900cb500 0x7f8b900c3210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:19:48.732 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.729+0000 7f8b94dd5640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f8b900ca0d0 0x7f8b900ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:19:48.732 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.729+0000 7f8b94dd5640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b900caa20 con 0x7f8b9015fbc0 2024-05-04T02:19:48.732 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.729+0000 7f8b94dd5640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f8b900c7a80 con 0x7f8b900ca0d0 2024-05-04T02:19:48.732 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.729+0000 7f8b94dd5640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f8b900cb910 con 0x7f8b900cb500 2024-05-04T02:19:48.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.729+0000 7f8b87fff640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f8b900ca0d0 0x7f8b900ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:19:48.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.730+0000 7f8b8e59c640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8b900cb500 0x7f8b900c3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:19:48.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.730+0000 7f8b8ed9d640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f8b9015fbc0 0x7f8b9015ffd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.107:60390/0 (socket says 172.21.15.107:60390) 2024-05-04T02:19:48.733 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.730+0000 7f8b8ed9d640 1 -- 172.21.15.107:0/2194393519 learned_addr learned my addr 172.21.15.107:0/2194393519 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-04T02:19:48.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.732+0000 7f8b8dd9b640 1 -- 172.21.15.107:0/2194393519 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4125403553 0 0) 0x7f8b900caa20 con 0x7f8b9015fbc0 2024-05-04T02:19:48.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.732+0000 7f8b8dd9b640 1 -- 172.21.15.107:0/2194393519 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8b7c003520 con 0x7f8b9015fbc0 2024-05-04T02:19:48.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.732+0000 7f8b87fff640 1 -- 172.21.15.107:0/2194393519 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8b900cb500 msgr2=0x7f8b900c3210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:19:48.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.732+0000 7f8b87fff640 1 --2- 172.21.15.107:0/2194393519 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8b900cb500 0x7f8b900c3210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:48.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.732+0000 7f8b87fff640 1 -- 172.21.15.107:0/2194393519 >> v1:172.21.15.1:6789/0 conn(0x7f8b9015fbc0 legacy=0x7f8b9015ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:19:48.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.733+0000 7f8b87fff640 1 -- 172.21.15.107:0/2194393519 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b9008d6f0 con 0x7f8b900ca0d0 2024-05-04T02:19:48.737 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.735+0000 7f8b87fff640 1 --2- 172.21.15.107:0/2194393519 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b900ca0d0 0x7f8b900ca4e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8b780097a0 tx=0x7f8b7802a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea6b0bde0a07cac3 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:19:48.739 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.737+0000 7f8b8dd9b640 1 -- 172.21.15.107:0/2194393519 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b78037070 con 0x7f8b900ca0d0 2024-05-04T02:19:48.742 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.740+0000 7f8b8dd9b640 1 -- 172.21.15.107:0/2194393519 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b78032440 con 0x7f8b900ca0d0 2024-05-04T02:19:48.742 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.740+0000 7f8b8dd9b640 1 -- 172.21.15.107:0/2194393519 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b780327f0 con 0x7f8b900ca0d0 2024-05-04T02:19:48.744 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.741+0000 7f8b94dd5640 1 -- 172.21.15.107:0/2194393519 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b900ca0d0 msgr2=0x7f8b900ca4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:19:48.744 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.741+0000 7f8b94dd5640 1 --2- 172.21.15.107:0/2194393519 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b900ca0d0 0x7f8b900ca4e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8b780097a0 tx=0x7f8b7802a210 comp rx=0 tx=0).stop 2024-05-04T02:19:48.744 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.741+0000 7f8b94dd5640 1 -- 172.21.15.107:0/2194393519 shutdown_connections 2024-05-04T02:19:48.744 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.741+0000 7f8b94dd5640 1 --2- 172.21.15.107:0/2194393519 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b900ca0d0 0x7f8b900ca4e0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:48.744 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.741+0000 7f8b94dd5640 1 --2- 172.21.15.107:0/2194393519 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8b900cb500 0x7f8b900c3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:48.744 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.741+0000 7f8b94dd5640 1 -- 172.21.15.107:0/2194393519 >> 172.21.15.107:0/2194393519 conn(0x7f8b900cf6c0 msgr2=0x7f8b900cfad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:19:48.744 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.741+0000 7f8b94dd5640 1 -- 172.21.15.107:0/2194393519 shutdown_connections 2024-05-04T02:19:48.744 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.741+0000 7f8b94dd5640 1 -- 172.21.15.107:0/2194393519 wait complete. 2024-05-04T02:19:48.746 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.743+0000 7f8b94dd5640 1 Processor -- start 2024-05-04T02:19:48.746 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.743+0000 7f8b94dd5640 1 -- start start 2024-05-04T02:19:48.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.745+0000 7f8b94dd5640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8b900ca0d0 0x7f8b901f2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:19:48.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.745+0000 7f8b94dd5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b900cb500 0x7f8b90157b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:19:48.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.745+0000 7f8b94dd5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b9015fbc0 0x7f8b90155910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:19:48.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.745+0000 7f8b94dd5640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8b900c5420 con 0x7f8b900cb500 2024-05-04T02:19:48.748 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.745+0000 7f8b94dd5640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f8b900c5140 con 0x7f8b9015fbc0 2024-05-04T02:19:48.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.745+0000 7f8b94dd5640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f8b900c5700 con 0x7f8b900ca0d0 2024-05-04T02:19:48.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.745+0000 7f8b8ed9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b9015fbc0 0x7f8b90155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:19:48.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.745+0000 7f8b8e59c640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8b900ca0d0 0x7f8b901f2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:19:48.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.745+0000 7f8b87fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b900cb500 0x7f8b90157b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:19:48.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.746+0000 7f8b8ed9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b9015fbc0 0x7f8b90155910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:46016/0 (socket says 172.21.15.107:46016) 2024-05-04T02:19:48.749 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.746+0000 7f8b8ed9d640 1 -- 172.21.15.107:0/3082663656 learned_addr learned my addr 172.21.15.107:0/3082663656 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-04T02:19:48.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.750+0000 7f8b8ed9d640 1 -- 172.21.15.107:0/3082663656 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8b900ca0d0 msgr2=0x7f8b901f2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:19:48.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.750+0000 7f8b8ed9d640 1 --2- 172.21.15.107:0/3082663656 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8b900ca0d0 0x7f8b901f2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:48.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.750+0000 7f8b8ed9d640 1 -- 172.21.15.107:0/3082663656 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b900cb500 msgr2=0x7f8b90157b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:19:48.752 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.750+0000 7f8b8ed9d640 1 --2- 172.21.15.107:0/3082663656 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b900cb500 0x7f8b90157b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:48.753 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.750+0000 7f8b8ed9d640 1 -- 172.21.15.107:0/3082663656 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b90070ba0 con 0x7f8b9015fbc0 2024-05-04T02:19:48.754 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.752+0000 7f8b8ed9d640 1 --2- 172.21.15.107:0/3082663656 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b9015fbc0 0x7f8b90155910 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8b8800cad0 tx=0x7f8b8800cf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:19:48.758 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.756+0000 7f8b86ffd640 1 -- 172.21.15.107:0/3082663656 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b8800ac30 con 0x7f8b9015fbc0 2024-05-04T02:19:48.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.756+0000 7f8b86ffd640 1 -- 172.21.15.107:0/3082663656 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b8800add0 con 0x7f8b9015fbc0 2024-05-04T02:19:48.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.756+0000 7f8b94dd5640 1 -- 172.21.15.107:0/3082663656 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b9006f790 con 0x7f8b9015fbc0 2024-05-04T02:19:48.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.756+0000 7f8b86ffd640 1 -- 172.21.15.107:0/3082663656 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b88012600 con 0x7f8b9015fbc0 2024-05-04T02:19:48.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.756+0000 7f8b94dd5640 1 -- 172.21.15.107:0/3082663656 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b900703a0 con 0x7f8b9015fbc0 2024-05-04T02:19:48.759 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.757+0000 7f8b94dd5640 1 -- 172.21.15.107:0/3082663656 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b90069c60 con 0x7f8b9015fbc0 2024-05-04T02:19:48.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.759+0000 7f8b86ffd640 1 -- 172.21.15.107:0/3082663656 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8b880127a0 con 0x7f8b9015fbc0 2024-05-04T02:19:48.762 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.759+0000 7f8b86ffd640 1 -- 172.21.15.107:0/3082663656 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f8b88025c80 con 0x7f8b9015fbc0 2024-05-04T02:19:48.863 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-04T02:19:48.860+0000 7f0b43a14040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-04T02:19:48.868 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.866+0000 7f8b86ffd640 1 -- 172.21.15.107:0/3082663656 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f8b88025430 con 0x7f8b9015fbc0 2024-05-04T02:19:48.916 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-04T02:19:48.913+0000 7f0b43a14040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-04T02:19:48.940 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:48.938+0000 7f8b94dd5640 1 -- 172.21.15.107:0/3082663656 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd new", "uuid": "26386eba-d106-4abe-8d6b-7dccdd106cb3", "id": 3} v 0) -- 0x7f8b900c6290 con 0x7f8b9015fbc0 2024-05-04T02:19:48.972 INFO:tasks.ceph.mgr.y.smithi001.stderr:2024-05-04T02:19:48.970+0000 7f5048624040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-04T02:19:49.036 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-04T02:19:49.033+0000 7f0b43a14040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-04T02:19:49.043 INFO:tasks.ceph.mgr.y.smithi001.stderr:2024-05-04T02:19:49.041+0000 7f5048624040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-04T02:19:49.064 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.062+0000 7f8b86ffd640 1 -- 172.21.15.107:0/3082663656 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "26386eba-d106-4abe-8d6b-7dccdd106cb3", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f8b880256f0 con 0x7f8b9015fbc0 2024-05-04T02:19:49.065 INFO:teuthology.orchestra.run.smithi107.stdout:3 2024-05-04T02:19:49.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.063+0000 7f8b94dd5640 1 -- 172.21.15.107:0/3082663656 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b9015fbc0 msgr2=0x7f8b90155910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:19:49.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.063+0000 7f8b94dd5640 1 --2- 172.21.15.107:0/3082663656 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b9015fbc0 0x7f8b90155910 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8b8800cad0 tx=0x7f8b8800cf90 comp rx=0 tx=0).stop 2024-05-04T02:19:49.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.063+0000 7f8b94dd5640 1 -- 172.21.15.107:0/3082663656 shutdown_connections 2024-05-04T02:19:49.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.063+0000 7f8b94dd5640 1 --2- 172.21.15.107:0/3082663656 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8b9015fbc0 0x7f8b90155910 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:49.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.063+0000 7f8b94dd5640 1 --2- 172.21.15.107:0/3082663656 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8b900cb500 0x7f8b90157b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:49.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.063+0000 7f8b94dd5640 1 --2- 172.21.15.107:0/3082663656 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8b900ca0d0 0x7f8b901f2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:49.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.063+0000 7f8b94dd5640 1 -- 172.21.15.107:0/3082663656 >> 172.21.15.107:0/3082663656 conn(0x7f8b900cf6c0 msgr2=0x7f8b9015ffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:19:49.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.063+0000 7f8b94dd5640 1 -- 172.21.15.107:0/3082663656 shutdown_connections 2024-05-04T02:19:49.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.063+0000 7f8b94dd5640 1 -- 172.21.15.107:0/3082663656 wait complete. 2024-05-04T02:19:49.076 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd new 2ba3d1b3-c5fa-4ff4-bf5d-772e77d79c59 4 2024-05-04T02:19:49.168 INFO:tasks.ceph.mgr.y.smithi001.stderr:2024-05-04T02:19:49.166+0000 7f5048624040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-04T02:19:49.184 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.182+0000 7f9c58f9d640 1 Processor -- start 2024-05-04T02:19:49.184 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.182+0000 7f9c58f9d640 1 -- start start 2024-05-04T02:19:49.186 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.183+0000 7f9c58f9d640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f9c54150b80 0x7f9c5415d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:19:49.186 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.183+0000 7f9c58f9d640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f9c5415db70 0x7f9c541649c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:19:49.186 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.183+0000 7f9c58f9d640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c5415e380 con 0x7f9c540ca110 2024-05-04T02:19:49.186 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.183+0000 7f9c58f9d640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f9c5406fe00 con 0x7f9c5415db70 2024-05-04T02:19:49.186 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.183+0000 7f9c58f9d640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f9c540c9490 con 0x7f9c54150b80 2024-05-04T02:19:49.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.184+0000 7f9c52ffd640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f9c54150b80 0x7f9c5415d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:19:49.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.184+0000 7f9c53fff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f9c5415db70 0x7f9c541649c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:19:49.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.184+0000 7f9c53fff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f9c5415db70 0x7f9c541649c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.107:41542/0 (socket says 172.21.15.107:41542) 2024-05-04T02:19:49.187 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.184+0000 7f9c53fff640 1 -- 172.21.15.107:0/2456774985 learned_addr learned my addr 172.21.15.107:0/2456774985 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-04T02:19:49.189 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.187+0000 7f9c53fff640 1 -- 172.21.15.107:0/2456774985 >> v2:172.21.15.107:3300/0 conn(0x7f9c54150b80 msgr2=0x7f9c5415d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:19:49.189 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.187+0000 7f9c53fff640 1 --2- 172.21.15.107:0/2456774985 >> v2:172.21.15.107:3300/0 conn(0x7f9c54150b80 0x7f9c5415d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:49.189 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.187+0000 7f9c53fff640 1 -- 172.21.15.107:0/2456774985 >> v1:172.21.15.107:6789/0 conn(0x7f9c540ca110 legacy=0x7f9c5406f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:19:49.190 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.187+0000 7f9c53fff640 1 -- 172.21.15.107:0/2456774985 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c540c9770 con 0x7f9c5415db70 2024-05-04T02:19:49.191 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.189+0000 7f9c53fff640 1 --2- 172.21.15.107:0/2456774985 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9c5415db70 0x7f9c541649c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9c54072fb0 tx=0x7f9c4c02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0fb19cd26cc1efc server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:19:49.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.194+0000 7f9c527fc640 1 -- 172.21.15.107:0/2456774985 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c4c036070 con 0x7f9c5415db70 2024-05-04T02:19:49.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.194+0000 7f9c527fc640 1 -- 172.21.15.107:0/2456774985 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c4c031600 con 0x7f9c5415db70 2024-05-04T02:19:49.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.194+0000 7f9c527fc640 1 -- 172.21.15.107:0/2456774985 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c4c0319d0 con 0x7f9c5415db70 2024-05-04T02:19:49.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.195+0000 7f9c58f9d640 1 -- 172.21.15.107:0/2456774985 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9c5415db70 msgr2=0x7f9c541649c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:19:49.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.195+0000 7f9c58f9d640 1 --2- 172.21.15.107:0/2456774985 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9c5415db70 0x7f9c541649c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9c54072fb0 tx=0x7f9c4c02a730 comp rx=0 tx=0).stop 2024-05-04T02:19:49.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.195+0000 7f9c58f9d640 1 -- 172.21.15.107:0/2456774985 shutdown_connections 2024-05-04T02:19:49.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.195+0000 7f9c58f9d640 1 --2- 172.21.15.107:0/2456774985 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9c5415db70 0x7f9c541649c0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:49.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.195+0000 7f9c58f9d640 1 --2- 172.21.15.107:0/2456774985 >> v2:172.21.15.107:3300/0 conn(0x7f9c54150b80 0x7f9c5415d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:49.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.195+0000 7f9c58f9d640 1 -- 172.21.15.107:0/2456774985 >> 172.21.15.107:0/2456774985 conn(0x7f9c540ca9a0 msgr2=0x7f9c540cadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:19:49.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.195+0000 7f9c58f9d640 1 -- 172.21.15.107:0/2456774985 shutdown_connections 2024-05-04T02:19:49.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.195+0000 7f9c58f9d640 1 -- 172.21.15.107:0/2456774985 wait complete. 2024-05-04T02:19:49.199 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.197+0000 7f9c58f9d640 1 Processor -- start 2024-05-04T02:19:49.199 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.197+0000 7f9c58f9d640 1 -- start start 2024-05-04T02:19:49.201 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.198+0000 7f9c58f9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9c540ca110 0x7f9c540cd860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:19:49.201 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.198+0000 7f9c58f9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c54150b80 0x7f9c540ccaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:19:49.201 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.198+0000 7f9c58f9d640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c5415db70 0x7f9c540c2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:19:49.201 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.198+0000 7f9c58f9d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9c540c9be0 con 0x7f9c540ca110 2024-05-04T02:19:49.201 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.198+0000 7f9c58f9d640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f9c5406e000 con 0x7f9c54150b80 2024-05-04T02:19:49.201 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.198+0000 7f9c58f9d640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f9c5406e520 con 0x7f9c5415db70 2024-05-04T02:19:49.202 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.199+0000 7f9c52ffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c54150b80 0x7f9c540ccaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:19:49.202 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.199+0000 7f9c53fff640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c5415db70 0x7f9c540c2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:19:49.202 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.199+0000 7f9c537fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9c540ca110 0x7f9c540cd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:19:49.202 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.199+0000 7f9c52ffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c54150b80 0x7f9c540ccaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:46036/0 (socket says 172.21.15.107:46036) 2024-05-04T02:19:49.202 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.199+0000 7f9c52ffd640 1 -- 172.21.15.107:0/1219751374 learned_addr learned my addr 172.21.15.107:0/1219751374 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-04T02:19:49.206 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.203+0000 7f9c52ffd640 1 -- 172.21.15.107:0/1219751374 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c5415db70 msgr2=0x7f9c540c2fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:19:49.206 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.203+0000 7f9c52ffd640 1 --2- 172.21.15.107:0/1219751374 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c5415db70 0x7f9c540c2fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:49.206 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.203+0000 7f9c52ffd640 1 -- 172.21.15.107:0/1219751374 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9c540ca110 msgr2=0x7f9c540cd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:19:49.206 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.203+0000 7f9c52ffd640 1 --2- 172.21.15.107:0/1219751374 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9c540ca110 0x7f9c540cd860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:49.206 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.203+0000 7f9c52ffd640 1 -- 172.21.15.107:0/1219751374 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c540c3500 con 0x7f9c54150b80 2024-05-04T02:19:49.208 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.206+0000 7f9c52ffd640 1 --2- 172.21.15.107:0/1219751374 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c54150b80 0x7f9c540ccaa0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9c4800e840 tx=0x7f9c4800ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:19:49.213 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.210+0000 7f9c3bfff640 1 -- 172.21.15.107:0/1219751374 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c48017070 con 0x7f9c54150b80 2024-05-04T02:19:49.213 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.210+0000 7f9c3bfff640 1 -- 172.21.15.107:0/1219751374 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c4800c940 con 0x7f9c54150b80 2024-05-04T02:19:49.213 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.210+0000 7f9c3bfff640 1 -- 172.21.15.107:0/1219751374 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c4800cd10 con 0x7f9c54150b80 2024-05-04T02:19:49.213 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.210+0000 7f9c58f9d640 1 -- 172.21.15.107:0/1219751374 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c540cc6c0 con 0x7f9c54150b80 2024-05-04T02:19:49.213 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.210+0000 7f9c58f9d640 1 -- 172.21.15.107:0/1219751374 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c5415d2c0 con 0x7f9c54150b80 2024-05-04T02:19:49.213 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.211+0000 7f9c58f9d640 1 -- 172.21.15.107:0/1219751374 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c540cc430 con 0x7f9c54150b80 2024-05-04T02:19:49.216 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.213+0000 7f9c3bfff640 1 -- 172.21.15.107:0/1219751374 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9c4801a070 con 0x7f9c54150b80 2024-05-04T02:19:49.216 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.214+0000 7f9c3bfff640 1 -- 172.21.15.107:0/1219751374 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f9c48006550 con 0x7f9c54150b80 2024-05-04T02:19:49.323 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.320+0000 7f9c3bfff640 1 -- 172.21.15.107:0/1219751374 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f9c48006750 con 0x7f9c54150b80 2024-05-04T02:19:49.333 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-04T02:19:49.331+0000 7f0b43a14040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-04T02:19:49.382 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-04T02:19:49.380+0000 7f0b43a14040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-04T02:19:49.397 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.395+0000 7f9c58f9d640 1 -- 172.21.15.107:0/1219751374 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2ba3d1b3-c5fa-4ff4-bf5d-772e77d79c59", "id": 4} v 0) -- 0x7f9c540762f0 con 0x7f9c54150b80 2024-05-04T02:19:49.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.472+0000 7f9c3bfff640 1 -- 172.21.15.107:0/1219751374 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2ba3d1b3-c5fa-4ff4-bf5d-772e77d79c59", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f9c48005990 con 0x7f9c54150b80 2024-05-04T02:19:49.474 INFO:teuthology.orchestra.run.smithi107.stdout:4 2024-05-04T02:19:49.475 INFO:tasks.ceph.mgr.y.smithi001.stderr:2024-05-04T02:19:49.472+0000 7f5048624040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-04T02:19:49.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.473+0000 7f9c58f9d640 1 -- 172.21.15.107:0/1219751374 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c54150b80 msgr2=0x7f9c540ccaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:19:49.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.473+0000 7f9c58f9d640 1 --2- 172.21.15.107:0/1219751374 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c54150b80 0x7f9c540ccaa0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9c4800e840 tx=0x7f9c4800ed00 comp rx=0 tx=0).stop 2024-05-04T02:19:49.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.473+0000 7f9c58f9d640 1 -- 172.21.15.107:0/1219751374 shutdown_connections 2024-05-04T02:19:49.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.473+0000 7f9c58f9d640 1 --2- 172.21.15.107:0/1219751374 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c5415db70 0x7f9c540c2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:49.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.473+0000 7f9c58f9d640 1 --2- 172.21.15.107:0/1219751374 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c54150b80 0x7f9c540ccaa0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:49.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.473+0000 7f9c58f9d640 1 --2- 172.21.15.107:0/1219751374 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9c540ca110 0x7f9c540cd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:49.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.473+0000 7f9c58f9d640 1 -- 172.21.15.107:0/1219751374 >> 172.21.15.107:0/1219751374 conn(0x7f9c540ca9a0 msgr2=0x7f9c540716d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:19:49.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.473+0000 7f9c58f9d640 1 -- 172.21.15.107:0/1219751374 shutdown_connections 2024-05-04T02:19:49.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.473+0000 7f9c58f9d640 1 -- 172.21.15.107:0/1219751374 wait complete. 2024-05-04T02:19:49.490 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd new c42646eb-6e14-4b42-a7a3-54f99f1662bb 5 2024-05-04T02:19:49.527 INFO:tasks.ceph.mgr.y.smithi001.stderr:2024-05-04T02:19:49.525+0000 7f5048624040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-04T02:19:49.554 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-04T02:19:49.552+0000 7f0b43a14040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-04T02:19:49.598 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.595+0000 7f1198d57640 1 Processor -- start 2024-05-04T02:19:49.598 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.596+0000 7f1198d57640 1 -- start start 2024-05-04T02:19:49.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.597+0000 7f1198d57640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f119406f0a0 0x7f1194156580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:19:49.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.597+0000 7f1198d57640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f119415fa50 0x7f119415fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:19:49.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.597+0000 7f1198d57640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f11940708b0 0x7f1194070cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:19:49.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.597+0000 7f1198d57640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f119415c5c0 con 0x7f119406f0a0 2024-05-04T02:19:49.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.597+0000 7f1198d57640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f119406f6c0 con 0x7f119415fa50 2024-05-04T02:19:49.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.597+0000 7f1198d57640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f119415d310 con 0x7f11940708b0 2024-05-04T02:19:49.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.597+0000 7f118bfff640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f119415fa50 0x7f119415fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:19:49.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.598+0000 7f1192d9d640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f11940708b0 0x7f1194070cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:19:49.600 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.598+0000 7f119259c640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f119406f0a0 0x7f1194156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:19:49.601 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.598+0000 7f118bfff640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f119415fa50 0x7f119415fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:46048/0 (socket says 172.21.15.107:46048) 2024-05-04T02:19:49.601 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.598+0000 7f118bfff640 1 -- 172.21.15.107:0/3184287757 learned_addr learned my addr 172.21.15.107:0/3184287757 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-04T02:19:49.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.600+0000 7f118bfff640 1 -- 172.21.15.107:0/3184287757 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f11940708b0 msgr2=0x7f1194070cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:19:49.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.600+0000 7f118bfff640 1 --2- 172.21.15.107:0/3184287757 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f11940708b0 0x7f1194070cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:49.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.600+0000 7f118bfff640 1 -- 172.21.15.107:0/3184287757 >> v2:172.21.15.1:3300/0 conn(0x7f119406f0a0 msgr2=0x7f1194156580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:19:49.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.600+0000 7f118bfff640 1 --2- 172.21.15.107:0/3184287757 >> v2:172.21.15.1:3300/0 conn(0x7f119406f0a0 0x7f1194156580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:49.603 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.600+0000 7f118bfff640 1 -- 172.21.15.107:0/3184287757 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f119415c830 con 0x7f119415fa50 2024-05-04T02:19:49.605 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.602+0000 7f118bfff640 1 --2- 172.21.15.107:0/3184287757 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f119415fa50 0x7f119415fe60 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1194070550 tx=0x7f117c02a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0547f04d56f5a92 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:19:49.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.606+0000 7f1191d9b640 1 -- 172.21.15.107:0/3184287757 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f117c037070 con 0x7f119415fa50 2024-05-04T02:19:49.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.606+0000 7f1191d9b640 1 -- 172.21.15.107:0/3184287757 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f117c032440 con 0x7f119415fa50 2024-05-04T02:19:49.609 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.606+0000 7f1191d9b640 1 -- 172.21.15.107:0/3184287757 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f117c032810 con 0x7f119415fa50 2024-05-04T02:19:49.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.607+0000 7f1198d57640 1 -- 172.21.15.107:0/3184287757 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f119415fa50 msgr2=0x7f119415fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:19:49.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.607+0000 7f1198d57640 1 --2- 172.21.15.107:0/3184287757 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f119415fa50 0x7f119415fe60 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1194070550 tx=0x7f117c02a1e0 comp rx=0 tx=0).stop 2024-05-04T02:19:49.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.607+0000 7f1198d57640 1 -- 172.21.15.107:0/3184287757 shutdown_connections 2024-05-04T02:19:49.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.607+0000 7f1198d57640 1 --2- 172.21.15.107:0/3184287757 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f11940708b0 0x7f1194070cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:49.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.607+0000 7f1198d57640 1 --2- 172.21.15.107:0/3184287757 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f119415fa50 0x7f119415fe60 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:49.610 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.607+0000 7f1198d57640 1 --2- 172.21.15.107:0/3184287757 >> v2:172.21.15.1:3300/0 conn(0x7f119406f0a0 0x7f1194156580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:49.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.607+0000 7f1198d57640 1 -- 172.21.15.107:0/3184287757 >> 172.21.15.107:0/3184287757 conn(0x7f11940cb8e0 msgr2=0x7f11940ce5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:19:49.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.607+0000 7f1198d57640 1 -- 172.21.15.107:0/3184287757 shutdown_connections 2024-05-04T02:19:49.611 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.607+0000 7f1198d57640 1 -- 172.21.15.107:0/3184287757 wait complete. 2024-05-04T02:19:49.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.609+0000 7f1198d57640 1 Processor -- start 2024-05-04T02:19:49.612 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.610+0000 7f1198d57640 1 -- start start 2024-05-04T02:19:49.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.611+0000 7f1198d57640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f119406f0a0 0x7f11941f5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:19:49.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.611+0000 7f1198d57640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f11940708b0 0x7f119415f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:19:49.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.611+0000 7f1198d57640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f119415fa50 0x7f1194147fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:19:49.613 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.611+0000 7f1198d57640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f119406f980 con 0x7f119406f0a0 2024-05-04T02:19:49.614 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.611+0000 7f1198d57640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f119415cdf0 con 0x7f11940708b0 2024-05-04T02:19:49.614 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.611+0000 7f1198d57640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f11940cc3b0 con 0x7f119415fa50 2024-05-04T02:19:49.614 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.611+0000 7f119259c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f119406f0a0 0x7f11941f5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:19:49.615 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.611+0000 7f118bfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f11940708b0 0x7f119415f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:19:49.615 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.611+0000 7f1192d9d640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f119415fa50 0x7f1194147fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:19:49.615 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.612+0000 7f118bfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f11940708b0 0x7f119415f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:46050/0 (socket says 172.21.15.107:46050) 2024-05-04T02:19:49.615 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.612+0000 7f118bfff640 1 -- 172.21.15.107:0/645205926 learned_addr learned my addr 172.21.15.107:0/645205926 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-04T02:19:49.618 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.616+0000 7f118bfff640 1 -- 172.21.15.107:0/645205926 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f119415fa50 msgr2=0x7f1194147fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:19:49.618 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.616+0000 7f118bfff640 1 --2- 172.21.15.107:0/645205926 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f119415fa50 0x7f1194147fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:49.618 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.616+0000 7f118bfff640 1 -- 172.21.15.107:0/645205926 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f119406f0a0 msgr2=0x7f11941f5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:19:49.618 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.616+0000 7f118bfff640 1 --2- 172.21.15.107:0/645205926 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f119406f0a0 0x7f11941f5840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:49.618 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.616+0000 7f118bfff640 1 -- 172.21.15.107:0/645205926 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f119414f450 con 0x7f11940708b0 2024-05-04T02:19:49.620 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.618+0000 7f118bfff640 1 --2- 172.21.15.107:0/645205926 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f11940708b0 0x7f119415f040 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f117c000c00 tx=0x7f117c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:19:49.624 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.622+0000 7f118affd640 1 -- 172.21.15.107:0/645205926 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f117c041020 con 0x7f11940708b0 2024-05-04T02:19:49.624 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.622+0000 7f118affd640 1 -- 172.21.15.107:0/645205926 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f117c03d6e0 con 0x7f11940708b0 2024-05-04T02:19:49.625 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.622+0000 7f118affd640 1 -- 172.21.15.107:0/645205926 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f117c037040 con 0x7f11940708b0 2024-05-04T02:19:49.625 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.622+0000 7f1198d57640 1 -- 172.21.15.107:0/645205926 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f119414dea0 con 0x7f11940708b0 2024-05-04T02:19:49.625 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.622+0000 7f1198d57640 1 -- 172.21.15.107:0/645205926 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f119414f100 con 0x7f11940708b0 2024-05-04T02:19:49.625 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.623+0000 7f1198d57640 1 -- 172.21.15.107:0/645205926 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1194063fb0 con 0x7f11940708b0 2024-05-04T02:19:49.696 INFO:tasks.ceph.mgr.y.smithi001.stderr:2024-05-04T02:19:49.694+0000 7f5048624040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-04T02:19:49.697 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-04T02:19:49.694+0000 7f0b43a14040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-04T02:19:49.731 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.728+0000 7f118affd640 1 -- 172.21.15.107:0/645205926 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f117c044020 con 0x7f11940708b0 2024-05-04T02:19:49.731 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.728+0000 7f118affd640 1 -- 172.21.15.107:0/645205926 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f117c04fc20 con 0x7f11940708b0 2024-05-04T02:19:49.731 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.728+0000 7f118affd640 1 -- 172.21.15.107:0/645205926 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f117c04b030 con 0x7f11940708b0 2024-05-04T02:19:49.749 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-04T02:19:49.746+0000 7f0b43a14040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-04T02:19:49.808 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.805+0000 7f1198d57640 1 -- 172.21.15.107:0/645205926 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c42646eb-6e14-4b42-a7a3-54f99f1662bb", "id": 5} v 0) -- 0x7f1194076740 con 0x7f11940708b0 2024-05-04T02:19:49.828 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-04T02:19:49.825+0000 7f0b43a14040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-04T02:19:49.845 INFO:tasks.ceph.mgr.y.smithi001.stderr:2024-05-04T02:19:49.843+0000 7f5048624040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-04T02:19:49.874 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-04T02:19:49.872+0000 7f0b43a14040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-04T02:19:49.900 INFO:tasks.ceph.mgr.y.smithi001.stderr:2024-05-04T02:19:49.899+0000 7f5048624040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-04T02:19:49.918 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.916+0000 7f118affd640 1 -- 172.21.15.107:0/645205926 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c42646eb-6e14-4b42-a7a3-54f99f1662bb", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f117c04f430 con 0x7f11940708b0 2024-05-04T02:19:49.918 INFO:teuthology.orchestra.run.smithi107.stdout:5 2024-05-04T02:19:49.919 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.917+0000 7f1198d57640 1 -- 172.21.15.107:0/645205926 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f11940708b0 msgr2=0x7f119415f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:19:49.920 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.917+0000 7f1198d57640 1 --2- 172.21.15.107:0/645205926 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f11940708b0 0x7f119415f040 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f117c000c00 tx=0x7f117c0046c0 comp rx=0 tx=0).stop 2024-05-04T02:19:49.920 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.917+0000 7f1198d57640 1 -- 172.21.15.107:0/645205926 shutdown_connections 2024-05-04T02:19:49.920 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.917+0000 7f1198d57640 1 --2- 172.21.15.107:0/645205926 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f119415fa50 0x7f1194147fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:49.920 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.917+0000 7f1198d57640 1 --2- 172.21.15.107:0/645205926 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f11940708b0 0x7f119415f040 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:49.920 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.917+0000 7f1198d57640 1 --2- 172.21.15.107:0/645205926 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f119406f0a0 0x7f11941f5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:49.920 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.917+0000 7f1198d57640 1 -- 172.21.15.107:0/645205926 >> 172.21.15.107:0/645205926 conn(0x7f11940cb8e0 msgr2=0x7f1194070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:19:49.920 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.917+0000 7f1198d57640 1 -- 172.21.15.107:0/645205926 shutdown_connections 2024-05-04T02:19:49.920 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:49.917+0000 7f1198d57640 1 -- 172.21.15.107:0/645205926 wait complete. 2024-05-04T02:19:49.930 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd new a8a2dbb8-0107-4b8e-93c3-5fa7e6af15a3 6 2024-05-04T02:19:49.976 INFO:tasks.ceph.mgr.y.smithi001.stderr:2024-05-04T02:19:49.974+0000 7f5048624040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-04T02:19:50.024 INFO:tasks.ceph.mgr.y.smithi001.stderr:2024-05-04T02:19:50.022+0000 7f5048624040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-04T02:19:50.038 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.036+0000 7f30393ce640 1 Processor -- start 2024-05-04T02:19:50.039 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.036+0000 7f30393ce640 1 -- start start 2024-05-04T02:19:50.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.037+0000 7f30393ce640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f3034070d40 0x7f303415d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:19:50.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.037+0000 7f30393ce640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f303415de70 0x7f30340cc760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:19:50.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.037+0000 7f30393ce640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f303415b310 con 0x7f30341547a0 2024-05-04T02:19:50.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.037+0000 7f30393ce640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f30340cc090 con 0x7f3034070d40 2024-05-04T02:19:50.040 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.037+0000 7f30393ce640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f30340cbdb0 con 0x7f303415de70 2024-05-04T02:19:50.041 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.037+0000 7f30337fe640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f303415de70 0x7f30340cc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:19:50.041 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.038+0000 7f302bfff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f3034070d40 0x7f303415d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:19:50.041 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.038+0000 7f30337fe640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f303415de70 0x7f30340cc760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:46058/0 (socket says 172.21.15.107:46058) 2024-05-04T02:19:50.041 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.038+0000 7f30337fe640 1 -- 172.21.15.107:0/933947574 learned_addr learned my addr 172.21.15.107:0/933947574 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-04T02:19:50.043 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.041+0000 7f302bfff640 1 -- 172.21.15.107:0/933947574 >> v2:172.21.15.107:3300/0 conn(0x7f303415de70 msgr2=0x7f30340cc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:19:50.044 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.041+0000 7f302bfff640 1 --2- 172.21.15.107:0/933947574 >> v2:172.21.15.107:3300/0 conn(0x7f303415de70 0x7f30340cc760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:50.044 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.041+0000 7f302bfff640 1 -- 172.21.15.107:0/933947574 >> v1:172.21.15.107:6789/0 conn(0x7f30341547a0 legacy=0x7f30340cac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:19:50.044 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.041+0000 7f302bfff640 1 -- 172.21.15.107:0/933947574 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f303415a550 con 0x7f3034070d40 2024-05-04T02:19:50.045 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.043+0000 7f302bfff640 1 --2- 172.21.15.107:0/933947574 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3034070d40 0x7f303415d930 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f303408d960 tx=0x7f301c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b930dcdd8941e23 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:19:50.049 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.047+0000 7f30327fc640 1 -- 172.21.15.107:0/933947574 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f301c037070 con 0x7f3034070d40 2024-05-04T02:19:50.049 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.047+0000 7f30327fc640 1 -- 172.21.15.107:0/933947574 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f301c032440 con 0x7f3034070d40 2024-05-04T02:19:50.049 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.047+0000 7f30327fc640 1 -- 172.21.15.107:0/933947574 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f301c032810 con 0x7f3034070d40 2024-05-04T02:19:50.050 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.048+0000 7f30393ce640 1 -- 172.21.15.107:0/933947574 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3034070d40 msgr2=0x7f303415d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:19:50.050 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.048+0000 7f30393ce640 1 --2- 172.21.15.107:0/933947574 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3034070d40 0x7f303415d930 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f303408d960 tx=0x7f301c02a1a0 comp rx=0 tx=0).stop 2024-05-04T02:19:50.051 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.048+0000 7f30393ce640 1 -- 172.21.15.107:0/933947574 shutdown_connections 2024-05-04T02:19:50.051 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.048+0000 7f30393ce640 1 --2- 172.21.15.107:0/933947574 >> v2:172.21.15.107:3300/0 conn(0x7f303415de70 0x7f30340cc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:50.051 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.048+0000 7f30393ce640 1 --2- 172.21.15.107:0/933947574 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3034070d40 0x7f303415d930 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:50.051 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.048+0000 7f30393ce640 1 -- 172.21.15.107:0/933947574 >> 172.21.15.107:0/933947574 conn(0x7f3034073b10 msgr2=0x7f3034073f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:19:50.051 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.048+0000 7f30393ce640 1 -- 172.21.15.107:0/933947574 shutdown_connections 2024-05-04T02:19:50.051 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.048+0000 7f30393ce640 1 -- 172.21.15.107:0/933947574 wait complete. 2024-05-04T02:19:50.052 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.049+0000 7f30393ce640 1 Processor -- start 2024-05-04T02:19:50.052 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.049+0000 7f30393ce640 1 -- start start 2024-05-04T02:19:50.053 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.051+0000 7f30393ce640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3034070d40 0x7f30341e58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:19:50.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.051+0000 7f30393ce640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30341547a0 0x7f3034155880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:19:50.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.051+0000 7f30393ce640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f303415de70 0x7f30341e3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:19:50.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.051+0000 7f30393ce640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f303415adf0 con 0x7f30341547a0 2024-05-04T02:19:50.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.051+0000 7f30393ce640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f303415ab10 con 0x7f3034070d40 2024-05-04T02:19:50.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.051+0000 7f30393ce640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f30340cb9e0 con 0x7f303415de70 2024-05-04T02:19:50.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.051+0000 7f3032ffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3034070d40 0x7f30341e58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:19:50.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.051+0000 7f302bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30341547a0 0x7f3034155880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:19:50.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.051+0000 7f30337fe640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f303415de70 0x7f30341e3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:19:50.054 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.051+0000 7f302bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30341547a0 0x7f3034155880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.107:41594/0 (socket says 172.21.15.107:41594) 2024-05-04T02:19:50.055 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.052+0000 7f302bfff640 1 -- 172.21.15.107:0/2740838509 learned_addr learned my addr 172.21.15.107:0/2740838509 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-04T02:19:50.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.055+0000 7f3032ffd640 1 -- 172.21.15.107:0/2740838509 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f303415de70 msgr2=0x7f30341e3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:19:50.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.055+0000 7f3032ffd640 1 --2- 172.21.15.107:0/2740838509 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f303415de70 0x7f30341e3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:50.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.055+0000 7f3032ffd640 1 -- 172.21.15.107:0/2740838509 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30341547a0 msgr2=0x7f3034155880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:19:50.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.055+0000 7f3032ffd640 1 --2- 172.21.15.107:0/2740838509 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30341547a0 0x7f3034155880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:50.058 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.055+0000 7f3032ffd640 1 -- 172.21.15.107:0/2740838509 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3034157610 con 0x7f3034070d40 2024-05-04T02:19:50.059 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.055+0000 7f302bfff640 1 --2- 172.21.15.107:0/2740838509 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30341547a0 0x7f3034155880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-04T02:19:50.060 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.058+0000 7f3032ffd640 1 --2- 172.21.15.107:0/2740838509 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3034070d40 0x7f30341e58e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f302400c3c0 tx=0x7f302400c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:19:50.062 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.060+0000 7f302b7fe640 1 -- 172.21.15.107:0/2740838509 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3024017070 con 0x7f3034070d40 2024-05-04T02:19:50.063 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.060+0000 7f30393ce640 1 -- 172.21.15.107:0/2740838509 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30341578d0 con 0x7f3034070d40 2024-05-04T02:19:50.063 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.060+0000 7f30393ce640 1 -- 172.21.15.107:0/2740838509 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3034154c30 con 0x7f3034070d40 2024-05-04T02:19:50.063 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.061+0000 7f30393ce640 1 -- 172.21.15.107:0/2740838509 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f303415b8b0 con 0x7f3034070d40 2024-05-04T02:19:50.064 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.061+0000 7f302b7fe640 1 -- 172.21.15.107:0/2740838509 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30240052d0 con 0x7f3034070d40 2024-05-04T02:19:50.064 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.061+0000 7f302b7fe640 1 -- 172.21.15.107:0/2740838509 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3024007240 con 0x7f3034070d40 2024-05-04T02:19:50.171 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.169+0000 7f302b7fe640 1 -- 172.21.15.107:0/2740838509 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f302401a070 con 0x7f3034070d40 2024-05-04T02:19:50.172 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.169+0000 7f302b7fe640 1 -- 172.21.15.107:0/2740838509 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f3024003c30 con 0x7f3034070d40 2024-05-04T02:19:50.172 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.169+0000 7f302b7fe640 1 -- 172.21.15.107:0/2740838509 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f303415b8b0 con 0x7f3034070d40 2024-05-04T02:19:50.244 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.242+0000 7f30393ce640 1 -- 172.21.15.107:0/2740838509 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a8a2dbb8-0107-4b8e-93c3-5fa7e6af15a3", "id": 6} v 0) -- 0x7f3034076740 con 0x7f3034070d40 2024-05-04T02:19:50.350 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.348+0000 7f302b7fe640 1 -- 172.21.15.107:0/2740838509 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a8a2dbb8-0107-4b8e-93c3-5fa7e6af15a3", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f3024021080 con 0x7f3034070d40 2024-05-04T02:19:50.351 INFO:teuthology.orchestra.run.smithi107.stdout:6 2024-05-04T02:19:50.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.349+0000 7f30393ce640 1 -- 172.21.15.107:0/2740838509 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3034070d40 msgr2=0x7f30341e58e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:19:50.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.349+0000 7f30393ce640 1 --2- 172.21.15.107:0/2740838509 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3034070d40 0x7f30341e58e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f302400c3c0 tx=0x7f302400c880 comp rx=0 tx=0).stop 2024-05-04T02:19:50.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.349+0000 7f30393ce640 1 -- 172.21.15.107:0/2740838509 shutdown_connections 2024-05-04T02:19:50.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.349+0000 7f30393ce640 1 --2- 172.21.15.107:0/2740838509 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f303415de70 0x7f30341e3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:50.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.349+0000 7f30393ce640 1 --2- 172.21.15.107:0/2740838509 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f30341547a0 0x7f3034155880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:50.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.349+0000 7f30393ce640 1 --2- 172.21.15.107:0/2740838509 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3034070d40 0x7f30341e58e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:50.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.349+0000 7f30393ce640 1 -- 172.21.15.107:0/2740838509 >> 172.21.15.107:0/2740838509 conn(0x7f3034073b10 msgr2=0x7f303415c570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:19:50.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.349+0000 7f30393ce640 1 -- 172.21.15.107:0/2740838509 shutdown_connections 2024-05-04T02:19:50.352 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.349+0000 7f30393ce640 1 -- 172.21.15.107:0/2740838509 wait complete. 2024-05-04T02:19:50.362 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd new 3b9bdc70-8831-4df9-8d50-362aa0f02aed 7 2024-05-04T02:19:50.403 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-04T02:19:50.400+0000 7f0b43a14040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-04T02:19:50.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.467+0000 7ff807cd1640 1 Processor -- start 2024-05-04T02:19:50.470 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.467+0000 7ff807cd1640 1 -- start start 2024-05-04T02:19:50.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.469+0000 7ff807cd1640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff80015c4a0 0x7ff80015c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:19:50.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.469+0000 7ff807cd1640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff80015cdf0 0x7ff800166de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:19:50.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.469+0000 7ff807cd1640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8000cd3b0 con 0x7ff8000cdcf0 2024-05-04T02:19:50.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.469+0000 7ff807cd1640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7ff8000b74b0 con 0x7ff80015cdf0 2024-05-04T02:19:50.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.469+0000 7ff807cd1640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff80006d1a0 con 0x7ff80015c4a0 2024-05-04T02:19:50.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.470+0000 7ff80526c640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff80015c4a0 0x7ff80015c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:19:50.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.470+0000 7ff805a6d640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7ff8000cdcf0 0x7ff80006d9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:52254/0 (socket says 172.21.15.107:52254) 2024-05-04T02:19:50.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.470+0000 7ff805a6d640 1 -- 172.21.15.107:0/1336170177 learned_addr learned my addr 172.21.15.107:0/1336170177 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-05-04T02:19:50.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.470+0000 7ff80626e640 1 --2- 172.21.15.107:0/1336170177 >> v2:172.21.15.1:3300/0 conn(0x7ff80015cdf0 0x7ff800166de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:19:50.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.473+0000 7ff804a6b640 1 -- 172.21.15.107:0/1336170177 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1904831146 0 0) 0x7ff8000cd3b0 con 0x7ff8000cdcf0 2024-05-04T02:19:50.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.473+0000 7ff804a6b640 1 -- 172.21.15.107:0/1336170177 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff7ec003520 con 0x7ff8000cdcf0 2024-05-04T02:19:50.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.473+0000 7ff80626e640 1 -- 172.21.15.107:0/1336170177 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff80015c4a0 msgr2=0x7ff80015c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:19:50.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.473+0000 7ff80626e640 1 --2- 172.21.15.107:0/1336170177 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff80015c4a0 0x7ff80015c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:50.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.473+0000 7ff80626e640 1 -- 172.21.15.107:0/1336170177 >> v1:172.21.15.107:6789/0 conn(0x7ff8000cdcf0 legacy=0x7ff80006d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:19:50.476 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.473+0000 7ff80626e640 1 -- 172.21.15.107:0/1336170177 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff80006d480 con 0x7ff80015cdf0 2024-05-04T02:19:50.477 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.475+0000 7ff80626e640 1 --2- 172.21.15.107:0/1336170177 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff80015cdf0 0x7ff800166de0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff7f8009d90 tx=0x7ff7f802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76e24c3d2a6f4478 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:19:50.482 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.479+0000 7ff804a6b640 1 -- 172.21.15.107:0/1336170177 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7f8007740 con 0x7ff80015cdf0 2024-05-04T02:19:50.482 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.479+0000 7ff804a6b640 1 -- 172.21.15.107:0/1336170177 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7f80078e0 con 0x7ff80015cdf0 2024-05-04T02:19:50.482 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.479+0000 7ff804a6b640 1 -- 172.21.15.107:0/1336170177 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7f8007cb0 con 0x7ff80015cdf0 2024-05-04T02:19:50.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.480+0000 7ff807cd1640 1 -- 172.21.15.107:0/1336170177 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff80015cdf0 msgr2=0x7ff800166de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:19:50.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.480+0000 7ff807cd1640 1 --2- 172.21.15.107:0/1336170177 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff80015cdf0 0x7ff800166de0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff7f8009d90 tx=0x7ff7f802a6f0 comp rx=0 tx=0).stop 2024-05-04T02:19:50.483 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.480+0000 7ff807cd1640 1 -- 172.21.15.107:0/1336170177 shutdown_connections 2024-05-04T02:19:50.484 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.480+0000 7ff807cd1640 1 --2- 172.21.15.107:0/1336170177 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff80015cdf0 0x7ff800166de0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:50.484 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.480+0000 7ff807cd1640 1 --2- 172.21.15.107:0/1336170177 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff80015c4a0 0x7ff80015c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:50.484 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.480+0000 7ff807cd1640 1 -- 172.21.15.107:0/1336170177 >> 172.21.15.107:0/1336170177 conn(0x7ff8000ce960 msgr2=0x7ff80008cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:19:50.484 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.481+0000 7ff807cd1640 1 -- 172.21.15.107:0/1336170177 shutdown_connections 2024-05-04T02:19:50.484 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.481+0000 7ff807cd1640 1 -- 172.21.15.107:0/1336170177 wait complete. 2024-05-04T02:19:50.486 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.483+0000 7ff807cd1640 1 Processor -- start 2024-05-04T02:19:50.486 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.483+0000 7ff807cd1640 1 -- start start 2024-05-04T02:19:50.489 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.485+0000 7ff807cd1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8000cdcf0 0x7ff8000d1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:19:50.489 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.485+0000 7ff807cd1640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff80015c4a0 0x7ff80008d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:19:50.489 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.486+0000 7ff807cd1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff80015cdf0 0x7ff80014e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:19:50.489 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.486+0000 7ff807cd1640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff8000cd7c0 con 0x7ff8000cdcf0 2024-05-04T02:19:50.489 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.486+0000 7ff807cd1640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff8000b7790 con 0x7ff80015cdf0 2024-05-04T02:19:50.489 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.486+0000 7ff807cd1640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff80015d950 con 0x7ff80015c4a0 2024-05-04T02:19:50.489 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.486+0000 7ff80626e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff80015cdf0 0x7ff80014e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:19:50.489 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.486+0000 7ff80526c640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff80015c4a0 0x7ff80008d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:19:50.489 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.486+0000 7ff805a6d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8000cdcf0 0x7ff8000d1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:19:50.489 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.486+0000 7ff80626e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff80015cdf0 0x7ff80014e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:46078/0 (socket says 172.21.15.107:46078) 2024-05-04T02:19:50.489 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.486+0000 7ff80626e640 1 -- 172.21.15.107:0/2885947999 learned_addr learned my addr 172.21.15.107:0/2885947999 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-05-04T02:19:50.493 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.490+0000 7ff80626e640 1 -- 172.21.15.107:0/2885947999 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff80015c4a0 msgr2=0x7ff80008d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:19:50.493 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.490+0000 7ff80626e640 1 --2- 172.21.15.107:0/2885947999 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff80015c4a0 0x7ff80008d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:50.493 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.490+0000 7ff80626e640 1 -- 172.21.15.107:0/2885947999 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8000cdcf0 msgr2=0x7ff8000d1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:19:50.493 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.490+0000 7ff80626e640 1 --2- 172.21.15.107:0/2885947999 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8000cdcf0 0x7ff8000d1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:50.493 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.490+0000 7ff80626e640 1 -- 172.21.15.107:0/2885947999 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8001f3630 con 0x7ff80015cdf0 2024-05-04T02:19:50.495 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.493+0000 7ff80626e640 1 --2- 172.21.15.107:0/2885947999 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff80015cdf0 0x7ff80014e640 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff7f8009eb0 tx=0x7ff7f8004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:19:50.499 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.496+0000 7ff7f67fc640 1 -- 172.21.15.107:0/2885947999 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7f8040030 con 0x7ff80015cdf0 2024-05-04T02:19:50.499 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.497+0000 7ff807cd1640 1 -- 172.21.15.107:0/2885947999 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8000c8ce0 con 0x7ff80015cdf0 2024-05-04T02:19:50.499 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.497+0000 7ff807cd1640 1 -- 172.21.15.107:0/2885947999 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff80008db90 con 0x7ff80015cdf0 2024-05-04T02:19:50.499 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.497+0000 7ff7f67fc640 1 -- 172.21.15.107:0/2885947999 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7f8007840 con 0x7ff80015cdf0 2024-05-04T02:19:50.500 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.497+0000 7ff7f67fc640 1 -- 172.21.15.107:0/2885947999 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7f804a060 con 0x7ff80015cdf0 2024-05-04T02:19:50.500 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.498+0000 7ff807cd1640 1 -- 172.21.15.107:0/2885947999 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7e8005290 con 0x7ff80015cdf0 2024-05-04T02:19:50.503 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.501+0000 7ff7f67fc640 1 -- 172.21.15.107:0/2885947999 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff7f8043030 con 0x7ff80015cdf0 2024-05-04T02:19:50.503 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.501+0000 7ff7f67fc640 1 -- 172.21.15.107:0/2885947999 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7ff7f803ba70 con 0x7ff80015cdf0 2024-05-04T02:19:50.535 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-04T02:19:50.532+0000 7f0b43a14040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-04T02:19:50.541 INFO:tasks.ceph.mgr.y.smithi001.stderr:2024-05-04T02:19:50.538+0000 7f5048624040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-04T02:19:50.608 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.606+0000 7ff7f67fc640 1 -- 172.21.15.107:0/2885947999 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7ff7f803bcc0 con 0x7ff80015cdf0 2024-05-04T02:19:50.663 INFO:tasks.ceph.mgr.y.smithi001.stderr:2024-05-04T02:19:50.661+0000 7f5048624040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-04T02:19:50.679 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:50.677+0000 7ff807cd1640 1 -- 172.21.15.107:0/2885947999 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3b9bdc70-8831-4df9-8d50-362aa0f02aed", "id": 7} v 0) -- 0x7ff7e8005580 con 0x7ff80015cdf0 2024-05-04T02:19:51.133 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:51.130+0000 7ff7f67fc640 1 -- 172.21.15.107:0/2885947999 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mgrmap(e 2) ==== 49122+0+0 (secure 0 0 0) 0x7ff7f8045410 con 0x7ff80015cdf0 2024-05-04T02:19:51.216 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:51.214+0000 7ff7f67fc640 1 -- 172.21.15.107:0/2885947999 <== mon.1 v2:172.21.15.107:3300/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3b9bdc70-8831-4df9-8d50-362aa0f02aed", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7ff7f804ee10 con 0x7ff80015cdf0 2024-05-04T02:19:51.217 INFO:teuthology.orchestra.run.smithi107.stdout:7 2024-05-04T02:19:51.217 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:51.215+0000 7ff807cd1640 1 -- 172.21.15.107:0/2885947999 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff80015cdf0 msgr2=0x7ff80014e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:19:51.217 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:51.215+0000 7ff807cd1640 1 --2- 172.21.15.107:0/2885947999 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff80015cdf0 0x7ff80014e640 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff7f8009eb0 tx=0x7ff7f8004a40 comp rx=0 tx=0).stop 2024-05-04T02:19:51.218 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:51.215+0000 7ff807cd1640 1 -- 172.21.15.107:0/2885947999 shutdown_connections 2024-05-04T02:19:51.218 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:51.215+0000 7ff807cd1640 1 --2- 172.21.15.107:0/2885947999 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff80015cdf0 0x7ff80014e640 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:51.218 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:51.215+0000 7ff807cd1640 1 --2- 172.21.15.107:0/2885947999 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff80015c4a0 0x7ff80008d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:51.218 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:51.215+0000 7ff807cd1640 1 --2- 172.21.15.107:0/2885947999 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff8000cdcf0 0x7ff8000d1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:51.218 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:51.215+0000 7ff807cd1640 1 -- 172.21.15.107:0/2885947999 >> 172.21.15.107:0/2885947999 conn(0x7ff8000ce960 msgr2=0x7ff80015ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:19:51.218 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:51.215+0000 7ff807cd1640 1 -- 172.21.15.107:0/2885947999 shutdown_connections 2024-05-04T02:19:51.218 INFO:teuthology.orchestra.run.smithi107.stderr:2024-05-04T02:19:51.215+0000 7ff807cd1640 1 -- 172.21.15.107:0/2885947999 wait complete. 2024-05-04T02:19:51.228 INFO:tasks.ceph.osd.0:Restarting daemon 2024-05-04T02:19:51.228 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 0 2024-05-04T02:19:51.231 INFO:tasks.ceph.osd.0:Started 2024-05-04T02:19:51.231 INFO:tasks.ceph.osd.1:Restarting daemon 2024-05-04T02:19:51.231 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 1 2024-05-04T02:19:51.233 INFO:tasks.ceph.osd.1:Started 2024-05-04T02:19:51.233 INFO:tasks.ceph.osd.2:Restarting daemon 2024-05-04T02:19:51.233 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 2 2024-05-04T02:19:51.235 INFO:tasks.ceph.osd.2:Started 2024-05-04T02:19:51.235 INFO:tasks.ceph.osd.3:Restarting daemon 2024-05-04T02:19:51.235 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 3 2024-05-04T02:19:51.240 INFO:tasks.ceph.osd.3:Started 2024-05-04T02:19:51.240 INFO:tasks.ceph.osd.4:Restarting daemon 2024-05-04T02:19:51.240 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 4 2024-05-04T02:19:51.270 INFO:tasks.ceph.osd.4:Started 2024-05-04T02:19:51.271 INFO:tasks.ceph.osd.5:Restarting daemon 2024-05-04T02:19:51.271 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 5 2024-05-04T02:19:51.274 INFO:tasks.ceph.osd.5:Started 2024-05-04T02:19:51.274 INFO:tasks.ceph.osd.6:Restarting daemon 2024-05-04T02:19:51.274 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 6 2024-05-04T02:19:51.276 INFO:tasks.ceph.osd.6:Started 2024-05-04T02:19:51.277 INFO:tasks.ceph.osd.7:Restarting daemon 2024-05-04T02:19:51.277 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 7 2024-05-04T02:19:51.278 INFO:tasks.ceph.osd.7:Started 2024-05-04T02:19:51.279 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-04T02:19:51.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:51.409+0000 7ff21ac97640 1 Processor -- start 2024-05-04T02:19:51.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:51.410+0000 7ff21ac97640 1 -- start start 2024-05-04T02:19:51.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:51.411+0000 7ff21ac97640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff2141546d0 0x7ff21415ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:19:51.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:51.411+0000 7ff21ac97640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff21415d6e0 con 0x7ff2140b5170 2024-05-04T02:19:51.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:51.411+0000 7ff21ac97640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2140ca190 con 0x7ff2140cb4d0 2024-05-04T02:19:51.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:51.411+0000 7ff21ac97640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff21415b370 con 0x7ff2141546d0 2024-05-04T02:19:51.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:51.411+0000 7ff213fff640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff2141546d0 0x7ff21415ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:19:51.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:51.412+0000 7ff219234640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7ff2140cb4d0 0x7ff214164c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.1:60826/0 (socket says 172.21.15.1:60826) 2024-05-04T02:19:51.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:51.412+0000 7ff219234640 1 -- 172.21.15.1:0/453087305 learned_addr learned my addr 172.21.15.1:0/453087305 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-05-04T02:19:51.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:51.414+0000 7ff213fff640 1 -- 172.21.15.1:0/453087305 >> v1:172.21.15.107:6789/0 conn(0x7ff2140cb4d0 legacy=0x7ff214164c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:19:51.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:51.414+0000 7ff213fff640 1 -- 172.21.15.1:0/453087305 >> v1:172.21.15.1:6789/0 conn(0x7ff2140b5170 legacy=0x7ff2140702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:19:51.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:51.414+0000 7ff213fff640 1 -- 172.21.15.1:0/453087305 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2140ca430 con 0x7ff2141546d0 2024-05-04T02:19:51.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:51.417+0000 7ff213fff640 1 --2- 172.21.15.1:0/453087305 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff2141546d0 0x7ff21415ae30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff2000097d0 tx=0x7ff20002a160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe3473bbd2667f3b server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:19:51.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:51.420+0000 7ff2137fe640 1 -- 172.21.15.1:0/453087305 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff200037070 con 0x7ff2141546d0 2024-05-04T02:19:51.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:51.420+0000 7ff2137fe640 1 -- 172.21.15.1:0/453087305 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff200032440 con 0x7ff2141546d0 2024-05-04T02:19:51.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:51.420+0000 7ff2137fe640 1 -- 172.21.15.1:0/453087305 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff200032810 con 0x7ff2141546d0 2024-05-04T02:19:51.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:51.421+0000 7ff21ac97640 1 -- 172.21.15.1:0/453087305 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff2141546d0 msgr2=0x7ff21415ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:19:51.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:51.421+0000 7ff21ac97640 1 --2- 172.21.15.1:0/453087305 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff2141546d0 0x7ff21415ae30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff2000097d0 tx=0x7ff20002a160 comp rx=0 tx=0).stop 2024-05-04T02:19:51.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:51.421+0000 7ff21ac97640 1 -- 172.21.15.1:0/453087305 shutdown_connections 2024-05-04T02:19:51.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:51.421+0000 7ff21ac97640 1 --2- 172.21.15.1:0/453087305 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff2141546d0 0x7ff21415ae30 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:51.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:51.421+0000 7ff21ac97640 1 -- 172.21.15.1:0/453087305 >> 172.21.15.1:0/453087305 conn(0x7ff2140cf6e0 msgr2=0x7ff2140cfaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:19:51.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:51.421+0000 7ff21ac97640 1 -- 172.21.15.1:0/453087305 shutdown_connections 2024-05-04T02:19:51.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:51.421+0000 7ff21ac97640 1 -- 172.21.15.1:0/453087305 wait complete. 2024-05-04T02:19:51.425 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:51.423+0000 7ff21ac97640 1 Processor -- start 2024-05-04T02:19:51.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:51.423+0000 7ff21ac97640 1 -- start start 2024-05-04T02:19:51.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:51.425+0000 7ff21ac97640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff2140b5170 0x7ff214157920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:19:51.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:51.425+0000 7ff21ac97640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2140cb4d0 0x7ff2140b4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:19:51.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:51.425+0000 7ff21ac97640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2141546d0 0x7ff2140b4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:19:51.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:51.425+0000 7ff21ac97640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff2140cacd0 con 0x7ff2141546d0 2024-05-04T02:19:51.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:51.425+0000 7ff21ac97640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff2140ca9f0 con 0x7ff2140cb4d0 2024-05-04T02:19:51.427 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:51.425+0000 7ff21ac97640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff2140cafb0 con 0x7ff2140b5170 2024-05-04T02:19:51.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:51.425+0000 7ff218a33640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff2140b5170 0x7ff214157920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:19:51.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:51.426+0000 7ff218a33640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff2140b5170 0x7ff214157920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.1:54442/0 (socket says 172.21.15.1:54442) 2024-05-04T02:19:51.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:51.426+0000 7ff218a33640 1 -- 172.21.15.1:0/4005917810 learned_addr learned my addr 172.21.15.1:0/4005917810 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:19:51.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:51.426+0000 7ff213fff640 1 --2- 172.21.15.1:0/4005917810 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2140cb4d0 0x7ff2140b4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:19:51.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:51.430+0000 7ff218a33640 1 -- 172.21.15.1:0/4005917810 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2140cb4d0 msgr2=0x7ff2140b4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:19:51.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:51.430+0000 7ff218a33640 1 --2- 172.21.15.1:0/4005917810 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2140cb4d0 0x7ff2140b4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:51.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:51.430+0000 7ff218a33640 1 -- 172.21.15.1:0/4005917810 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2141546d0 msgr2=0x7ff2140b4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:19:51.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:51.430+0000 7ff218a33640 1 --2- 172.21.15.1:0/4005917810 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2141546d0 0x7ff2140b4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:51.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:51.430+0000 7ff218a33640 1 -- 172.21.15.1:0/4005917810 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2141f2f10 con 0x7ff2140b5170 2024-05-04T02:19:51.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:51.434+0000 7ff218a33640 1 --2- 172.21.15.1:0/4005917810 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff2140b5170 0x7ff214157920 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff20800b410 tx=0x7ff20800b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:19:51.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:51.444+0000 7ff2117fa640 1 -- 172.21.15.1:0/4005917810 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff208015020 con 0x7ff2140b5170 2024-05-04T02:19:51.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:51.445+0000 7ff2117fa640 1 -- 172.21.15.1:0/4005917810 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff208011830 con 0x7ff2140b5170 2024-05-04T02:19:51.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:51.445+0000 7ff21ac97640 1 -- 172.21.15.1:0/4005917810 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2141f31f0 con 0x7ff2140b5170 2024-05-04T02:19:51.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:51.445+0000 7ff2117fa640 1 -- 172.21.15.1:0/4005917810 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff208011c20 con 0x7ff2140b5170 2024-05-04T02:19:51.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:51.445+0000 7ff21ac97640 1 -- 172.21.15.1:0/4005917810 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2140ce980 con 0x7ff2140b5170 2024-05-04T02:19:51.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:51.446+0000 7ff21ac97640 1 -- 172.21.15.1:0/4005917810 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff214071710 con 0x7ff2140b5170 2024-05-04T02:19:51.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:51.463+0000 7ff2117fa640 1 -- 172.21.15.1:0/4005917810 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 2) ==== 49122+0+0 (secure 0 0 0) 0x7ff208018020 con 0x7ff2140b5170 2024-05-04T02:19:51.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:51.466+0000 7ff2117fa640 1 -- 172.21.15.1:0/4005917810 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7ff2080035f0 con 0x7ff2140b5170 2024-05-04T02:19:51.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:51.591+0000 7ff2117fa640 1 -- 172.21.15.1:0/4005917810 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7ff214071710 con 0x7ff2140b5170 2024-05-04T02:19:51.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:51.656+0000 7ff21ac97640 1 -- 172.21.15.1:0/4005917810 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff214076740 con 0x7ff2140b5170 2024-05-04T02:19:51.704 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:51.701+0000 7ff2117fa640 1 -- 172.21.15.1:0/4005917810 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7ff20801f070 con 0x7ff2140b5170 2024-05-04T02:19:51.704 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:19:51.704 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":10,"fsid":"b45b4a9a-b84c-4a66-907b-43f0ca45e7c0","created":"2024-05-04T02:19:44.555410+0000","modified":"2024-05-04T02:19:50.811018+0000","last_up_change":"0.000000","last_in_change":"2024-05-04T02:19:50.811018+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d8ad7964-7bd6-4ba9-ae4f-b55d7566b18c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ce155f6d-7e0c-47c8-a0e0-fb53ff0c7726","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7847c281-5da0-4d7d-b888-7f49d99a50b9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"26386eba-d106-4abe-8d6b-7dccdd106cb3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"2ba3d1b3-c5fa-4ff4-bf5d-772e77d79c59","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c42646eb-6e14-4b42-a7a3-54f99f1662bb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a8a2dbb8-0107-4b8e-93c3-5fa7e6af15a3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"3b9bdc70-8831-4df9-8d50-362aa0f02aed","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-04T02:19:51.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:51.702+0000 7ff21ac97640 1 -- 172.21.15.1:0/4005917810 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff2140b5170 msgr2=0x7ff214157920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:19:51.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:51.702+0000 7ff21ac97640 1 --2- 172.21.15.1:0/4005917810 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff2140b5170 0x7ff214157920 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff20800b410 tx=0x7ff20800b8d0 comp rx=0 tx=0).stop 2024-05-04T02:19:51.705 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:51.703+0000 7ff21ac97640 1 -- 172.21.15.1:0/4005917810 shutdown_connections 2024-05-04T02:19:51.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:51.703+0000 7ff21ac97640 1 --2- 172.21.15.1:0/4005917810 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff2141546d0 0x7ff2140b4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:51.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:51.703+0000 7ff21ac97640 1 --2- 172.21.15.1:0/4005917810 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff2140cb4d0 0x7ff2140b4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:51.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:51.703+0000 7ff21ac97640 1 --2- 172.21.15.1:0/4005917810 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff2140b5170 0x7ff214157920 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:51.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:51.703+0000 7ff21ac97640 1 -- 172.21.15.1:0/4005917810 >> 172.21.15.1:0/4005917810 conn(0x7ff2140cf6e0 msgr2=0x7ff21415b720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:19:51.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:51.703+0000 7ff21ac97640 1 -- 172.21.15.1:0/4005917810 shutdown_connections 2024-05-04T02:19:51.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:19:51.703+0000 7ff21ac97640 1 -- 172.21.15.1:0/4005917810 wait complete. 2024-05-04T02:19:51.716 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-05-04T02:19:51.716 INFO:tasks.ceph:Waiting for OSDs to come up 2024-05-04T02:19:51.859 INFO:tasks.ceph.osd.0.smithi001.stderr:2024-05-04T02:19:51.857+0000 7f6082a15640 -1 Falling back to public interface 2024-05-04T02:19:51.878 INFO:tasks.ceph.osd.2.smithi001.stderr:2024-05-04T02:19:51.876+0000 7fc382223640 -1 Falling back to public interface 2024-05-04T02:19:51.901 INFO:tasks.ceph.osd.1.smithi001.stderr:2024-05-04T02:19:51.899+0000 7f79c4e0f640 -1 Falling back to public interface 2024-05-04T02:19:51.915 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-04T02:19:51.913+0000 7fc08ccb3640 -1 Falling back to public interface 2024-05-04T02:19:51.916 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-04T02:19:51.913+0000 7fea38ba5640 -1 Falling back to public interface 2024-05-04T02:19:51.926 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-04T02:19:51.923+0000 7ff503218640 -1 Falling back to public interface 2024-05-04T02:19:51.933 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-04T02:19:51.930+0000 7f564a22e640 -1 Falling back to public interface 2024-05-04T02:19:51.968 INFO:tasks.ceph.osd.3.smithi001.stderr:2024-05-04T02:19:51.966+0000 7fdc9bf26640 -1 Falling back to public interface 2024-05-04T02:19:52.466 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:19:52.469 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:19:52.522 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-04T02:19:52.519+0000 7f0ae30d3640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-05-04T02:19:52.523 DEBUG:teuthology.orchestra.run.smithi001:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-04T02:19:52.596 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-04T02:19:52.594+0000 7f0ae30d3640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-05-04T02:19:52.667 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:52.665+0000 7f346ec92640 1 Processor -- start 2024-05-04T02:19:52.668 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:52.665+0000 7f346ec92640 1 -- start start 2024-05-04T02:19:52.668 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:52.666+0000 7f346ec92640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f346806e170 0x7f34681567e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:19:52.669 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:52.666+0000 7f346ec92640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f34680c9580 0x7f34680c3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:19:52.669 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:52.666+0000 7f346ec92640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34680c5680 con 0x7f34680c9170 2024-05-04T02:19:52.669 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:52.666+0000 7f346ec92640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f346815d1a0 con 0x7f346806e170 2024-05-04T02:19:52.669 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:52.666+0000 7f346ec92640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f34680c5920 con 0x7f34680c9580 2024-05-04T02:19:52.669 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:52.667+0000 7f3467fff640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f34680c9170 0x7f34680c4c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:52188/0 (socket says 172.21.15.1:52188) 2024-05-04T02:19:52.669 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:52.667+0000 7f3467fff640 1 -- 172.21.15.1:0/1949535347 learned_addr learned my addr 172.21.15.1:0/1949535347 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-05-04T02:19:52.672 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:52.670+0000 7f34677fe640 1 -- 172.21.15.1:0/1949535347 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1132959270 0 0) 0x7f34680c5680 con 0x7f34680c9170 2024-05-04T02:19:52.672 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:52.670+0000 7f34677fe640 1 -- 172.21.15.1:0/1949535347 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3458003520 con 0x7f34680c9170 2024-05-04T02:19:52.677 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:52.674+0000 7f34677fe640 1 -- 172.21.15.1:0/1949535347 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2832855337 0 0) 0x7f3458003520 con 0x7f34680c9170 2024-05-04T02:19:52.677 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:52.674+0000 7f34677fe640 1 -- 172.21.15.1:0/1949535347 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f34680c9580 msgr2=0x7f34680c3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:19:52.677 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:52.674+0000 7f34677fe640 1 --2- 172.21.15.1:0/1949535347 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f34680c9580 0x7f34680c3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:52.677 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:52.674+0000 7f34677fe640 1 -- 172.21.15.1:0/1949535347 >> v2:172.21.15.107:3300/0 conn(0x7f346806e170 msgr2=0x7f34681567e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:19:52.677 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:52.674+0000 7f34677fe640 1 --2- 172.21.15.1:0/1949535347 >> v2:172.21.15.107:3300/0 conn(0x7f346806e170 0x7f34681567e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:52.677 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:52.674+0000 7f34677fe640 1 -- 172.21.15.1:0/1949535347 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f346815d630 con 0x7f34680c9170 2024-05-04T02:19:52.677 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:52.674+0000 7f34677fe640 1 -- 172.21.15.1:0/1949535347 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1418761865 0 0) 0x7f34540016f0 con 0x7f34680c9170 2024-05-04T02:19:52.677 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:52.674+0000 7f34677fe640 1 -- 172.21.15.1:0/1949535347 >> v1:172.21.15.1:6789/0 conn(0x7f34680c9170 legacy=0x7f34680c4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:19:52.677 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:52.674+0000 7f34677fe640 1 --2- 172.21.15.1:0/1949535347 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3458003a50 0x7f3458003ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:19:52.678 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:52.674+0000 7f34677fe640 1 --2- 172.21.15.1:0/1949535347 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f34680c9580 0x7f3458004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:19:52.678 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:52.674+0000 7f34677fe640 1 --2- 172.21.15.1:0/1949535347 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3458004fc0 0x7f345800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:19:52.678 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:52.674+0000 7f34677fe640 1 -- 172.21.15.1:0/1949535347 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f346815d1a0 con 0x7f3458003a50 2024-05-04T02:19:52.678 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:52.674+0000 7f34677fe640 1 -- 172.21.15.1:0/1949535347 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f34680c5920 con 0x7f3458004fc0 2024-05-04T02:19:52.678 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:52.674+0000 7f34677fe640 1 -- 172.21.15.1:0/1949535347 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f345800bf30 con 0x7f34680c9580 2024-05-04T02:19:52.680 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:52.678+0000 7f346ca2e640 1 --2- 172.21.15.1:0/1949535347 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3458003a50 0x7f3458003ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:19:52.682 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:52.680+0000 7f346ca2e640 1 -- 172.21.15.1:0/1949535347 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f34680c9580 msgr2=0x7f3458004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:19:52.683 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:52.680+0000 7f346ca2e640 1 --2- 172.21.15.1:0/1949535347 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f34680c9580 0x7f3458004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:52.683 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:52.680+0000 7f346ca2e640 1 -- 172.21.15.1:0/1949535347 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3458004fc0 msgr2=0x7f345800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:19:52.683 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:52.680+0000 7f346ca2e640 1 --2- 172.21.15.1:0/1949535347 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3458004fc0 0x7f345800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:52.683 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:52.680+0000 7f346ca2e640 1 -- 172.21.15.1:0/1949535347 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3458003520 con 0x7f3458003a50 2024-05-04T02:19:52.684 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:52.682+0000 7f346ca2e640 1 --2- 172.21.15.1:0/1949535347 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3458003a50 0x7f3458003ee0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f345c009860 tx=0x7f3458005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ea7454854d07e54 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:19:52.688 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:52.686+0000 7f34677fe640 1 -- 172.21.15.1:0/1949535347 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f345c037070 con 0x7f3458003a50 2024-05-04T02:19:52.688 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:52.686+0000 7f34677fe640 1 -- 172.21.15.1:0/1949535347 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f345c02aaa0 con 0x7f3458003a50 2024-05-04T02:19:52.688 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:52.686+0000 7f34677fe640 1 -- 172.21.15.1:0/1949535347 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f345c009460 con 0x7f3458003a50 2024-05-04T02:19:52.689 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:52.687+0000 7f346ec92640 1 -- 172.21.15.1:0/1949535347 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3458003a50 msgr2=0x7f3458003ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:19:52.689 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:52.687+0000 7f346ec92640 1 --2- 172.21.15.1:0/1949535347 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3458003a50 0x7f3458003ee0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f345c009860 tx=0x7f3458005830 comp rx=0 tx=0).stop 2024-05-04T02:19:52.690 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:52.687+0000 7f346d22f640 1 -- 172.21.15.1:0/1949535347 reap_dead start 2024-05-04T02:19:52.690 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:52.687+0000 7f346ec92640 1 -- 172.21.15.1:0/1949535347 shutdown_connections 2024-05-04T02:19:52.690 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:52.687+0000 7f346ec92640 1 -- 172.21.15.1:0/1949535347 >> 172.21.15.1:0/1949535347 conn(0x7f34680cb690 msgr2=0x7f34680cbaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:19:52.690 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:52.687+0000 7f346ec92640 1 -- 172.21.15.1:0/1949535347 shutdown_connections 2024-05-04T02:19:52.690 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:52.687+0000 7f346ec92640 1 -- 172.21.15.1:0/1949535347 wait complete. 2024-05-04T02:19:52.691 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:52.689+0000 7f346ec92640 1 Processor -- start 2024-05-04T02:19:52.691 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:52.689+0000 7f346ec92640 1 -- start start 2024-05-04T02:19:52.693 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:52.691+0000 7f346ec92640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3458003a50 0x7f34681588b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:19:52.693 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:52.691+0000 7f346ec92640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34680c8c00 0x7f3468159650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:19:52.693 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:52.691+0000 7f346ec92640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3468159b90 0x7f34680cd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:19:52.693 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:52.691+0000 7f346ec92640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f346815ce30 con 0x7f3468159b90 2024-05-04T02:19:52.693 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:52.691+0000 7f346ec92640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f346815cb50 con 0x7f34680c8c00 2024-05-04T02:19:52.694 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:52.691+0000 7f346ec92640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f34680c5370 con 0x7f3458003a50 2024-05-04T02:19:52.694 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:52.691+0000 7f346d22f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3468159b90 0x7f34680cd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:19:52.694 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:52.692+0000 7f346d22f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3468159b90 0x7f34680cd7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55478/0 (socket says 172.21.15.1:55478) 2024-05-04T02:19:52.694 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:52.692+0000 7f346d22f640 1 -- 172.21.15.1:0/2577180117 learned_addr learned my addr 172.21.15.1:0/2577180117 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:19:52.698 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:52.695+0000 7f346d22f640 1 -- 172.21.15.1:0/2577180117 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3458003a50 msgr2=0x7f34681588b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:19:52.698 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:52.695+0000 7f346d22f640 1 --2- 172.21.15.1:0/2577180117 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3458003a50 0x7f34681588b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:52.698 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:52.695+0000 7f346d22f640 1 -- 172.21.15.1:0/2577180117 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34680c8c00 msgr2=0x7f3468159650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:19:52.698 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:52.695+0000 7f346d22f640 1 --2- 172.21.15.1:0/2577180117 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34680c8c00 0x7f3468159650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:52.698 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:52.696+0000 7f346d22f640 1 -- 172.21.15.1:0/2577180117 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34681f26a0 con 0x7f3468159b90 2024-05-04T02:19:52.700 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:52.698+0000 7f346d22f640 1 --2- 172.21.15.1:0/2577180117 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3468159b90 0x7f34680cd7a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3468074a60 tx=0x7f346000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:19:52.707 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:52.705+0000 7f34657fa640 1 -- 172.21.15.1:0/2577180117 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3460017070 con 0x7f3468159b90 2024-05-04T02:19:52.708 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:52.705+0000 7f34657fa640 1 -- 172.21.15.1:0/2577180117 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f346000aa20 con 0x7f3468159b90 2024-05-04T02:19:52.708 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:52.705+0000 7f346ec92640 1 -- 172.21.15.1:0/2577180117 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3468158640 con 0x7f3468159b90 2024-05-04T02:19:52.708 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:52.705+0000 7f34657fa640 1 -- 172.21.15.1:0/2577180117 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f346000adf0 con 0x7f3468159b90 2024-05-04T02:19:52.708 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:52.705+0000 7f346ec92640 1 -- 172.21.15.1:0/2577180117 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34681572a0 con 0x7f3468159b90 2024-05-04T02:19:52.708 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:52.706+0000 7f346ec92640 1 -- 172.21.15.1:0/2577180117 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3468069160 con 0x7f3468159b90 2024-05-04T02:19:52.731 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:52.729+0000 7f34657fa640 1 -- 172.21.15.1:0/2577180117 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 3) ==== 98039+0+0 (secure 0 0 0) 0x7f346001a070 con 0x7f3468159b90 2024-05-04T02:19:52.731 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:52.729+0000 7f34657fa640 1 --2- 172.21.15.1:0/2577180117 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f344c0761a0 0x7f344c0786b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:19:52.731 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:52.729+0000 7f346ca2e640 1 --2- 172.21.15.1:0/2577180117 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f344c0761a0 0x7f344c0786b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:19:52.732 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:52.730+0000 7f346ca2e640 1 --2- 172.21.15.1:0/2577180117 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f344c0761a0 0x7f344c0786b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f345c034000 tx=0x7f345c02c000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:19:53.035 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:53.033+0000 7f34657fa640 1 -- 172.21.15.1:0/2577180117 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f346005ee90 con 0x7f3468159b90 2024-05-04T02:19:53.035 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:53.033+0000 7f34657fa640 1 -- 172.21.15.1:0/2577180117 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f3460021020 con 0x7f3468159b90 2024-05-04T02:19:53.230 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:53.228+0000 7f346ec92640 1 -- 172.21.15.1:0/2577180117 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f34680c4810 con 0x7f3468159b90 2024-05-04T02:19:53.444 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:53.442+0000 7f34657fa640 1 -- 172.21.15.1:0/2577180117 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mgrmap(e 4) ==== 98145+0+0 (secure 0 0 0) 0x7f346005c680 con 0x7f3468159b90 2024-05-04T02:19:53.448 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:53.446+0000 7f34657fa640 1 -- 172.21.15.1:0/2577180117 <== mon.0 v2:172.21.15.1:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f34600861f0 con 0x7f3468159b90 2024-05-04T02:19:53.449 INFO:teuthology.misc.health.smithi001.stdout: 2024-05-04T02:19:53.449 INFO:teuthology.misc.health.smithi001.stdout:{"epoch":10,"fsid":"b45b4a9a-b84c-4a66-907b-43f0ca45e7c0","created":"2024-05-04T02:19:44.555410+0000","modified":"2024-05-04T02:19:50.811018+0000","last_up_change":"0.000000","last_in_change":"2024-05-04T02:19:50.811018+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d8ad7964-7bd6-4ba9-ae4f-b55d7566b18c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ce155f6d-7e0c-47c8-a0e0-fb53ff0c7726","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7847c281-5da0-4d7d-b888-7f49d99a50b9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"26386eba-d106-4abe-8d6b-7dccdd106cb3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"2ba3d1b3-c5fa-4ff4-bf5d-772e77d79c59","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c42646eb-6e14-4b42-a7a3-54f99f1662bb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a8a2dbb8-0107-4b8e-93c3-5fa7e6af15a3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"3b9bdc70-8831-4df9-8d50-362aa0f02aed","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-04T02:19:53.451 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:53.449+0000 7f346ec92640 1 -- 172.21.15.1:0/2577180117 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f344c0761a0 msgr2=0x7f344c0786b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:19:53.452 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:53.449+0000 7f346ec92640 1 --2- 172.21.15.1:0/2577180117 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f344c0761a0 0x7f344c0786b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f345c034000 tx=0x7f345c02c000 comp rx=0 tx=0).stop 2024-05-04T02:19:53.452 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:53.449+0000 7f346ec92640 1 -- 172.21.15.1:0/2577180117 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3468159b90 msgr2=0x7f34680cd7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:19:53.452 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:53.449+0000 7f346ec92640 1 --2- 172.21.15.1:0/2577180117 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3468159b90 0x7f34680cd7a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3468074a60 tx=0x7f346000cc20 comp rx=0 tx=0).stop 2024-05-04T02:19:53.452 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:53.449+0000 7f346ec92640 1 -- 172.21.15.1:0/2577180117 shutdown_connections 2024-05-04T02:19:53.452 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:53.449+0000 7f346ec92640 1 --2- 172.21.15.1:0/2577180117 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f344c0761a0 0x7f344c0786b0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:53.452 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:53.449+0000 7f346ec92640 1 --2- 172.21.15.1:0/2577180117 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3468159b90 0x7f34680cd7a0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:53.452 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:53.449+0000 7f346ec92640 1 --2- 172.21.15.1:0/2577180117 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f34680c8c00 0x7f3468159650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:53.452 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:53.449+0000 7f346ec92640 1 --2- 172.21.15.1:0/2577180117 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3458003a50 0x7f34681588b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:19:53.452 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:53.449+0000 7f346ec92640 1 -- 172.21.15.1:0/2577180117 >> 172.21.15.1:0/2577180117 conn(0x7f34680cb690 msgr2=0x7f346815b040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:19:53.452 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:53.449+0000 7f346ec92640 1 -- 172.21.15.1:0/2577180117 shutdown_connections 2024-05-04T02:19:53.452 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:19:53.449+0000 7f346ec92640 1 -- 172.21.15.1:0/2577180117 wait complete. 2024-05-04T02:19:53.462 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-04T02:19:55.314 INFO:tasks.ceph.osd.0.smithi001.stderr:2024-05-04T02:19:55.312+0000 7f6082a15640 -1 osd.0 0 log_to_monitors true 2024-05-04T02:19:55.356 INFO:tasks.ceph.osd.2.smithi001.stderr:2024-05-04T02:19:55.354+0000 7fc382223640 -1 osd.2 0 log_to_monitors true 2024-05-04T02:19:55.381 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-04T02:19:55.378+0000 7fc08ccb3640 -1 osd.4 0 log_to_monitors true 2024-05-04T02:19:55.411 INFO:tasks.ceph.osd.1.smithi001.stderr:2024-05-04T02:19:55.409+0000 7f79c4e0f640 -1 osd.1 0 log_to_monitors true 2024-05-04T02:19:55.434 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-04T02:19:55.432+0000 7f564a22e640 -1 osd.7 0 log_to_monitors true 2024-05-04T02:19:55.441 INFO:tasks.ceph.osd.3.smithi001.stderr:2024-05-04T02:19:55.439+0000 7fdc9bf26640 -1 osd.3 0 log_to_monitors true 2024-05-04T02:19:55.470 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-04T02:19:55.468+0000 7ff503218640 -1 osd.5 0 log_to_monitors true 2024-05-04T02:19:55.471 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-04T02:19:55.468+0000 7fea38ba5640 -1 osd.6 0 log_to_monitors true 2024-05-04T02:19:57.295 INFO:tasks.ceph.osd.0.smithi001.stderr:2024-05-04T02:19:57.292+0000 7f607e2fb640 -1 osd.0 0 waiting for initial osdmap 2024-05-04T02:19:57.320 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-04T02:19:57.318+0000 7fc088c49640 -1 osd.4 0 waiting for initial osdmap 2024-05-04T02:19:57.355 INFO:tasks.ceph.osd.0.smithi001.stderr:2024-05-04T02:19:57.353+0000 7f60760f6640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-04T02:19:57.360 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-04T02:19:57.358+0000 7fc080a44640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-04T02:19:58.794 INFO:tasks.ceph.osd.1.smithi001.stderr:2024-05-04T02:19:58.792+0000 7f79c06f3640 -1 osd.1 0 waiting for initial osdmap 2024-05-04T02:19:58.902 INFO:tasks.ceph.osd.1.smithi001.stderr:2024-05-04T02:19:58.900+0000 7f79b84ee640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-04T02:19:58.920 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-04T02:19:58.918+0000 7fea34b3b640 -1 osd.6 0 waiting for initial osdmap 2024-05-04T02:19:58.933 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-04T02:19:58.930+0000 7f5645778640 -1 osd.7 0 waiting for initial osdmap 2024-05-04T02:19:58.940 INFO:tasks.ceph.osd.3.smithi001.stderr:2024-05-04T02:19:58.939+0000 7fdc97ebc640 -1 osd.3 0 waiting for initial osdmap 2024-05-04T02:19:58.955 INFO:tasks.ceph.osd.2.smithi001.stderr:2024-05-04T02:19:58.953+0000 7fc37e9cd640 -1 osd.2 0 waiting for initial osdmap 2024-05-04T02:19:58.981 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-04T02:19:58.978+0000 7ff4feb80640 -1 osd.5 0 waiting for initial osdmap 2024-05-04T02:19:58.998 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-04T02:19:58.996+0000 7fea2c936640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-04T02:19:59.003 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-04T02:19:59.001+0000 7f563d573640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-04T02:19:59.030 INFO:tasks.ceph.osd.2.smithi001.stderr:2024-05-04T02:19:59.028+0000 7fc375fb4640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-04T02:19:59.038 INFO:tasks.ceph.osd.3.smithi001.stderr:2024-05-04T02:19:59.036+0000 7fdc8fcb7640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-04T02:19:59.041 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-04T02:19:59.039+0000 7ff4f697b640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-04T02:20:00.269 DEBUG:teuthology.orchestra.run.smithi001:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-04T02:20:00.373 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:00.371+0000 7f88a74d9640 1 Processor -- start 2024-05-04T02:20:00.374 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:00.372+0000 7f88a74d9640 1 -- start start 2024-05-04T02:20:00.375 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:00.373+0000 7f88a74d9640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f88a00c61a0 0x7f88a00c9510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:00.376 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:00.373+0000 7f88a74d9640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88a015c620 con 0x7f88a00cc880 2024-05-04T02:20:00.376 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:00.373+0000 7f88a74d9640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88a00c69c0 con 0x7f88a015d2a0 2024-05-04T02:20:00.376 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:00.373+0000 7f88a74d9640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f88a00c66e0 con 0x7f88a00c61a0 2024-05-04T02:20:00.376 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:00.374+0000 7f88a5a76640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f88a00cc880 0x7f88a0166f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:52200/0 (socket says 172.21.15.1:52200) 2024-05-04T02:20:00.376 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:00.374+0000 7f88a5a76640 1 -- 172.21.15.1:0/2433370717 learned_addr learned my addr 172.21.15.1:0/2433370717 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-05-04T02:20:00.378 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:00.377+0000 7f8897fff640 1 -- 172.21.15.1:0/2433370717 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 607024894 0 0) 0x7f88a015c620 con 0x7f88a00cc880 2024-05-04T02:20:00.379 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:00.377+0000 7f8897fff640 1 -- 172.21.15.1:0/2433370717 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f888c003520 con 0x7f88a00cc880 2024-05-04T02:20:00.383 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:00.381+0000 7f8897fff640 1 -- 172.21.15.1:0/2433370717 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3507015587 0 0) 0x7f888c003520 con 0x7f88a00cc880 2024-05-04T02:20:00.383 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:00.381+0000 7f8897fff640 1 -- 172.21.15.1:0/2433370717 >> v2:172.21.15.107:3300/0 conn(0x7f88a00c61a0 msgr2=0x7f88a00c9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:00.384 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:00.381+0000 7f8897fff640 1 --2- 172.21.15.1:0/2433370717 >> v2:172.21.15.107:3300/0 conn(0x7f88a00c61a0 0x7f88a00c9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:00.384 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:00.381+0000 7f8897fff640 1 -- 172.21.15.1:0/2433370717 >> v1:172.21.15.107:6789/0 conn(0x7f88a015d2a0 legacy=0x7f88a00c76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:00.384 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:00.381+0000 7f8897fff640 1 -- 172.21.15.1:0/2433370717 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88a00c48a0 con 0x7f88a00cc880 2024-05-04T02:20:00.384 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:00.381+0000 7f8897fff640 1 -- 172.21.15.1:0/2433370717 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1418761865 0 0) 0x7f8898001a90 con 0x7f88a00cc880 2024-05-04T02:20:00.384 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:00.381+0000 7f8897fff640 1 -- 172.21.15.1:0/2433370717 >> v1:172.21.15.1:6789/0 conn(0x7f88a00cc880 legacy=0x7f88a0166f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:00.384 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:00.381+0000 7f8897fff640 1 --2- 172.21.15.1:0/2433370717 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f888c003a50 0x7f888c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:00.384 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:00.381+0000 7f8897fff640 1 --2- 172.21.15.1:0/2433370717 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f888c004800 0x7f888c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:00.384 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:00.381+0000 7f8897fff640 1 --2- 172.21.15.1:0/2433370717 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f888c0053f0 0x7f888c00ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:00.384 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:00.381+0000 7f8897fff640 1 -- 172.21.15.1:0/2433370717 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f88a00c66e0 con 0x7f888c003a50 2024-05-04T02:20:00.384 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:00.381+0000 7f8897fff640 1 -- 172.21.15.1:0/2433370717 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f888c00c360 con 0x7f888c0053f0 2024-05-04T02:20:00.384 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:00.381+0000 7f8897fff640 1 -- 172.21.15.1:0/2433370717 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f888c00c560 con 0x7f888c004800 2024-05-04T02:20:00.387 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:00.385+0000 7f88a5275640 1 --2- 172.21.15.1:0/2433370717 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f888c003a50 0x7f888c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:00.390 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:00.388+0000 7f88a5275640 1 -- 172.21.15.1:0/2433370717 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f888c004800 msgr2=0x7f888c004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:00.390 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:00.388+0000 7f88a5275640 1 --2- 172.21.15.1:0/2433370717 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f888c004800 0x7f888c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:00.390 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:00.388+0000 7f88a5275640 1 -- 172.21.15.1:0/2433370717 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f888c0053f0 msgr2=0x7f888c00ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:00.390 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:00.388+0000 7f88a5275640 1 --2- 172.21.15.1:0/2433370717 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f888c0053f0 0x7f888c00ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:00.390 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:00.388+0000 7f88a5275640 1 -- 172.21.15.1:0/2433370717 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f888c003520 con 0x7f888c003a50 2024-05-04T02:20:00.391 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:00.388+0000 7f88a5a76640 1 -- 172.21.15.1:0/2433370717 reap_dead start 2024-05-04T02:20:00.392 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:00.390+0000 7f88a5275640 1 --2- 172.21.15.1:0/2433370717 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f888c003a50 0x7f888c003ea0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8890009860 tx=0x7f888c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7643e0906b8a9cd3 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:00.396 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:00.394+0000 7f8897fff640 1 -- 172.21.15.1:0/2433370717 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8890037070 con 0x7f888c003a50 2024-05-04T02:20:00.396 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:00.394+0000 7f8897fff640 1 -- 172.21.15.1:0/2433370717 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f889002aa70 con 0x7f888c003a50 2024-05-04T02:20:00.397 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:00.394+0000 7f8897fff640 1 -- 172.21.15.1:0/2433370717 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8890009460 con 0x7f888c003a50 2024-05-04T02:20:00.397 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:00.395+0000 7f88a74d9640 1 -- 172.21.15.1:0/2433370717 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f888c003a50 msgr2=0x7f888c003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:00.397 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:00.395+0000 7f88a74d9640 1 --2- 172.21.15.1:0/2433370717 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f888c003a50 0x7f888c003ea0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8890009860 tx=0x7f888c005830 comp rx=0 tx=0).stop 2024-05-04T02:20:00.398 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:00.395+0000 7f88a74d9640 1 -- 172.21.15.1:0/2433370717 shutdown_connections 2024-05-04T02:20:00.398 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:00.395+0000 7f88a74d9640 1 --2- 172.21.15.1:0/2433370717 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f888c003a50 0x7f888c003ea0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:00.398 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:00.395+0000 7f88a74d9640 1 -- 172.21.15.1:0/2433370717 >> 172.21.15.1:0/2433370717 conn(0x7f88a0073b40 msgr2=0x7f88a0073f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:00.398 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:00.395+0000 7f88a74d9640 1 -- 172.21.15.1:0/2433370717 shutdown_connections 2024-05-04T02:20:00.398 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:00.395+0000 7f88a74d9640 1 -- 172.21.15.1:0/2433370717 wait complete. 2024-05-04T02:20:00.399 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:00.397+0000 7f88a74d9640 1 Processor -- start 2024-05-04T02:20:00.399 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:00.397+0000 7f88a74d9640 1 -- start start 2024-05-04T02:20:00.400 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:00.398+0000 7f88a74d9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f888c003a50 0x7f88a01f3030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:00.400 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:00.398+0000 7f88a74d9640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f88a014e9b0 0x7f88a0158620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:00.400 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:00.398+0000 7f88a74d9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f88a014e100 0x7f88a0156f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:00.400 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:00.398+0000 7f88a74d9640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f88a00c5140 con 0x7f888c003a50 2024-05-04T02:20:00.400 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:00.398+0000 7f88a74d9640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f88a00c4e60 con 0x7f88a014e100 2024-05-04T02:20:00.401 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:00.398+0000 7f88a74d9640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f88a00b58b0 con 0x7f88a014e9b0 2024-05-04T02:20:00.401 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:00.399+0000 7f88a5275640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f888c003a50 0x7f88a01f3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:00.401 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:00.399+0000 7f88a5275640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f888c003a50 0x7f88a01f3030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:55512/0 (socket says 172.21.15.1:55512) 2024-05-04T02:20:00.401 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:00.399+0000 7f88a5275640 1 -- 172.21.15.1:0/702410708 learned_addr learned my addr 172.21.15.1:0/702410708 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:00.405 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:00.403+0000 7f88a5275640 1 -- 172.21.15.1:0/702410708 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f88a014e9b0 msgr2=0x7f88a0158620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:00.405 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:00.403+0000 7f88a5275640 1 --2- 172.21.15.1:0/702410708 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f88a014e9b0 0x7f88a0158620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:00.405 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:00.403+0000 7f88a5275640 1 -- 172.21.15.1:0/702410708 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f88a014e100 msgr2=0x7f88a0156f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:00.405 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:00.403+0000 7f88a5275640 1 --2- 172.21.15.1:0/702410708 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f88a014e100 0x7f88a0156f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:00.405 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:00.403+0000 7f88a5275640 1 -- 172.21.15.1:0/702410708 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88a01f2570 con 0x7f888c003a50 2024-05-04T02:20:00.407 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:00.405+0000 7f88a5275640 1 --2- 172.21.15.1:0/702410708 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f888c003a50 0x7f88a01f3030 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8890009980 tx=0x7f88900047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:00.412 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:00.409+0000 7f8895ffb640 1 -- 172.21.15.1:0/702410708 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8890042020 con 0x7f888c003a50 2024-05-04T02:20:00.412 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:00.409+0000 7f8895ffb640 1 -- 172.21.15.1:0/702410708 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8890009440 con 0x7f888c003a50 2024-05-04T02:20:00.412 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:00.409+0000 7f88a74d9640 1 -- 172.21.15.1:0/702410708 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88a0159560 con 0x7f888c003a50 2024-05-04T02:20:00.412 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:00.409+0000 7f8895ffb640 1 -- 172.21.15.1:0/702410708 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8890037040 con 0x7f888c003a50 2024-05-04T02:20:00.412 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:00.410+0000 7f88a74d9640 1 -- 172.21.15.1:0/702410708 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88a01f2830 con 0x7f888c003a50 2024-05-04T02:20:00.413 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:00.411+0000 7f88a74d9640 1 -- 172.21.15.1:0/702410708 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88a0069160 con 0x7f888c003a50 2024-05-04T02:20:00.436 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:00.434+0000 7f8895ffb640 1 -- 172.21.15.1:0/702410708 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 4) ==== 98145+0+0 (secure 0 0 0) 0x7f8890045020 con 0x7f888c003a50 2024-05-04T02:20:00.437 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:00.435+0000 7f8895ffb640 1 --2- 172.21.15.1:0/702410708 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f8884076290 0x7f88840787a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:00.437 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:00.435+0000 7f88a4a74640 1 --2- 172.21.15.1:0/702410708 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f8884076290 0x7f88840787a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:00.438 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:00.436+0000 7f88a4a74640 1 --2- 172.21.15.1:0/702410708 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f8884076290 0x7f88840787a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f88a00d0260 tx=0x7f889c007990 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:00.730 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:00.728+0000 7f8895ffb640 1 -- 172.21.15.1:0/702410708 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2791+0+0 (secure 0 0 0) 0x7f889007d850 con 0x7f888c003a50 2024-05-04T02:20:00.730 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:00.728+0000 7f8895ffb640 1 -- 172.21.15.1:0/702410708 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f889004c030 con 0x7f888c003a50 2024-05-04T02:20:00.948 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:00.945+0000 7f88a74d9640 1 -- 172.21.15.1:0/702410708 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f88a00c5440 con 0x7f888c003a50 2024-05-04T02:20:01.172 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:01.170+0000 7f8895ffb640 1 -- 172.21.15.1:0/702410708 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) ==== 74+0+12690 (secure 0 0 0) 0x7f8890081cc0 con 0x7f888c003a50 2024-05-04T02:20:01.172 INFO:teuthology.misc.health.smithi001.stdout: 2024-05-04T02:20:01.173 INFO:teuthology.misc.health.smithi001.stdout:{"epoch":15,"fsid":"b45b4a9a-b84c-4a66-907b-43f0ca45e7c0","created":"2024-05-04T02:19:44.555410+0000","modified":"2024-05-04T02:20:00.162760+0000","last_up_change":"2024-05-04T02:20:00.162760+0000","last_in_change":"2024-05-04T02:19:50.811018+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-04T02:19:59.664283+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d8ad7964-7bd6-4ba9-ae4f-b55d7566b18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":2338132980},{"type":"v1","addr":"172.21.15.1:6801","nonce":2338132980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":2338132980},{"type":"v1","addr":"172.21.15.1:6803","nonce":2338132980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":2338132980},{"type":"v1","addr":"172.21.15.1:6807","nonce":2338132980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":2338132980},{"type":"v1","addr":"172.21.15.1:6805","nonce":2338132980}]},"public_addr":"172.21.15.1:6801/2338132980","cluster_addr":"172.21.15.1:6803/2338132980","heartbeat_back_addr":"172.21.15.1:6807/2338132980","heartbeat_front_addr":"172.21.15.1:6805/2338132980","state":["exists","up"]},{"osd":1,"uuid":"ce155f6d-7e0c-47c8-a0e0-fb53ff0c7726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":459131368},{"type":"v1","addr":"172.21.15.1:6817","nonce":459131368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":459131368},{"type":"v1","addr":"172.21.15.1:6819","nonce":459131368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":459131368},{"type":"v1","addr":"172.21.15.1:6823","nonce":459131368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":459131368},{"type":"v1","addr":"172.21.15.1:6821","nonce":459131368}]},"public_addr":"172.21.15.1:6817/459131368","cluster_addr":"172.21.15.1:6819/459131368","heartbeat_back_addr":"172.21.15.1:6823/459131368","heartbeat_front_addr":"172.21.15.1:6821/459131368","state":["exists","up"]},{"osd":2,"uuid":"7847c281-5da0-4d7d-b888-7f49d99a50b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":3463851105},{"type":"v1","addr":"172.21.15.1:6809","nonce":3463851105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":3463851105},{"type":"v1","addr":"172.21.15.1:6811","nonce":3463851105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":3463851105},{"type":"v1","addr":"172.21.15.1:6815","nonce":3463851105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":3463851105},{"type":"v1","addr":"172.21.15.1:6813","nonce":3463851105}]},"public_addr":"172.21.15.1:6809/3463851105","cluster_addr":"172.21.15.1:6811/3463851105","heartbeat_back_addr":"172.21.15.1:6815/3463851105","heartbeat_front_addr":"172.21.15.1:6813/3463851105","state":["exists","up"]},{"osd":3,"uuid":"26386eba-d106-4abe-8d6b-7dccdd106cb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":3859721636},{"type":"v1","addr":"172.21.15.1:6825","nonce":3859721636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":3859721636},{"type":"v1","addr":"172.21.15.1:6827","nonce":3859721636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":3859721636},{"type":"v1","addr":"172.21.15.1:6831","nonce":3859721636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":3859721636},{"type":"v1","addr":"172.21.15.1:6829","nonce":3859721636}]},"public_addr":"172.21.15.1:6825/3859721636","cluster_addr":"172.21.15.1:6827/3859721636","heartbeat_back_addr":"172.21.15.1:6831/3859721636","heartbeat_front_addr":"172.21.15.1:6829/3859721636","state":["exists","up"]},{"osd":4,"uuid":"2ba3d1b3-c5fa-4ff4-bf5d-772e77d79c59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":2335597098},{"type":"v1","addr":"172.21.15.107:6803","nonce":2335597098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":2335597098},{"type":"v1","addr":"172.21.15.107:6805","nonce":2335597098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2335597098},{"type":"v1","addr":"172.21.15.107:6810","nonce":2335597098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":2335597098},{"type":"v1","addr":"172.21.15.107:6807","nonce":2335597098}]},"public_addr":"172.21.15.107:6803/2335597098","cluster_addr":"172.21.15.107:6805/2335597098","heartbeat_back_addr":"172.21.15.107:6810/2335597098","heartbeat_front_addr":"172.21.15.107:6807/2335597098","state":["exists","up"]},{"osd":5,"uuid":"c42646eb-6e14-4b42-a7a3-54f99f1662bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":1274544305},{"type":"v1","addr":"172.21.15.107:6819","nonce":1274544305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":1274544305},{"type":"v1","addr":"172.21.15.107:6821","nonce":1274544305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":1274544305},{"type":"v1","addr":"172.21.15.107:6825","nonce":1274544305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":1274544305},{"type":"v1","addr":"172.21.15.107:6823","nonce":1274544305}]},"public_addr":"172.21.15.107:6819/1274544305","cluster_addr":"172.21.15.107:6821/1274544305","heartbeat_back_addr":"172.21.15.107:6825/1274544305","heartbeat_front_addr":"172.21.15.107:6823/1274544305","state":["exists","up"]},{"osd":6,"uuid":"a8a2dbb8-0107-4b8e-93c3-5fa7e6af15a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6809","nonce":941385299},{"type":"v1","addr":"172.21.15.107:6811","nonce":941385299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":941385299},{"type":"v1","addr":"172.21.15.107:6813","nonce":941385299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":941385299},{"type":"v1","addr":"172.21.15.107:6817","nonce":941385299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":941385299},{"type":"v1","addr":"172.21.15.107:6815","nonce":941385299}]},"public_addr":"172.21.15.107:6811/941385299","cluster_addr":"172.21.15.107:6813/941385299","heartbeat_back_addr":"172.21.15.107:6817/941385299","heartbeat_front_addr":"172.21.15.107:6815/941385299","state":["exists","up"]},{"osd":7,"uuid":"3b9bdc70-8831-4df9-8d50-362aa0f02aed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":1723298539},{"type":"v1","addr":"172.21.15.107:6827","nonce":1723298539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":1723298539},{"type":"v1","addr":"172.21.15.107:6829","nonce":1723298539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":1723298539},{"type":"v1","addr":"172.21.15.107:6833","nonce":1723298539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":1723298539},{"type":"v1","addr":"172.21.15.107:6831","nonce":1723298539}]},"public_addr":"172.21.15.107:6827/1723298539","cluster_addr":"172.21.15.107:6829/1723298539","heartbeat_back_addr":"172.21.15.107:6833/1723298539","heartbeat_front_addr":"172.21.15.107:6831/1723298539","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T02:19:56.277538+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T02:19:56.384856+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-04T02:20:01.175 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:01.172+0000 7f88a74d9640 1 -- 172.21.15.1:0/702410708 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f8884076290 msgr2=0x7f88840787a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:01.175 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:01.172+0000 7f88a74d9640 1 --2- 172.21.15.1:0/702410708 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f8884076290 0x7f88840787a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f88a00d0260 tx=0x7f889c007990 comp rx=0 tx=0).stop 2024-05-04T02:20:01.176 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:01.172+0000 7f88a74d9640 1 -- 172.21.15.1:0/702410708 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f888c003a50 msgr2=0x7f88a01f3030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:01.176 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:01.172+0000 7f88a74d9640 1 --2- 172.21.15.1:0/702410708 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f888c003a50 0x7f88a01f3030 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8890009980 tx=0x7f88900047d0 comp rx=0 tx=0).stop 2024-05-04T02:20:01.176 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:01.172+0000 7f88a74d9640 1 -- 172.21.15.1:0/702410708 shutdown_connections 2024-05-04T02:20:01.176 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:01.172+0000 7f88a74d9640 1 --2- 172.21.15.1:0/702410708 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f8884076290 0x7f88840787a0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:01.176 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:01.172+0000 7f88a74d9640 1 --2- 172.21.15.1:0/702410708 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f88a014e100 0x7f88a0156f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:01.176 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:01.172+0000 7f88a74d9640 1 --2- 172.21.15.1:0/702410708 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f88a014e9b0 0x7f88a0158620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:01.177 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:01.172+0000 7f88a74d9640 1 --2- 172.21.15.1:0/702410708 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f888c003a50 0x7f88a01f3030 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:01.177 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:01.172+0000 7f88a74d9640 1 -- 172.21.15.1:0/702410708 >> 172.21.15.1:0/702410708 conn(0x7f88a0073b40 msgr2=0x7f88a00c5660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:01.177 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:01.172+0000 7f88a74d9640 1 -- 172.21.15.1:0/702410708 shutdown_connections 2024-05-04T02:20:01.177 INFO:teuthology.misc.health.smithi001.stderr:2024-05-04T02:20:01.172+0000 7f88a74d9640 1 -- 172.21.15.1:0/702410708 wait complete. 2024-05-04T02:20:01.185 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-05-04T02:20:01.185 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-05-04T02:20:01.186 DEBUG:tasks.ceph_manager:running mds.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.a.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-05-04T02:20:01.186 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-04T02:20:01.186 DEBUG:teuthology.orchestra.run.smithi001:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i a 2024-05-04T02:20:01.189 INFO:tasks.ceph.mds.a:Started 2024-05-04T02:20:01.189 DEBUG:tasks.ceph_manager:running mds.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.c.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-05-04T02:20:01.189 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-04T02:20:01.189 DEBUG:teuthology.orchestra.run.smithi001:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i c 2024-05-04T02:20:01.191 INFO:tasks.ceph.mds.c:Started 2024-05-04T02:20:01.192 DEBUG:tasks.ceph_manager:running mds.e under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.e.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-05-04T02:20:01.192 INFO:tasks.ceph.mds.e:Restarting daemon 2024-05-04T02:20:01.192 DEBUG:teuthology.orchestra.run.smithi001:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.e.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i e 2024-05-04T02:20:01.194 INFO:tasks.ceph.mds.e:Started 2024-05-04T02:20:01.194 DEBUG:tasks.ceph_manager:running mds.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.b.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-05-04T02:20:01.194 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-04T02:20:01.194 DEBUG:teuthology.orchestra.run.smithi107:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i b 2024-05-04T02:20:01.197 INFO:tasks.ceph.mds.b:Started 2024-05-04T02:20:01.197 DEBUG:tasks.ceph_manager:running mds.d under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.d.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-05-04T02:20:01.197 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-04T02:20:01.197 DEBUG:teuthology.orchestra.run.smithi107:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.d.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i d 2024-05-04T02:20:01.199 INFO:tasks.ceph.mds.d:Started 2024-05-04T02:20:01.199 DEBUG:tasks.ceph_manager:running mds.f under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.f.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2024-05-04T02:20:01.200 INFO:tasks.ceph.mds.f:Restarting daemon 2024-05-04T02:20:01.200 DEBUG:teuthology.orchestra.run.smithi107:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.f.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i f 2024-05-04T02:20:01.202 INFO:tasks.ceph.mds.f:Started 2024-05-04T02:20:01.202 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-05-04T02:20:01.202 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-04T02:20:01.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:01.333+0000 7fa1426f9640 1 Processor -- start 2024-05-04T02:20:01.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:01.333+0000 7fa1426f9640 1 -- start start 2024-05-04T02:20:01.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:01.334+0000 7fa1426f9640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fa13c0c39b0 0x7fa13c06cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:01.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:01.334+0000 7fa1426f9640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa13c0c3dc0 0x7fa13c0c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:01.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:01.334+0000 7fa1426f9640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa13c15ce00 con 0x7fa13c155e40 2024-05-04T02:20:01.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:01.334+0000 7fa1426f9640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7fa13c0c4620 con 0x7fa13c0c39b0 2024-05-04T02:20:01.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:01.334+0000 7fa1426f9640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa13c0c4340 con 0x7fa13c0c3dc0 2024-05-04T02:20:01.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:01.335+0000 7fa13bfff640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fa13c155e40 0x7fa13c0c30a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.1:43900/0 (socket says 172.21.15.1:43900) 2024-05-04T02:20:01.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:01.335+0000 7fa13bfff640 1 -- 172.21.15.1:0/4236947110 learned_addr learned my addr 172.21.15.1:0/4236947110 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-05-04T02:20:01.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:01.335+0000 7fa140c96640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa13c0c3dc0 0x7fa13c0c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:01.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:01.339+0000 7fa140c96640 1 -- 172.21.15.1:0/4236947110 >> v2:172.21.15.1:3300/0 conn(0x7fa13c0c39b0 msgr2=0x7fa13c06cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:01.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:01.339+0000 7fa140c96640 1 --2- 172.21.15.1:0/4236947110 >> v2:172.21.15.1:3300/0 conn(0x7fa13c0c39b0 0x7fa13c06cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:01.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:01.339+0000 7fa140c96640 1 -- 172.21.15.1:0/4236947110 >> v1:172.21.15.107:6789/0 conn(0x7fa13c155e40 legacy=0x7fa13c0c30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:01.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:01.339+0000 7fa140c96640 1 -- 172.21.15.1:0/4236947110 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa13c15c040 con 0x7fa13c0c3dc0 2024-05-04T02:20:01.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:01.341+0000 7fa140c96640 1 --2- 172.21.15.1:0/4236947110 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa13c0c3dc0 0x7fa13c0c89f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa134009d90 tx=0x7fa13402b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=785808a5d5e135ac server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:01.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:01.347+0000 7fa13affd640 1 -- 172.21.15.1:0/4236947110 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa134038070 con 0x7fa13c0c3dc0 2024-05-04T02:20:01.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:01.347+0000 7fa13affd640 1 -- 172.21.15.1:0/4236947110 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa134007540 con 0x7fa13c0c3dc0 2024-05-04T02:20:01.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:01.347+0000 7fa13affd640 1 -- 172.21.15.1:0/4236947110 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa134007910 con 0x7fa13c0c3dc0 2024-05-04T02:20:01.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:01.348+0000 7fa1426f9640 1 -- 172.21.15.1:0/4236947110 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa13c0c3dc0 msgr2=0x7fa13c0c89f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:01.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:01.348+0000 7fa1426f9640 1 --2- 172.21.15.1:0/4236947110 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa13c0c3dc0 0x7fa13c0c89f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa134009d90 tx=0x7fa13402b820 comp rx=0 tx=0).stop 2024-05-04T02:20:01.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:01.348+0000 7fa1426f9640 1 -- 172.21.15.1:0/4236947110 shutdown_connections 2024-05-04T02:20:01.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:01.348+0000 7fa1426f9640 1 --2- 172.21.15.1:0/4236947110 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa13c0c3dc0 0x7fa13c0c89f0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:01.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:01.348+0000 7fa1426f9640 1 --2- 172.21.15.1:0/4236947110 >> v2:172.21.15.1:3300/0 conn(0x7fa13c0c39b0 0x7fa13c06cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:01.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:01.348+0000 7fa1426f9640 1 -- 172.21.15.1:0/4236947110 >> 172.21.15.1:0/4236947110 conn(0x7fa13c0caaf0 msgr2=0x7fa13c0caf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:01.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:01.348+0000 7fa1426f9640 1 -- 172.21.15.1:0/4236947110 shutdown_connections 2024-05-04T02:20:01.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:01.348+0000 7fa1426f9640 1 -- 172.21.15.1:0/4236947110 wait complete. 2024-05-04T02:20:01.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:01.351+0000 7fa1426f9640 1 Processor -- start 2024-05-04T02:20:01.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:01.351+0000 7fa1426f9640 1 -- start start 2024-05-04T02:20:01.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:01.353+0000 7fa1426f9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa13c0c39b0 0x7fa13c1f2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:01.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:01.353+0000 7fa1426f9640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa13c0c3dc0 0x7fa13c154040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:01.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:01.353+0000 7fa1426f9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa13c155e40 0x7fa13c1e3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:01.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:01.353+0000 7fa1426f9640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa13c15c8e0 con 0x7fa13c155e40 2024-05-04T02:20:01.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:01.353+0000 7fa1426f9640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa13c15c600 con 0x7fa13c0c39b0 2024-05-04T02:20:01.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:01.353+0000 7fa1426f9640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa13c156250 con 0x7fa13c0c3dc0 2024-05-04T02:20:01.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:01.354+0000 7fa13bfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa13c0c39b0 0x7fa13c1f2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:01.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:01.354+0000 7fa13b7fe640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa13c0c3dc0 0x7fa13c154040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:01.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:01.354+0000 7fa13bfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa13c0c39b0 0x7fa13c1f2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.1:38264/0 (socket says 172.21.15.1:38264) 2024-05-04T02:20:01.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:01.354+0000 7fa13bfff640 1 -- 172.21.15.1:0/3953055815 learned_addr learned my addr 172.21.15.1:0/3953055815 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:01.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:01.358+0000 7fa13bfff640 1 -- 172.21.15.1:0/3953055815 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa13c0c3dc0 msgr2=0x7fa13c154040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:01.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:01.358+0000 7fa13bfff640 1 --2- 172.21.15.1:0/3953055815 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa13c0c3dc0 0x7fa13c154040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:01.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:01.358+0000 7fa13bfff640 1 -- 172.21.15.1:0/3953055815 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa13c155e40 msgr2=0x7fa13c1e3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:01.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:01.358+0000 7fa13bfff640 1 --2- 172.21.15.1:0/3953055815 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa13c155e40 0x7fa13c1e3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:01.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:01.358+0000 7fa13bfff640 1 -- 172.21.15.1:0/3953055815 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa13c1ef920 con 0x7fa13c0c39b0 2024-05-04T02:20:01.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:01.361+0000 7fa13bfff640 1 --2- 172.21.15.1:0/3953055815 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa13c0c39b0 0x7fa13c1f2950 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa12c00c400 tx=0x7fa12c00c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:01.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:01.366+0000 7fa138ff9640 1 -- 172.21.15.1:0/3953055815 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa12c017070 con 0x7fa13c0c39b0 2024-05-04T02:20:01.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:01.366+0000 7fa138ff9640 1 -- 172.21.15.1:0/3953055815 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa12c005d00 con 0x7fa13c0c39b0 2024-05-04T02:20:01.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:01.366+0000 7fa138ff9640 1 -- 172.21.15.1:0/3953055815 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa12c007310 con 0x7fa13c0c39b0 2024-05-04T02:20:01.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:01.366+0000 7fa1426f9640 1 -- 172.21.15.1:0/3953055815 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa13c14f570 con 0x7fa13c0c39b0 2024-05-04T02:20:01.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:01.366+0000 7fa1426f9640 1 -- 172.21.15.1:0/3953055815 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa13c1f2150 con 0x7fa13c0c39b0 2024-05-04T02:20:01.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:01.367+0000 7fa1426f9640 1 -- 172.21.15.1:0/3953055815 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa13c1e3280 con 0x7fa13c0c39b0 2024-05-04T02:20:01.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:01.689+0000 7fa138ff9640 1 -- 172.21.15.1:0/3953055815 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 4) ==== 98145+0+0 (secure 0 0 0) 0x7fa12c01a070 con 0x7fa13c0c39b0 2024-05-04T02:20:01.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:01.690+0000 7fa138ff9640 1 --2- 172.21.15.1:0/3953055815 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fa128076240 0x7fa128078750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:01.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:01.690+0000 7fa13b7fe640 1 --2- 172.21.15.1:0/3953055815 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fa128076240 0x7fa128078750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:01.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:01.691+0000 7fa13b7fe640 1 --2- 172.21.15.1:0/3953055815 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fa128076240 0x7fa128078750 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa13c159930 tx=0x7fa130009060 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:01.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:01.696+0000 7fa138ff9640 1 -- 172.21.15.1:0/3953055815 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 4846+0+0 (secure 0 0 0) 0x7fa12c05c2c0 con 0x7fa13c0c39b0 2024-05-04T02:20:01.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:01.708+0000 7fa138ff9640 1 -- 172.21.15.1:0/3953055815 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa12c021020 con 0x7fa13c0c39b0 2024-05-04T02:20:02.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:02.010+0000 7fa1426f9640 1 -- 172.21.15.1:0/3953055815 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa13c076740 con 0x7fa13c0c39b0 2024-05-04T02:20:02.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:02.035+0000 7fa138ff9640 1 -- 172.21.15.1:0/3953055815 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+569 (secure 0 0 0) 0x7fa12c060030 con 0x7fa13c0c39b0 2024-05-04T02:20:02.037 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:20:02.037 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-05-04T02:20:02.038 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 1 2024-05-04T02:20:02.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:02.037+0000 7fa1426f9640 1 -- 172.21.15.1:0/3953055815 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fa128076240 msgr2=0x7fa128078750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:02.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:02.037+0000 7fa1426f9640 1 --2- 172.21.15.1:0/3953055815 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fa128076240 0x7fa128078750 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa13c159930 tx=0x7fa130009060 comp rx=0 tx=0).stop 2024-05-04T02:20:02.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:02.037+0000 7fa1426f9640 1 -- 172.21.15.1:0/3953055815 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa13c0c39b0 msgr2=0x7fa13c1f2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:02.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:02.037+0000 7fa1426f9640 1 --2- 172.21.15.1:0/3953055815 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa13c0c39b0 0x7fa13c1f2950 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa12c00c400 tx=0x7fa12c00c8c0 comp rx=0 tx=0).stop 2024-05-04T02:20:02.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:02.037+0000 7fa1426f9640 1 -- 172.21.15.1:0/3953055815 shutdown_connections 2024-05-04T02:20:02.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:02.037+0000 7fa1426f9640 1 --2- 172.21.15.1:0/3953055815 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fa128076240 0x7fa128078750 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:02.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:02.037+0000 7fa1426f9640 1 --2- 172.21.15.1:0/3953055815 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa13c155e40 0x7fa13c1e3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:02.040 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:02.037+0000 7fa1426f9640 1 --2- 172.21.15.1:0/3953055815 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa13c0c3dc0 0x7fa13c154040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:02.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:02.037+0000 7fa1426f9640 1 --2- 172.21.15.1:0/3953055815 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa13c0c39b0 0x7fa13c1f2950 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:02.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:02.037+0000 7fa1426f9640 1 -- 172.21.15.1:0/3953055815 >> 172.21.15.1:0/3953055815 conn(0x7fa13c0caaf0 msgr2=0x7fa13c0c86e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:02.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:02.037+0000 7fa1426f9640 1 -- 172.21.15.1:0/3953055815 shutdown_connections 2024-05-04T02:20:02.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:02.038+0000 7fa1426f9640 1 -- 172.21.15.1:0/3953055815 wait complete. 2024-05-04T02:20:04.053 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-04T02:20:04.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:04.186+0000 7f7938126640 1 Processor -- start 2024-05-04T02:20:04.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:04.186+0000 7f7938126640 1 -- start start 2024-05-04T02:20:04.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:04.187+0000 7f7938126640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f79300c9c20 0x7f7930153470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:04.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:04.187+0000 7f7938126640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f79300c9170 0x7f7930159e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:04.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:04.187+0000 7f7938126640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79300cb380 con 0x7f793015d3d0 2024-05-04T02:20:04.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:04.187+0000 7f7938126640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f793015a350 con 0x7f79300c9c20 2024-05-04T02:20:04.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:04.187+0000 7f7938126640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f793015c980 con 0x7f79300c9170 2024-05-04T02:20:04.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:04.188+0000 7f7935ec2640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f79300c9c20 0x7f7930153470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:04.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:04.188+0000 7f79356c1640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f79300c9170 0x7f7930159e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:04.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:04.188+0000 7f7935ec2640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f79300c9c20 0x7f7930153470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.1:51616/0 (socket says 172.21.15.1:51616) 2024-05-04T02:20:04.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:04.188+0000 7f7935ec2640 1 -- 172.21.15.1:0/1874649668 learned_addr learned my addr 172.21.15.1:0/1874649668 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:04.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:04.191+0000 7f7935ec2640 1 -- 172.21.15.1:0/1874649668 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f79300c9170 msgr2=0x7f7930159e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:04.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:04.191+0000 7f7935ec2640 1 --2- 172.21.15.1:0/1874649668 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f79300c9170 0x7f7930159e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:04.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:04.191+0000 7f7935ec2640 1 -- 172.21.15.1:0/1874649668 >> v1:172.21.15.107:6789/0 conn(0x7f793015d3d0 legacy=0x7f79300c4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:04.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:04.192+0000 7f7935ec2640 1 -- 172.21.15.1:0/1874649668 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79300cb660 con 0x7f79300c9c20 2024-05-04T02:20:04.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:04.196+0000 7f7935ec2640 1 --2- 172.21.15.1:0/1874649668 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79300c9c20 0x7f7930153470 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f792c009870 tx=0x7f792c02a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c39d011662f3eb7f server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:04.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:04.201+0000 7f7934ec0640 1 -- 172.21.15.1:0/1874649668 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f792c037070 con 0x7f79300c9c20 2024-05-04T02:20:04.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:04.201+0000 7f7934ec0640 1 -- 172.21.15.1:0/1874649668 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f792c032440 con 0x7f79300c9c20 2024-05-04T02:20:04.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:04.201+0000 7f7934ec0640 1 -- 172.21.15.1:0/1874649668 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f792c032810 con 0x7f79300c9c20 2024-05-04T02:20:04.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:04.202+0000 7f7938126640 1 -- 172.21.15.1:0/1874649668 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79300c9c20 msgr2=0x7f7930153470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:04.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:04.202+0000 7f7938126640 1 --2- 172.21.15.1:0/1874649668 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79300c9c20 0x7f7930153470 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f792c009870 tx=0x7f792c02a130 comp rx=0 tx=0).stop 2024-05-04T02:20:04.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:04.202+0000 7f7938126640 1 -- 172.21.15.1:0/1874649668 shutdown_connections 2024-05-04T02:20:04.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:04.202+0000 7f7938126640 1 --2- 172.21.15.1:0/1874649668 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f79300c9170 0x7f7930159e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:04.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:04.202+0000 7f7938126640 1 --2- 172.21.15.1:0/1874649668 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79300c9c20 0x7f7930153470 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:04.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:04.202+0000 7f7938126640 1 -- 172.21.15.1:0/1874649668 >> 172.21.15.1:0/1874649668 conn(0x7f79300731f0 msgr2=0x7f79300706c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:04.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:04.202+0000 7f7938126640 1 -- 172.21.15.1:0/1874649668 shutdown_connections 2024-05-04T02:20:04.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:04.202+0000 7f7938126640 1 -- 172.21.15.1:0/1874649668 wait complete. 2024-05-04T02:20:04.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:04.205+0000 7f7938126640 1 Processor -- start 2024-05-04T02:20:04.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:04.205+0000 7f7938126640 1 -- start start 2024-05-04T02:20:04.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:04.207+0000 7f7938126640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79300c9170 0x7f79301f0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:04.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:04.207+0000 7f7938126640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f79300c9c20 0x7f7930151eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:04.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:04.207+0000 7f7938126640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f793015d3d0 0x7f7930156410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:04.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:04.207+0000 7f7938126640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f793015ceb0 con 0x7f793015d3d0 2024-05-04T02:20:04.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:04.207+0000 7f7938126640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f793015cbd0 con 0x7f79300c9170 2024-05-04T02:20:04.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:04.207+0000 7f7938126640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f793015d7e0 con 0x7f79300c9c20 2024-05-04T02:20:04.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:04.208+0000 7f7935ec2640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79300c9170 0x7f79301f0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:04.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:04.208+0000 7f79356c1640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f79300c9c20 0x7f7930151eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:04.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:04.209+0000 7f7935ec2640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79300c9170 0x7f79301f0560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.1:51628/0 (socket says 172.21.15.1:51628) 2024-05-04T02:20:04.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:04.209+0000 7f7935ec2640 1 -- 172.21.15.1:0/2319912690 learned_addr learned my addr 172.21.15.1:0/2319912690 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:04.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:04.209+0000 7f79366c3640 1 --2- 172.21.15.1:0/2319912690 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f793015d3d0 0x7f7930156410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:04.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:04.212+0000 7f7935ec2640 1 -- 172.21.15.1:0/2319912690 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f79300c9c20 msgr2=0x7f7930151eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:04.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:04.212+0000 7f7935ec2640 1 --2- 172.21.15.1:0/2319912690 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f79300c9c20 0x7f7930151eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:04.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:04.212+0000 7f7935ec2640 1 -- 172.21.15.1:0/2319912690 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f793015d3d0 msgr2=0x7f7930156410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:04.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:04.212+0000 7f7935ec2640 1 --2- 172.21.15.1:0/2319912690 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f793015d3d0 0x7f7930156410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:04.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:04.212+0000 7f7935ec2640 1 -- 172.21.15.1:0/2319912690 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79301f0aa0 con 0x7f79300c9170 2024-05-04T02:20:04.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:04.215+0000 7f7935ec2640 1 --2- 172.21.15.1:0/2319912690 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79300c9170 0x7f79301f0560 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f792c009870 tx=0x7f792c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:04.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:04.219+0000 7f79267fc640 1 -- 172.21.15.1:0/2319912690 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f792c041020 con 0x7f79300c9170 2024-05-04T02:20:04.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:04.219+0000 7f79267fc640 1 -- 172.21.15.1:0/2319912690 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f792c030640 con 0x7f79300c9170 2024-05-04T02:20:04.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:04.219+0000 7f79267fc640 1 -- 172.21.15.1:0/2319912690 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f792c037040 con 0x7f79300c9170 2024-05-04T02:20:04.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:04.219+0000 7f7938126640 1 -- 172.21.15.1:0/2319912690 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79300c60c0 con 0x7f79300c9170 2024-05-04T02:20:04.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:04.219+0000 7f7938126640 1 -- 172.21.15.1:0/2319912690 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79300c6660 con 0x7f79300c9170 2024-05-04T02:20:04.223 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:04.221+0000 7f7938126640 1 -- 172.21.15.1:0/2319912690 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79301f0c70 con 0x7f79300c9170 2024-05-04T02:20:04.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:04.525+0000 7f79267fc640 1 -- 172.21.15.1:0/2319912690 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 4) ==== 98145+0+0 (secure 0 0 0) 0x7f792c044020 con 0x7f79300c9170 2024-05-04T02:20:04.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:04.525+0000 7f79267fc640 1 --2- 172.21.15.1:0/2319912690 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f7914076270 0x7f7914078780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:04.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:04.526+0000 7f79356c1640 1 --2- 172.21.15.1:0/2319912690 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f7914076270 0x7f7914078780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:04.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:04.526+0000 7f79356c1640 1 --2- 172.21.15.1:0/2319912690 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f7914076270 0x7f7914078780 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f79301f1690 tx=0x7f7920009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:04.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:04.530+0000 7f79267fc640 1 -- 172.21.15.1:0/2319912690 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f792c07d570 con 0x7f79300c9170 2024-05-04T02:20:04.545 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:04.543+0000 7f79267fc640 1 -- 172.21.15.1:0/2319912690 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f792c04b030 con 0x7f79300c9170 2024-05-04T02:20:04.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:04.844+0000 7f7938126640 1 -- 172.21.15.1:0/2319912690 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7930076740 con 0x7f79300c9170 2024-05-04T02:20:05.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:05.802+0000 7f79267fc640 1 -- 172.21.15.1:0/2319912690 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f792c081540 con 0x7f79300c9170 2024-05-04T02:20:05.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:05.815+0000 7f79267fc640 1 -- 172.21.15.1:0/2319912690 <== mon.1 v2:172.21.15.107:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+569 (secure 0 0 0) 0x7f792c0819e0 con 0x7f79300c9170 2024-05-04T02:20:05.818 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:20:05.818 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-05-04T02:20:05.818 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 1 2024-05-04T02:20:05.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:05.818+0000 7f7938126640 1 -- 172.21.15.1:0/2319912690 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f7914076270 msgr2=0x7f7914078780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:05.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:05.818+0000 7f7938126640 1 --2- 172.21.15.1:0/2319912690 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f7914076270 0x7f7914078780 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f79301f1690 tx=0x7f7920009190 comp rx=0 tx=0).stop 2024-05-04T02:20:05.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:05.818+0000 7f7938126640 1 -- 172.21.15.1:0/2319912690 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79300c9170 msgr2=0x7f79301f0560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:05.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:05.818+0000 7f7938126640 1 --2- 172.21.15.1:0/2319912690 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79300c9170 0x7f79301f0560 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f792c009870 tx=0x7f792c0046c0 comp rx=0 tx=0).stop 2024-05-04T02:20:05.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:05.818+0000 7f7938126640 1 -- 172.21.15.1:0/2319912690 shutdown_connections 2024-05-04T02:20:05.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:05.818+0000 7f7938126640 1 --2- 172.21.15.1:0/2319912690 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f7914076270 0x7f7914078780 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:05.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:05.818+0000 7f7938126640 1 --2- 172.21.15.1:0/2319912690 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f793015d3d0 0x7f7930156410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:05.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:05.818+0000 7f7938126640 1 --2- 172.21.15.1:0/2319912690 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f79300c9c20 0x7f7930151eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:05.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:05.818+0000 7f7938126640 1 --2- 172.21.15.1:0/2319912690 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f79300c9170 0x7f79301f0560 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:05.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:05.818+0000 7f7938126640 1 -- 172.21.15.1:0/2319912690 >> 172.21.15.1:0/2319912690 conn(0x7f79300731f0 msgr2=0x7f793014fd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:05.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:05.818+0000 7f7938126640 1 -- 172.21.15.1:0/2319912690 shutdown_connections 2024-05-04T02:20:05.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:05.818+0000 7f7938126640 1 -- 172.21.15.1:0/2319912690 wait complete. 2024-05-04T02:20:07.837 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-04T02:20:07.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:07.952+0000 7fa243649640 1 Processor -- start 2024-05-04T02:20:07.955 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:07.952+0000 7fa243649640 1 -- start start 2024-05-04T02:20:07.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:07.955+0000 7fa243649640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fa23c154870 0x7fa23c0cbca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:07.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:07.955+0000 7fa243649640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa23c0c47a0 0x7fa23c0cb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:07.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:07.955+0000 7fa243649640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa23c15b200 con 0x7fa23c0702a0 2024-05-04T02:20:07.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:07.955+0000 7fa243649640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7fa23c0ca3f0 con 0x7fa23c154870 2024-05-04T02:20:07.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:07.955+0000 7fa243649640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa23c0ca6d0 con 0x7fa23c0c47a0 2024-05-04T02:20:07.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:07.955+0000 7fa240be4640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa23c0c47a0 0x7fa23c0cb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:07.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:07.956+0000 7fa2413e5640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fa23c154870 0x7fa23c0cbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:07.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:07.956+0000 7fa240be4640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa23c0c47a0 0x7fa23c0cb1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.1:51502/0 (socket says 172.21.15.1:51502) 2024-05-04T02:20:07.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:07.956+0000 7fa240be4640 1 -- 172.21.15.1:0/1153286341 learned_addr learned my addr 172.21.15.1:0/1153286341 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:07.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:07.960+0000 7fa240be4640 1 -- 172.21.15.1:0/1153286341 >> v2:172.21.15.1:3300/0 conn(0x7fa23c154870 msgr2=0x7fa23c0cbca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:07.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:07.960+0000 7fa240be4640 1 --2- 172.21.15.1:0/1153286341 >> v2:172.21.15.1:3300/0 conn(0x7fa23c154870 0x7fa23c0cbca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:07.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:07.960+0000 7fa240be4640 1 -- 172.21.15.1:0/1153286341 >> v1:172.21.15.1:6789/0 conn(0x7fa23c0702a0 legacy=0x7fa23c15d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:07.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:07.960+0000 7fa240be4640 1 -- 172.21.15.1:0/1153286341 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa23c0ca9b0 con 0x7fa23c0c47a0 2024-05-04T02:20:07.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:07.962+0000 7fa240be4640 1 --2- 172.21.15.1:0/1153286341 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa23c0c47a0 0x7fa23c0cb1b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa22c009870 tx=0x7fa22c02a300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed5884df67988cb3 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:07.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:07.967+0000 7fa233fff640 1 -- 172.21.15.1:0/1153286341 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa22c037070 con 0x7fa23c0c47a0 2024-05-04T02:20:07.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:07.967+0000 7fa233fff640 1 -- 172.21.15.1:0/1153286341 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa22c02ae50 con 0x7fa23c0c47a0 2024-05-04T02:20:07.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:07.967+0000 7fa233fff640 1 -- 172.21.15.1:0/1153286341 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa22c032860 con 0x7fa23c0c47a0 2024-05-04T02:20:07.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:07.968+0000 7fa243649640 1 -- 172.21.15.1:0/1153286341 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa23c0c47a0 msgr2=0x7fa23c0cb1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:07.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:07.968+0000 7fa243649640 1 --2- 172.21.15.1:0/1153286341 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa23c0c47a0 0x7fa23c0cb1b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa22c009870 tx=0x7fa22c02a300 comp rx=0 tx=0).stop 2024-05-04T02:20:07.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:07.968+0000 7fa243649640 1 -- 172.21.15.1:0/1153286341 shutdown_connections 2024-05-04T02:20:07.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:07.968+0000 7fa243649640 1 --2- 172.21.15.1:0/1153286341 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa23c0c47a0 0x7fa23c0cb1b0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:07.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:07.968+0000 7fa243649640 1 --2- 172.21.15.1:0/1153286341 >> v2:172.21.15.1:3300/0 conn(0x7fa23c154870 0x7fa23c0cbca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:07.970 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:07.968+0000 7fa243649640 1 -- 172.21.15.1:0/1153286341 >> 172.21.15.1:0/1153286341 conn(0x7fa23c073d40 msgr2=0x7fa23c0cf860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:07.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:07.968+0000 7fa243649640 1 -- 172.21.15.1:0/1153286341 shutdown_connections 2024-05-04T02:20:07.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:07.968+0000 7fa243649640 1 -- 172.21.15.1:0/1153286341 wait complete. 2024-05-04T02:20:07.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:07.970+0000 7fa243649640 1 Processor -- start 2024-05-04T02:20:07.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:07.970+0000 7fa243649640 1 -- start start 2024-05-04T02:20:07.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:07.972+0000 7fa243649640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa23c0702a0 0x7fa23c1f27a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:07.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:07.972+0000 7fa243649640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa23c0c47a0 0x7fa23c1e7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:07.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:07.972+0000 7fa243649640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa23c154870 0x7fa23c0cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:07.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:07.972+0000 7fa243649640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa23c0c5140 con 0x7fa23c0c47a0 2024-05-04T02:20:07.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:07.972+0000 7fa243649640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa23c0c4fc0 con 0x7fa23c0702a0 2024-05-04T02:20:07.974 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:07.972+0000 7fa243649640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa23c15ae20 con 0x7fa23c154870 2024-05-04T02:20:07.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:07.972+0000 7fa241be6640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa23c154870 0x7fa23c0cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:07.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:07.973+0000 7fa2413e5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa23c0702a0 0x7fa23c1f27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:07.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:07.973+0000 7fa241be6640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa23c154870 0x7fa23c0cbe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.1:51506/0 (socket says 172.21.15.1:51506) 2024-05-04T02:20:07.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:07.973+0000 7fa241be6640 1 -- 172.21.15.1:0/3786497532 learned_addr learned my addr 172.21.15.1:0/3786497532 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:07.975 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:07.973+0000 7fa240be4640 1 --2- 172.21.15.1:0/3786497532 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa23c0c47a0 0x7fa23c1e7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:07.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:07.979+0000 7fa241be6640 1 -- 172.21.15.1:0/3786497532 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa23c0702a0 msgr2=0x7fa23c1f27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:07.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:07.979+0000 7fa241be6640 1 --2- 172.21.15.1:0/3786497532 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa23c0702a0 0x7fa23c1f27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:07.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:07.979+0000 7fa241be6640 1 -- 172.21.15.1:0/3786497532 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa23c0c47a0 msgr2=0x7fa23c1e7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:07.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:07.979+0000 7fa241be6640 1 --2- 172.21.15.1:0/3786497532 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa23c0c47a0 0x7fa23c1e7340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:07.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:07.979+0000 7fa241be6640 1 -- 172.21.15.1:0/3786497532 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa23c0b1c90 con 0x7fa23c154870 2024-05-04T02:20:07.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:07.982+0000 7fa241be6640 1 --2- 172.21.15.1:0/3786497532 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa23c154870 0x7fa23c0cbe80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa23400c6e0 tx=0x7fa23400cba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:07.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:07.990+0000 7fa231ffb640 1 -- 172.21.15.1:0/3786497532 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa234003b70 con 0x7fa23c154870 2024-05-04T02:20:07.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:07.990+0000 7fa231ffb640 1 -- 172.21.15.1:0/3786497532 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa234003d10 con 0x7fa23c154870 2024-05-04T02:20:07.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:07.990+0000 7fa231ffb640 1 -- 172.21.15.1:0/3786497532 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2340052f0 con 0x7fa23c154870 2024-05-04T02:20:07.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:07.990+0000 7fa243649640 1 -- 172.21.15.1:0/3786497532 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa23c0af4f0 con 0x7fa23c154870 2024-05-04T02:20:07.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:07.991+0000 7fa243649640 1 -- 172.21.15.1:0/3786497532 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa23c1f2ce0 con 0x7fa23c154870 2024-05-04T02:20:07.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:07.992+0000 7fa243649640 1 -- 172.21.15.1:0/3786497532 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa23c069bc0 con 0x7fa23c154870 2024-05-04T02:20:08.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:08.028+0000 7fa231ffb640 1 -- 172.21.15.1:0/3786497532 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa234005490 con 0x7fa23c154870 2024-05-04T02:20:08.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:08.028+0000 7fa231ffb640 1 --2- 172.21.15.1:0/3786497532 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fa220076350 0x7fa220078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:08.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:08.029+0000 7fa2413e5640 1 --2- 172.21.15.1:0/3786497532 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fa220076350 0x7fa220078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:08.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:08.029+0000 7fa2413e5640 1 --2- 172.21.15.1:0/3786497532 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fa220076350 0x7fa220078860 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa238009aa0 tx=0x7fa238009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:08.273 INFO:tasks.ceph.mds.a.smithi001.stdout:starting mds.a at 2024-05-04T02:20:08.330 INFO:tasks.ceph.mds.c.smithi001.stdout:starting mds.c at 2024-05-04T02:20:08.337 INFO:tasks.ceph.mds.f.smithi107.stdout:starting mds.f at 2024-05-04T02:20:08.340 INFO:tasks.ceph.mds.b.smithi107.stdout:starting mds.b at 2024-05-04T02:20:08.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:08.359+0000 7fa231ffb640 1 -- 172.21.15.1:0/3786497532 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fa2340678b0 con 0x7fa23c154870 2024-05-04T02:20:08.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:08.375+0000 7fa231ffb640 1 -- 172.21.15.1:0/3786497532 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa2340610c0 con 0x7fa23c154870 2024-05-04T02:20:08.517 INFO:tasks.ceph.mds.d.smithi107.stdout:starting mds.d at 2024-05-04T02:20:08.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:08.698+0000 7fa243649640 1 -- 172.21.15.1:0/3786497532 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa23c0d05d0 con 0x7fa23c154870 2024-05-04T02:20:08.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:08.720+0000 7fa231ffb640 1 -- 172.21.15.1:0/3786497532 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+569 (secure 0 0 0) 0x7fa2340653c0 con 0x7fa23c154870 2024-05-04T02:20:08.723 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:20:08.723 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-05-04T02:20:08.723 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 1 2024-05-04T02:20:08.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:08.723+0000 7fa243649640 1 -- 172.21.15.1:0/3786497532 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fa220076350 msgr2=0x7fa220078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:08.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:08.723+0000 7fa243649640 1 --2- 172.21.15.1:0/3786497532 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fa220076350 0x7fa220078860 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa238009aa0 tx=0x7fa238009190 comp rx=0 tx=0).stop 2024-05-04T02:20:08.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:08.723+0000 7fa243649640 1 -- 172.21.15.1:0/3786497532 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa23c154870 msgr2=0x7fa23c0cbe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:08.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:08.723+0000 7fa243649640 1 --2- 172.21.15.1:0/3786497532 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa23c154870 0x7fa23c0cbe80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa23400c6e0 tx=0x7fa23400cba0 comp rx=0 tx=0).stop 2024-05-04T02:20:08.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:08.723+0000 7fa243649640 1 -- 172.21.15.1:0/3786497532 shutdown_connections 2024-05-04T02:20:08.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:08.723+0000 7fa243649640 1 --2- 172.21.15.1:0/3786497532 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fa220076350 0x7fa220078860 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:08.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:08.723+0000 7fa243649640 1 --2- 172.21.15.1:0/3786497532 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa23c154870 0x7fa23c0cbe80 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:08.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:08.723+0000 7fa243649640 1 --2- 172.21.15.1:0/3786497532 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa23c0c47a0 0x7fa23c1e7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:08.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:08.723+0000 7fa243649640 1 --2- 172.21.15.1:0/3786497532 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa23c0702a0 0x7fa23c1f27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:08.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:08.723+0000 7fa243649640 1 -- 172.21.15.1:0/3786497532 >> 172.21.15.1:0/3786497532 conn(0x7fa23c073d40 msgr2=0x7fa23c151f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:08.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:08.723+0000 7fa243649640 1 -- 172.21.15.1:0/3786497532 shutdown_connections 2024-05-04T02:20:08.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:08.723+0000 7fa243649640 1 -- 172.21.15.1:0/3786497532 wait complete. 2024-05-04T02:20:08.782 INFO:tasks.ceph.mds.e.smithi001.stdout:starting mds.e at 2024-05-04T02:20:10.738 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-04T02:20:10.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:10.848+0000 7f634b4f2640 1 Processor -- start 2024-05-04T02:20:10.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:10.848+0000 7f634b4f2640 1 -- start start 2024-05-04T02:20:10.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:10.849+0000 7f634b4f2640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f63440cde50 0x7f634415cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:10.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:10.849+0000 7f634b4f2640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63440cd6c0 con 0x7f63440cc590 2024-05-04T02:20:10.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:10.849+0000 7f634b4f2640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63440cd980 con 0x7f63440c7da0 2024-05-04T02:20:10.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:10.849+0000 7f634b4f2640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f63440c7070 con 0x7f63440cde50 2024-05-04T02:20:10.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:10.850+0000 7f6349a8f640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f63440cc590 0x7f6344166eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:42162/0 (socket says 172.21.15.1:42162) 2024-05-04T02:20:10.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:10.850+0000 7f6349a8f640 1 -- 172.21.15.1:0/18044994 learned_addr learned my addr 172.21.15.1:0/18044994 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-05-04T02:20:10.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:10.850+0000 7f634928e640 1 --2- 172.21.15.1:0/18044994 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f63440cde50 0x7f634415cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:10.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:10.852+0000 7f633bfff640 1 -- 172.21.15.1:0/18044994 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3097341730 0 0) 0x7f63440cd980 con 0x7f63440c7da0 2024-05-04T02:20:10.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:10.852+0000 7f633bfff640 1 -- 172.21.15.1:0/18044994 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6330003520 con 0x7f63440c7da0 2024-05-04T02:20:10.854 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:10.852+0000 7f633bfff640 1 -- 172.21.15.1:0/18044994 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1596087242 0 0) 0x7f63440cd6c0 con 0x7f63440cc590 2024-05-04T02:20:10.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:10.852+0000 7f633bfff640 1 -- 172.21.15.1:0/18044994 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63440cd980 con 0x7f63440cc590 2024-05-04T02:20:10.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:10.853+0000 7f634928e640 1 -- 172.21.15.1:0/18044994 >> v1:172.21.15.107:6789/0 conn(0x7f63440c7da0 legacy=0x7f634406c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:10.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:10.853+0000 7f634928e640 1 -- 172.21.15.1:0/18044994 >> v1:172.21.15.1:6789/0 conn(0x7f63440cc590 legacy=0x7f6344166eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:10.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:10.853+0000 7f634928e640 1 -- 172.21.15.1:0/18044994 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63440c72c0 con 0x7f63440cde50 2024-05-04T02:20:10.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:10.855+0000 7f634928e640 1 --2- 172.21.15.1:0/18044994 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f63440cde50 0x7f634415cfb0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f63400097d0 tx=0x7f634002a290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=30ed93c9374d4896 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:10.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:10.859+0000 7f633bfff640 1 -- 172.21.15.1:0/18044994 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6340037070 con 0x7f63440cde50 2024-05-04T02:20:10.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:10.859+0000 7f633bfff640 1 -- 172.21.15.1:0/18044994 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6340032440 con 0x7f63440cde50 2024-05-04T02:20:10.861 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:10.859+0000 7f633bfff640 1 -- 172.21.15.1:0/18044994 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63400327f0 con 0x7f63440cde50 2024-05-04T02:20:10.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:10.860+0000 7f634b4f2640 1 -- 172.21.15.1:0/18044994 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f63440cde50 msgr2=0x7f634415cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:10.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:10.860+0000 7f634b4f2640 1 --2- 172.21.15.1:0/18044994 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f63440cde50 0x7f634415cfb0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f63400097d0 tx=0x7f634002a290 comp rx=0 tx=0).stop 2024-05-04T02:20:10.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:10.860+0000 7f634b4f2640 1 -- 172.21.15.1:0/18044994 shutdown_connections 2024-05-04T02:20:10.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:10.860+0000 7f634b4f2640 1 --2- 172.21.15.1:0/18044994 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f63440cde50 0x7f634415cfb0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:10.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:10.860+0000 7f634b4f2640 1 -- 172.21.15.1:0/18044994 >> 172.21.15.1:0/18044994 conn(0x7f63440d2590 msgr2=0x7f63440ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:10.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:10.860+0000 7f634b4f2640 1 -- 172.21.15.1:0/18044994 shutdown_connections 2024-05-04T02:20:10.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:10.860+0000 7f634b4f2640 1 -- 172.21.15.1:0/18044994 wait complete. 2024-05-04T02:20:10.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:10.862+0000 7f634b4f2640 1 Processor -- start 2024-05-04T02:20:10.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:10.862+0000 7f634b4f2640 1 -- start start 2024-05-04T02:20:10.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:10.863+0000 7f634b4f2640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63440c7da0 0x7f634415e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:10.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:10.863+0000 7f634b4f2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f63440cc590 0x7f634415e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:10.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:10.863+0000 7f634b4f2640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f634415ee20 0x7f63441e6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:10.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:10.863+0000 7f634b4f2640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6344156b40 con 0x7f63440cc590 2024-05-04T02:20:10.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:10.863+0000 7f634b4f2640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f63440c7880 con 0x7f63440c7da0 2024-05-04T02:20:10.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:10.863+0000 7f634b4f2640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f63440cd310 con 0x7f634415ee20 2024-05-04T02:20:10.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:10.864+0000 7f6348a8d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f63440cc590 0x7f634415e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:10.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:10.864+0000 7f6349a8f640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f634415ee20 0x7f63441e6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:10.867 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:10.864+0000 7f634928e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63440c7da0 0x7f634415e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:10.867 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:10.864+0000 7f6348a8d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f63440cc590 0x7f634415e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54006/0 (socket says 172.21.15.1:54006) 2024-05-04T02:20:10.867 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:10.864+0000 7f6348a8d640 1 -- 172.21.15.1:0/2297231841 learned_addr learned my addr 172.21.15.1:0/2297231841 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:10.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:10.868+0000 7f6348a8d640 1 -- 172.21.15.1:0/2297231841 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f634415ee20 msgr2=0x7f63441e6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:10.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:10.868+0000 7f6348a8d640 1 --2- 172.21.15.1:0/2297231841 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f634415ee20 0x7f63441e6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:10.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:10.868+0000 7f6348a8d640 1 -- 172.21.15.1:0/2297231841 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63440c7da0 msgr2=0x7f634415e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:10.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:10.868+0000 7f6348a8d640 1 --2- 172.21.15.1:0/2297231841 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63440c7da0 0x7f634415e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:10.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:10.868+0000 7f6348a8d640 1 -- 172.21.15.1:0/2297231841 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63441f36a0 con 0x7f63440cc590 2024-05-04T02:20:10.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:10.871+0000 7f6348a8d640 1 --2- 172.21.15.1:0/2297231841 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f63440cc590 0x7f634415e280 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f633400c430 tx=0x7f633400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:10.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:10.875+0000 7f6339ffb640 1 -- 172.21.15.1:0/2297231841 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6334017070 con 0x7f63440cc590 2024-05-04T02:20:10.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:10.875+0000 7f6339ffb640 1 -- 172.21.15.1:0/2297231841 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63340052f0 con 0x7f63440cc590 2024-05-04T02:20:10.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:10.875+0000 7f634b4f2640 1 -- 172.21.15.1:0/2297231841 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63441e85b0 con 0x7f63440cc590 2024-05-04T02:20:10.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:10.875+0000 7f6339ffb640 1 -- 172.21.15.1:0/2297231841 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6334003830 con 0x7f63440cc590 2024-05-04T02:20:10.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:10.875+0000 7f634b4f2640 1 -- 172.21.15.1:0/2297231841 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63441e91d0 con 0x7f63440cc590 2024-05-04T02:20:10.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:10.876+0000 7f634b4f2640 1 -- 172.21.15.1:0/2297231841 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6344069bc0 con 0x7f63440cc590 2024-05-04T02:20:10.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:10.900+0000 7f6339ffb640 1 -- 172.21.15.1:0/2297231841 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f633401a070 con 0x7f63440cc590 2024-05-04T02:20:10.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:10.901+0000 7f6339ffb640 1 --2- 172.21.15.1:0/2297231841 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f6328076320 0x7f6328078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:10.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:10.901+0000 7f634928e640 1 --2- 172.21.15.1:0/2297231841 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f6328076320 0x7f6328078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:10.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:10.901+0000 7f634928e640 1 --2- 172.21.15.1:0/2297231841 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f6328076320 0x7f6328078830 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6340034000 tx=0x7f634002e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:11.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:11.203+0000 7f6339ffb640 1 -- 172.21.15.1:0/2297231841 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f63340668f0 con 0x7f63440cc590 2024-05-04T02:20:11.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:11.203+0000 7f6339ffb640 1 -- 172.21.15.1:0/2297231841 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6334021020 con 0x7f63440cc590 2024-05-04T02:20:11.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:11.437+0000 7f634b4f2640 1 -- 172.21.15.1:0/2297231841 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f63441f3400 con 0x7f63440cc590 2024-05-04T02:20:11.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:11.462+0000 7f6339ffb640 1 -- 172.21.15.1:0/2297231841 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+5506 (secure 0 0 0) 0x7f63441f3400 con 0x7f63440cc590 2024-05-04T02:20:11.465 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:20:11.465 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4214,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/2012070226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":2012070226},{"type":"v1","addr":"172.21.15.107:6837","nonce":2012070226}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4217,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/779417024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":779417024},{"type":"v1","addr":"172.21.15.107:6836","nonce":779417024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4223,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/4178520860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":4178520860},{"type":"v1","addr":"172.21.15.1:6837","nonce":4178520860}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4273,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6833/410847489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":410847489},{"type":"v1","addr":"172.21.15.1:6833","nonce":410847489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/1145100080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":1145100080},{"type":"v1","addr":"172.21.15.1:6835","nonce":1145100080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4285,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6839/1807033208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":1807033208},{"type":"v1","addr":"172.21.15.107:6839","nonce":1807033208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-05-04T02:20:11.465 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 3 2024-05-04T02:20:11.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:11.464+0000 7f634b4f2640 1 -- 172.21.15.1:0/2297231841 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f6328076320 msgr2=0x7f6328078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:11.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:11.464+0000 7f634b4f2640 1 --2- 172.21.15.1:0/2297231841 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f6328076320 0x7f6328078830 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6340034000 tx=0x7f634002e000 comp rx=0 tx=0).stop 2024-05-04T02:20:11.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:11.464+0000 7f634b4f2640 1 -- 172.21.15.1:0/2297231841 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f63440cc590 msgr2=0x7f634415e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:11.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:11.464+0000 7f634b4f2640 1 --2- 172.21.15.1:0/2297231841 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f63440cc590 0x7f634415e280 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f633400c430 tx=0x7f633400c8f0 comp rx=0 tx=0).stop 2024-05-04T02:20:11.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:11.464+0000 7f634b4f2640 1 -- 172.21.15.1:0/2297231841 shutdown_connections 2024-05-04T02:20:11.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:11.464+0000 7f634b4f2640 1 --2- 172.21.15.1:0/2297231841 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f6328076320 0x7f6328078830 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:11.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:11.464+0000 7f634b4f2640 1 --2- 172.21.15.1:0/2297231841 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f634415ee20 0x7f63441e6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:11.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:11.464+0000 7f634b4f2640 1 --2- 172.21.15.1:0/2297231841 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f63440cc590 0x7f634415e280 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:11.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:11.464+0000 7f634b4f2640 1 --2- 172.21.15.1:0/2297231841 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f63440c7da0 0x7f634415e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:11.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:11.464+0000 7f634b4f2640 1 -- 172.21.15.1:0/2297231841 >> 172.21.15.1:0/2297231841 conn(0x7f63440d2590 msgr2=0x7f6344063110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:11.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:11.464+0000 7f634b4f2640 1 -- 172.21.15.1:0/2297231841 shutdown_connections 2024-05-04T02:20:11.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:11.465+0000 7f634b4f2640 1 -- 172.21.15.1:0/2297231841 wait complete. 2024-05-04T02:20:11.478 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-04T02:20:11.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:11.589+0000 7f8c1e6f0640 1 Processor -- start 2024-05-04T02:20:11.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:11.589+0000 7f8c1e6f0640 1 -- start start 2024-05-04T02:20:11.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:11.590+0000 7f8c1e6f0640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8c181422c0 0x7f8c1815c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:11.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:11.590+0000 7f8c1e6f0640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f8c1815cf20 0x7f8c1806f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:11.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:11.590+0000 7f8c1e6f0640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c180c3830 con 0x7f8c180cab70 2024-05-04T02:20:11.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:11.590+0000 7f8c1e6f0640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f8c180c3b10 con 0x7f8c1815cf20 2024-05-04T02:20:11.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:11.590+0000 7f8c1e6f0640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f8c180c3df0 con 0x7f8c181422c0 2024-05-04T02:20:11.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:11.591+0000 7f8c177fe640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8c181422c0 0x7f8c1815c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:11.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:11.591+0000 7f8c177fe640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8c181422c0 0x7f8c1815c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.1:51578/0 (socket says 172.21.15.1:51578) 2024-05-04T02:20:11.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:11.591+0000 7f8c177fe640 1 -- 172.21.15.1:0/2495164927 learned_addr learned my addr 172.21.15.1:0/2495164927 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:11.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:11.594+0000 7f8c177fe640 1 -- 172.21.15.1:0/2495164927 >> v2:172.21.15.1:3300/0 conn(0x7f8c1815cf20 msgr2=0x7f8c1806f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:11.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:11.594+0000 7f8c177fe640 1 --2- 172.21.15.1:0/2495164927 >> v2:172.21.15.1:3300/0 conn(0x7f8c1815cf20 0x7f8c1806f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:11.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:11.594+0000 7f8c177fe640 1 -- 172.21.15.1:0/2495164927 >> v1:172.21.15.1:6789/0 conn(0x7f8c180cab70 legacy=0x7f8c180ce590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:11.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:11.594+0000 7f8c177fe640 1 -- 172.21.15.1:0/2495164927 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c180c40d0 con 0x7f8c181422c0 2024-05-04T02:20:11.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:11.596+0000 7f8c177fe640 1 --2- 172.21.15.1:0/2495164927 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8c181422c0 0x7f8c1815c9e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c009870 tx=0x7f8c0c02a150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1bb78bdeefa1e98b server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:11.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:11.600+0000 7f8c16ffd640 1 -- 172.21.15.1:0/2495164927 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c0c037070 con 0x7f8c181422c0 2024-05-04T02:20:11.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:11.600+0000 7f8c16ffd640 1 -- 172.21.15.1:0/2495164927 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c0c032440 con 0x7f8c181422c0 2024-05-04T02:20:11.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:11.600+0000 7f8c16ffd640 1 -- 172.21.15.1:0/2495164927 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c0c032810 con 0x7f8c181422c0 2024-05-04T02:20:11.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:11.600+0000 7f8c1e6f0640 1 -- 172.21.15.1:0/2495164927 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8c181422c0 msgr2=0x7f8c1815c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:11.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:11.600+0000 7f8c1e6f0640 1 --2- 172.21.15.1:0/2495164927 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8c181422c0 0x7f8c1815c9e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c009870 tx=0x7f8c0c02a150 comp rx=0 tx=0).stop 2024-05-04T02:20:11.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:11.600+0000 7f8c1e6f0640 1 -- 172.21.15.1:0/2495164927 shutdown_connections 2024-05-04T02:20:11.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:11.600+0000 7f8c1e6f0640 1 --2- 172.21.15.1:0/2495164927 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8c181422c0 0x7f8c1815c9e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:11.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:11.600+0000 7f8c1e6f0640 1 --2- 172.21.15.1:0/2495164927 >> v2:172.21.15.1:3300/0 conn(0x7f8c1815cf20 0x7f8c1806f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:11.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:11.600+0000 7f8c1e6f0640 1 -- 172.21.15.1:0/2495164927 >> 172.21.15.1:0/2495164927 conn(0x7f8c180725c0 msgr2=0x7f8c180729d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:11.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:11.600+0000 7f8c1e6f0640 1 -- 172.21.15.1:0/2495164927 shutdown_connections 2024-05-04T02:20:11.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:11.600+0000 7f8c1e6f0640 1 -- 172.21.15.1:0/2495164927 wait complete. 2024-05-04T02:20:11.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:11.602+0000 7f8c1e6f0640 1 Processor -- start 2024-05-04T02:20:11.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:11.602+0000 7f8c1e6f0640 1 -- start start 2024-05-04T02:20:11.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:11.604+0000 7f8c1e6f0640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8c180cab70 0x7f8c180c7650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:11.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:11.604+0000 7f8c1e6f0640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8c181422c0 0x7f8c1813f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:11.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:11.604+0000 7f8c1e6f0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8c1815cf20 0x7f8c180c63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:11.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:11.604+0000 7f8c1e6f0640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8c180ceca0 con 0x7f8c1815cf20 2024-05-04T02:20:11.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:11.604+0000 7f8c1e6f0640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f8c181426d0 con 0x7f8c181422c0 2024-05-04T02:20:11.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:11.604+0000 7f8c1e6f0640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f8c180cee20 con 0x7f8c180cab70 2024-05-04T02:20:11.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:11.604+0000 7f8c17fff640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8c180cab70 0x7f8c180c7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:11.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:11.604+0000 7f8c177fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8c181422c0 0x7f8c1813f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:11.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:11.605+0000 7f8c17fff640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8c180cab70 0x7f8c180c7650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.1:51584/0 (socket says 172.21.15.1:51584) 2024-05-04T02:20:11.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:11.605+0000 7f8c17fff640 1 -- 172.21.15.1:0/181185175 learned_addr learned my addr 172.21.15.1:0/181185175 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:11.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:11.609+0000 7f8c17fff640 1 -- 172.21.15.1:0/181185175 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8c181422c0 msgr2=0x7f8c1813f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:11.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:11.609+0000 7f8c17fff640 1 --2- 172.21.15.1:0/181185175 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8c181422c0 0x7f8c1813f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:11.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:11.609+0000 7f8c17fff640 1 -- 172.21.15.1:0/181185175 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8c1815cf20 msgr2=0x7f8c180c63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:11.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:11.609+0000 7f8c17fff640 1 --2- 172.21.15.1:0/181185175 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8c1815cf20 0x7f8c180c63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:11.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:11.609+0000 7f8c17fff640 1 -- 172.21.15.1:0/181185175 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c180c7b90 con 0x7f8c180cab70 2024-05-04T02:20:11.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:11.612+0000 7f8c17fff640 1 --2- 172.21.15.1:0/181185175 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8c180cab70 0x7f8c180c7650 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8c0800b3e0 tx=0x7f8c0800b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:11.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:11.615+0000 7f8c14ff9640 1 -- 172.21.15.1:0/181185175 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c08015020 con 0x7f8c180cab70 2024-05-04T02:20:11.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:11.616+0000 7f8c14ff9640 1 -- 172.21.15.1:0/181185175 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c08011850 con 0x7f8c180cab70 2024-05-04T02:20:11.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:11.616+0000 7f8c1e6f0640 1 -- 172.21.15.1:0/181185175 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c1815e2c0 con 0x7f8c180cab70 2024-05-04T02:20:11.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:11.616+0000 7f8c14ff9640 1 -- 172.21.15.1:0/181185175 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c08011c40 con 0x7f8c180cab70 2024-05-04T02:20:11.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:11.616+0000 7f8c1e6f0640 1 -- 172.21.15.1:0/181185175 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c181602d0 con 0x7f8c180cab70 2024-05-04T02:20:11.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:11.617+0000 7f8c1e6f0640 1 -- 172.21.15.1:0/181185175 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c18076740 con 0x7f8c180cab70 2024-05-04T02:20:11.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:11.901+0000 7f8c14ff9640 1 -- 172.21.15.1:0/181185175 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8c08018020 con 0x7f8c180cab70 2024-05-04T02:20:11.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:11.902+0000 7f8c14ff9640 1 --2- 172.21.15.1:0/181185175 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f8c04076320 0x7f8c04078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:11.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:11.902+0000 7f8c177fe640 1 --2- 172.21.15.1:0/181185175 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f8c04076320 0x7f8c04078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:11.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:11.903+0000 7f8c177fe640 1 --2- 172.21.15.1:0/181185175 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f8c04076320 0x7f8c04078830 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c034000 tx=0x7f8c0c02e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:11.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:11.904+0000 7f8c14ff9640 1 -- 172.21.15.1:0/181185175 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f8c080675b0 con 0x7f8c180cab70 2024-05-04T02:20:11.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:11.915+0000 7f8c14ff9640 1 -- 172.21.15.1:0/181185175 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8c0801f020 con 0x7f8c180cab70 2024-05-04T02:20:12.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:12.110+0000 7f8c1e6f0640 1 -- 172.21.15.1:0/181185175 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f8c1815a2e0 con 0x7f8c180cab70 2024-05-04T02:20:12.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:12.118+0000 7f8c14ff9640 1 -- 172.21.15.1:0/181185175 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) ==== 84+0+65 (secure 0 0 0) 0x7f8c08061410 con 0x7f8c180cab70 2024-05-04T02:20:12.120 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:20:12.120 INFO:teuthology.orchestra.run.smithi001.stdout:[ 2024-05-04T02:20:12.120 INFO:teuthology.orchestra.run.smithi001.stdout: { 2024-05-04T02:20:12.120 INFO:teuthology.orchestra.run.smithi001.stdout: "poolnum": 1, 2024-05-04T02:20:12.120 INFO:teuthology.orchestra.run.smithi001.stdout: "poolname": ".mgr" 2024-05-04T02:20:12.120 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-05-04T02:20:12.120 INFO:teuthology.orchestra.run.smithi001.stdout:] 2024-05-04T02:20:12.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:12.120+0000 7f8c1e6f0640 1 -- 172.21.15.1:0/181185175 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f8c04076320 msgr2=0x7f8c04078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:12.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:12.120+0000 7f8c1e6f0640 1 --2- 172.21.15.1:0/181185175 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f8c04076320 0x7f8c04078830 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c034000 tx=0x7f8c0c02e000 comp rx=0 tx=0).stop 2024-05-04T02:20:12.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:12.120+0000 7f8c1e6f0640 1 -- 172.21.15.1:0/181185175 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8c180cab70 msgr2=0x7f8c180c7650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:12.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:12.120+0000 7f8c1e6f0640 1 --2- 172.21.15.1:0/181185175 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8c180cab70 0x7f8c180c7650 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8c0800b3e0 tx=0x7f8c0800b8a0 comp rx=0 tx=0).stop 2024-05-04T02:20:12.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:12.120+0000 7f8c1e6f0640 1 -- 172.21.15.1:0/181185175 shutdown_connections 2024-05-04T02:20:12.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:12.120+0000 7f8c1e6f0640 1 --2- 172.21.15.1:0/181185175 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f8c04076320 0x7f8c04078830 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:12.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:12.120+0000 7f8c1e6f0640 1 --2- 172.21.15.1:0/181185175 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8c1815cf20 0x7f8c180c63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:12.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:12.120+0000 7f8c1e6f0640 1 --2- 172.21.15.1:0/181185175 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8c181422c0 0x7f8c1813f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:12.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:12.120+0000 7f8c1e6f0640 1 --2- 172.21.15.1:0/181185175 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8c180cab70 0x7f8c180c7650 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:12.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:12.120+0000 7f8c1e6f0640 1 -- 172.21.15.1:0/181185175 >> 172.21.15.1:0/181185175 conn(0x7f8c180725c0 msgr2=0x7f8c1815a600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:12.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:12.120+0000 7f8c1e6f0640 1 -- 172.21.15.1:0/181185175 shutdown_connections 2024-05-04T02:20:12.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:12.120+0000 7f8c1e6f0640 1 -- 172.21.15.1:0/181185175 wait complete. 2024-05-04T02:20:12.133 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-04T02:20:12.133 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-04T02:20:12.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:12.246+0000 7fb25fdb7640 1 Processor -- start 2024-05-04T02:20:12.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:12.246+0000 7fb25fdb7640 1 -- start start 2024-05-04T02:20:12.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:12.248+0000 7fb25fdb7640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb2580cdcf0 0x7fb25806d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:12.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:12.248+0000 7fb25fdb7640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb25815c4a0 0x7fb25815c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:12.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:12.248+0000 7fb25fdb7640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2580cd3b0 con 0x7fb25815cdf0 2024-05-04T02:20:12.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:12.248+0000 7fb25fdb7640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7fb2580b74b0 con 0x7fb2580cdcf0 2024-05-04T02:20:12.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:12.248+0000 7fb25fdb7640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fb25806d1a0 con 0x7fb25815c4a0 2024-05-04T02:20:12.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:12.249+0000 7fb25db53640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb2580cdcf0 0x7fb25806d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:12.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:12.249+0000 7fb25e354640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fb25815cdf0 0x7fb25815fa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:42172/0 (socket says 172.21.15.1:42172) 2024-05-04T02:20:12.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:12.249+0000 7fb25e354640 1 -- 172.21.15.1:0/488360445 learned_addr learned my addr 172.21.15.1:0/488360445 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-05-04T02:20:12.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:12.249+0000 7fb25d352640 1 --2- 172.21.15.1:0/488360445 >> v2:172.21.15.107:3300/0 conn(0x7fb25815c4a0 0x7fb25815c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:12.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:12.252+0000 7fb25d352640 1 -- 172.21.15.1:0/488360445 >> v2:172.21.15.1:3300/0 conn(0x7fb2580cdcf0 msgr2=0x7fb25806d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:12.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:12.252+0000 7fb25d352640 1 --2- 172.21.15.1:0/488360445 >> v2:172.21.15.1:3300/0 conn(0x7fb2580cdcf0 0x7fb25806d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:12.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:12.252+0000 7fb25d352640 1 -- 172.21.15.1:0/488360445 >> v1:172.21.15.1:6789/0 conn(0x7fb25815cdf0 legacy=0x7fb25815fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:12.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:12.252+0000 7fb25d352640 1 -- 172.21.15.1:0/488360445 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb25806d480 con 0x7fb25815c4a0 2024-05-04T02:20:12.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:12.254+0000 7fb25d352640 1 --2- 172.21.15.1:0/488360445 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb25815c4a0 0x7fb25815c8b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb2580cc610 tx=0x7fb24c02a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a16bc516cf0e2f1 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:12.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:12.258+0000 7fb25cb51640 1 -- 172.21.15.1:0/488360445 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb24c037070 con 0x7fb25815c4a0 2024-05-04T02:20:12.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:12.258+0000 7fb25cb51640 1 -- 172.21.15.1:0/488360445 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb24c032440 con 0x7fb25815c4a0 2024-05-04T02:20:12.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:12.258+0000 7fb25cb51640 1 -- 172.21.15.1:0/488360445 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb24c032810 con 0x7fb25815c4a0 2024-05-04T02:20:12.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:12.259+0000 7fb25fdb7640 1 -- 172.21.15.1:0/488360445 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb25815c4a0 msgr2=0x7fb25815c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:12.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:12.259+0000 7fb25fdb7640 1 --2- 172.21.15.1:0/488360445 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb25815c4a0 0x7fb25815c8b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb2580cc610 tx=0x7fb24c02a230 comp rx=0 tx=0).stop 2024-05-04T02:20:12.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:12.259+0000 7fb25fdb7640 1 -- 172.21.15.1:0/488360445 shutdown_connections 2024-05-04T02:20:12.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:12.259+0000 7fb25fdb7640 1 --2- 172.21.15.1:0/488360445 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb25815c4a0 0x7fb25815c8b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:12.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:12.259+0000 7fb25fdb7640 1 --2- 172.21.15.1:0/488360445 >> v2:172.21.15.1:3300/0 conn(0x7fb2580cdcf0 0x7fb25806d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:12.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:12.259+0000 7fb25fdb7640 1 -- 172.21.15.1:0/488360445 >> 172.21.15.1:0/488360445 conn(0x7fb2580ce960 msgr2=0x7fb25808cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:12.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:12.259+0000 7fb25fdb7640 1 -- 172.21.15.1:0/488360445 shutdown_connections 2024-05-04T02:20:12.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:12.259+0000 7fb25fdb7640 1 -- 172.21.15.1:0/488360445 wait complete. 2024-05-04T02:20:12.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:12.260+0000 7fb25fdb7640 1 Processor -- start 2024-05-04T02:20:12.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:12.261+0000 7fb25fdb7640 1 -- start start 2024-05-04T02:20:12.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:12.262+0000 7fb25fdb7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2580cdcf0 0x7fb2581f5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:12.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:12.262+0000 7fb25fdb7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb25815c4a0 0x7fb2581e2870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:12.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:12.262+0000 7fb25fdb7640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb25815cdf0 0x7fb25815b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:12.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:12.262+0000 7fb25fdb7640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb2580b7790 con 0x7fb2580cdcf0 2024-05-04T02:20:12.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:12.262+0000 7fb25fdb7640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fb25815d200 con 0x7fb25815c4a0 2024-05-04T02:20:12.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:12.262+0000 7fb25fdb7640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fb2580cd7c0 con 0x7fb25815cdf0 2024-05-04T02:20:12.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:12.262+0000 7fb25db53640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2580cdcf0 0x7fb2581f5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:12.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:12.262+0000 7fb25d352640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb25815c4a0 0x7fb2581e2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:12.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:12.262+0000 7fb25e354640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb25815cdf0 0x7fb25815b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:12.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:12.263+0000 7fb25db53640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2580cdcf0 0x7fb2581f5ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:54036/0 (socket says 172.21.15.1:54036) 2024-05-04T02:20:12.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:12.263+0000 7fb25db53640 1 -- 172.21.15.1:0/3464982473 learned_addr learned my addr 172.21.15.1:0/3464982473 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:12.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:12.266+0000 7fb25d352640 1 -- 172.21.15.1:0/3464982473 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb25815cdf0 msgr2=0x7fb25815b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:12.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:12.266+0000 7fb25d352640 1 --2- 172.21.15.1:0/3464982473 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb25815cdf0 0x7fb25815b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:12.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:12.267+0000 7fb25d352640 1 -- 172.21.15.1:0/3464982473 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2580cdcf0 msgr2=0x7fb2581f5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:12.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:12.267+0000 7fb25d352640 1 --2- 172.21.15.1:0/3464982473 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2580cdcf0 0x7fb2581f5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:12.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:12.267+0000 7fb25d352640 1 -- 172.21.15.1:0/3464982473 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2581f6400 con 0x7fb25815c4a0 2024-05-04T02:20:12.269 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:12.267+0000 7fb25db53640 1 --2- 172.21.15.1:0/3464982473 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2580cdcf0 0x7fb2581f5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-04T02:20:12.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:12.269+0000 7fb25d352640 1 --2- 172.21.15.1:0/3464982473 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb25815c4a0 0x7fb2581e2870 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb25806d320 tx=0x7fb24c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:12.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:12.273+0000 7fb2567fc640 1 -- 172.21.15.1:0/3464982473 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb24c041030 con 0x7fb25815c4a0 2024-05-04T02:20:12.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:12.273+0000 7fb2567fc640 1 -- 172.21.15.1:0/3464982473 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb24c030500 con 0x7fb25815c4a0 2024-05-04T02:20:12.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:12.273+0000 7fb2567fc640 1 -- 172.21.15.1:0/3464982473 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb24c037040 con 0x7fb25815c4a0 2024-05-04T02:20:12.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:12.273+0000 7fb25fdb7640 1 -- 172.21.15.1:0/3464982473 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2581e4ae0 con 0x7fb25815c4a0 2024-05-04T02:20:12.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:12.273+0000 7fb25fdb7640 1 -- 172.21.15.1:0/3464982473 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2581e50a0 con 0x7fb25815c4a0 2024-05-04T02:20:12.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:12.274+0000 7fb25fdb7640 1 -- 172.21.15.1:0/3464982473 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb258069c60 con 0x7fb25815c4a0 2024-05-04T02:20:12.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:12.556+0000 7fb2567fc640 1 -- 172.21.15.1:0/3464982473 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb24c044070 con 0x7fb25815c4a0 2024-05-04T02:20:12.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:12.556+0000 7fb2567fc640 1 --2- 172.21.15.1:0/3464982473 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fb244076320 0x7fb244078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:12.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:12.557+0000 7fb2567fc640 1 -- 172.21.15.1:0/3464982473 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fb24c0b7bb0 con 0x7fb25815c4a0 2024-05-04T02:20:12.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:12.557+0000 7fb25db53640 1 --2- 172.21.15.1:0/3464982473 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fb244076320 0x7fb244078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:12.559 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:12.557+0000 7fb25db53640 1 --2- 172.21.15.1:0/3464982473 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fb244076320 0x7fb244078830 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb250009f50 tx=0x7fb250009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:12.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:12.567+0000 7fb2567fc640 1 -- 172.21.15.1:0/3464982473 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb24c0812f0 con 0x7fb25815c4a0 2024-05-04T02:20:12.763 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:12.761+0000 7fb25fdb7640 1 -- 172.21.15.1:0/3464982473 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fb2580cbec0 con 0x7fb25815c4a0 2024-05-04T02:20:13.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:13.196+0000 7fb2567fc640 1 -- 172.21.15.1:0/3464982473 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) ==== 138+0+0 (secure 0 0 0) 0x7fb24c0855f0 con 0x7fb25815c4a0 2024-05-04T02:20:13.198 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_metadata' created 2024-05-04T02:20:13.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:13.198+0000 7fb25fdb7640 1 -- 172.21.15.1:0/3464982473 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fb244076320 msgr2=0x7fb244078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:13.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:13.198+0000 7fb25fdb7640 1 --2- 172.21.15.1:0/3464982473 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fb244076320 0x7fb244078830 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb250009f50 tx=0x7fb250009190 comp rx=0 tx=0).stop 2024-05-04T02:20:13.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:13.198+0000 7fb25fdb7640 1 -- 172.21.15.1:0/3464982473 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb25815c4a0 msgr2=0x7fb2581e2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:13.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:13.198+0000 7fb25fdb7640 1 --2- 172.21.15.1:0/3464982473 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb25815c4a0 0x7fb2581e2870 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb25806d320 tx=0x7fb24c0046c0 comp rx=0 tx=0).stop 2024-05-04T02:20:13.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:13.198+0000 7fb25fdb7640 1 -- 172.21.15.1:0/3464982473 shutdown_connections 2024-05-04T02:20:13.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:13.198+0000 7fb25fdb7640 1 --2- 172.21.15.1:0/3464982473 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fb244076320 0x7fb244078830 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:13.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:13.198+0000 7fb25fdb7640 1 --2- 172.21.15.1:0/3464982473 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb25815cdf0 0x7fb25815b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:13.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:13.198+0000 7fb25fdb7640 1 --2- 172.21.15.1:0/3464982473 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb25815c4a0 0x7fb2581e2870 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:13.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:13.198+0000 7fb25fdb7640 1 --2- 172.21.15.1:0/3464982473 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb2580cdcf0 0x7fb2581f5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:13.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:13.198+0000 7fb25fdb7640 1 -- 172.21.15.1:0/3464982473 >> 172.21.15.1:0/3464982473 conn(0x7fb2580ce960 msgr2=0x7fb2581e8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:13.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:13.198+0000 7fb25fdb7640 1 -- 172.21.15.1:0/3464982473 shutdown_connections 2024-05-04T02:20:13.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:13.198+0000 7fb25fdb7640 1 -- 172.21.15.1:0/3464982473 wait complete. 2024-05-04T02:20:13.211 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-04T02:20:13.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:13.334+0000 7f145a405640 1 Processor -- start 2024-05-04T02:20:13.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:13.334+0000 7f145a405640 1 -- start start 2024-05-04T02:20:13.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:13.336+0000 7f145a405640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f14540cdcf0 0x7f145406d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:13.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:13.336+0000 7f145a405640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f145415c4a0 0x7f145415c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:13.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:13.336+0000 7f145a405640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14540cd3b0 con 0x7f145415cdf0 2024-05-04T02:20:13.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:13.336+0000 7f145a405640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f14540b74b0 con 0x7f145415c4a0 2024-05-04T02:20:13.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:13.336+0000 7f145a405640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f145406d1a0 con 0x7f14540cdcf0 2024-05-04T02:20:13.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:13.336+0000 7f1453fff640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f14540cdcf0 0x7f145406d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:13.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:13.336+0000 7f14537fe640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f145415c4a0 0x7f145415c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:13.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:13.336+0000 7f14589a2640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f145415cdf0 0x7f145415fa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:38892/0 (socket says 172.21.15.1:38892) 2024-05-04T02:20:13.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:13.337+0000 7f14589a2640 1 -- 172.21.15.1:0/2636412655 learned_addr learned my addr 172.21.15.1:0/2636412655 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-05-04T02:20:13.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:13.339+0000 7f1453fff640 1 -- 172.21.15.1:0/2636412655 >> v2:172.21.15.1:3300/0 conn(0x7f145415c4a0 msgr2=0x7f145415c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:13.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:13.339+0000 7f1453fff640 1 --2- 172.21.15.1:0/2636412655 >> v2:172.21.15.1:3300/0 conn(0x7f145415c4a0 0x7f145415c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:13.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:13.339+0000 7f1453fff640 1 -- 172.21.15.1:0/2636412655 >> v1:172.21.15.1:6789/0 conn(0x7f145415cdf0 legacy=0x7f145415fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:13.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:13.339+0000 7f1453fff640 1 -- 172.21.15.1:0/2636412655 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f145406d480 con 0x7f14540cdcf0 2024-05-04T02:20:13.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:13.341+0000 7f1453fff640 1 --2- 172.21.15.1:0/2636412655 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14540cdcf0 0x7f145406d9a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f145408f250 tx=0x7f144402a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a79878f077f8c01f server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:13.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:13.345+0000 7f1452ffd640 1 -- 172.21.15.1:0/2636412655 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1444037070 con 0x7f14540cdcf0 2024-05-04T02:20:13.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:13.345+0000 7f1452ffd640 1 -- 172.21.15.1:0/2636412655 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1444032440 con 0x7f14540cdcf0 2024-05-04T02:20:13.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:13.345+0000 7f1452ffd640 1 -- 172.21.15.1:0/2636412655 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1444032810 con 0x7f14540cdcf0 2024-05-04T02:20:13.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:13.346+0000 7f145a405640 1 -- 172.21.15.1:0/2636412655 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14540cdcf0 msgr2=0x7f145406d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:13.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:13.346+0000 7f145a405640 1 --2- 172.21.15.1:0/2636412655 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14540cdcf0 0x7f145406d9a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f145408f250 tx=0x7f144402a230 comp rx=0 tx=0).stop 2024-05-04T02:20:13.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:13.346+0000 7f145a405640 1 -- 172.21.15.1:0/2636412655 shutdown_connections 2024-05-04T02:20:13.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:13.346+0000 7f145a405640 1 --2- 172.21.15.1:0/2636412655 >> v2:172.21.15.1:3300/0 conn(0x7f145415c4a0 0x7f145415c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:13.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:13.346+0000 7f145a405640 1 --2- 172.21.15.1:0/2636412655 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f14540cdcf0 0x7f145406d9a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:13.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:13.346+0000 7f145a405640 1 -- 172.21.15.1:0/2636412655 >> 172.21.15.1:0/2636412655 conn(0x7f14540ce960 msgr2=0x7f145408cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:13.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:13.346+0000 7f145a405640 1 -- 172.21.15.1:0/2636412655 shutdown_connections 2024-05-04T02:20:13.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:13.346+0000 7f145a405640 1 -- 172.21.15.1:0/2636412655 wait complete. 2024-05-04T02:20:13.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:13.348+0000 7f145a405640 1 Processor -- start 2024-05-04T02:20:13.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:13.348+0000 7f145a405640 1 -- start start 2024-05-04T02:20:13.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:13.350+0000 7f145a405640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14540cdcf0 0x7f1454153e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:13.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:13.350+0000 7f145a405640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f145415c4a0 0x7f14541f2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:13.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:13.350+0000 7f145a405640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f145415cdf0 0x7f145415b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:13.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:13.350+0000 7f145a405640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f14540b7790 con 0x7f14540cdcf0 2024-05-04T02:20:13.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:13.350+0000 7f145a405640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f145415d200 con 0x7f145415c4a0 2024-05-04T02:20:13.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:13.350+0000 7f145a405640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f14540cd7c0 con 0x7f145415cdf0 2024-05-04T02:20:13.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:13.350+0000 7f1453fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14540cdcf0 0x7f1454153e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:13.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:13.350+0000 7f14589a2640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f145415cdf0 0x7f145415b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:13.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:13.350+0000 7f14537fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f145415c4a0 0x7f14541f2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:13.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:13.350+0000 7f1453fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14540cdcf0 0x7f1454153e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46522/0 (socket says 172.21.15.1:46522) 2024-05-04T02:20:13.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:13.350+0000 7f1453fff640 1 -- 172.21.15.1:0/234349171 learned_addr learned my addr 172.21.15.1:0/234349171 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:13.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:13.354+0000 7f14537fe640 1 -- 172.21.15.1:0/234349171 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f145415cdf0 msgr2=0x7f145415b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:13.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:13.354+0000 7f14537fe640 1 --2- 172.21.15.1:0/234349171 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f145415cdf0 0x7f145415b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:13.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:13.354+0000 7f14537fe640 1 -- 172.21.15.1:0/234349171 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14540cdcf0 msgr2=0x7f1454153e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:13.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:13.354+0000 7f14537fe640 1 --2- 172.21.15.1:0/234349171 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14540cdcf0 0x7f1454153e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:13.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:13.354+0000 7f14537fe640 1 -- 172.21.15.1:0/234349171 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14541f2fd0 con 0x7f145415c4a0 2024-05-04T02:20:13.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:13.357+0000 7f14537fe640 1 --2- 172.21.15.1:0/234349171 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f145415c4a0 0x7f14541f2a90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f145408fa30 tx=0x7f143c00ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:13.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:13.361+0000 7f1450ff9640 1 -- 172.21.15.1:0/234349171 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f143c017070 con 0x7f145415c4a0 2024-05-04T02:20:13.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:13.361+0000 7f1450ff9640 1 -- 172.21.15.1:0/234349171 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f143c00c730 con 0x7f145415c4a0 2024-05-04T02:20:13.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:13.361+0000 7f145a405640 1 -- 172.21.15.1:0/234349171 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1454151ec0 con 0x7f145415c4a0 2024-05-04T02:20:13.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:13.361+0000 7f1450ff9640 1 -- 172.21.15.1:0/234349171 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f143c00cb20 con 0x7f145415c4a0 2024-05-04T02:20:13.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:13.361+0000 7f145a405640 1 -- 172.21.15.1:0/234349171 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1454154ae0 con 0x7f145415c4a0 2024-05-04T02:20:13.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:13.362+0000 7f145a405640 1 -- 172.21.15.1:0/234349171 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1454069c60 con 0x7f145415c4a0 2024-05-04T02:20:13.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:13.384+0000 7f1450ff9640 1 -- 172.21.15.1:0/234349171 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f143c01a070 con 0x7f145415c4a0 2024-05-04T02:20:13.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:13.384+0000 7f1450ff9640 1 --2- 172.21.15.1:0/234349171 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f14340762d0 0x7f14340787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:13.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:13.385+0000 7f1453fff640 1 --2- 172.21.15.1:0/234349171 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f14340762d0 0x7f14340787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:13.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:13.385+0000 7f1453fff640 1 --2- 172.21.15.1:0/234349171 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f14340762d0 0x7f14340787e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1444009560 tx=0x7f144402e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:13.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:13.389+0000 7f1450ff9640 1 -- 172.21.15.1:0/234349171 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5227+0+0 (secure 0 0 0) 0x7f143c05ccc0 con 0x7f145415c4a0 2024-05-04T02:20:13.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:13.658+0000 7f1450ff9640 1 -- 172.21.15.1:0/234349171 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f143c060a30 con 0x7f145415c4a0 2024-05-04T02:20:13.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:13.849+0000 7f145a405640 1 -- 172.21.15.1:0/234349171 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f14540d0320 con 0x7f145415c4a0 2024-05-04T02:20:14.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:14.347+0000 7f1450ff9640 1 -- 172.21.15.1:0/234349171 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) ==== 170+0+0 (secure 0 0 0) 0x7f143c064d30 con 0x7f145415c4a0 2024-05-04T02:20:14.350 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_data' created 2024-05-04T02:20:14.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:14.350+0000 7f145a405640 1 -- 172.21.15.1:0/234349171 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f14340762d0 msgr2=0x7f14340787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:14.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:14.350+0000 7f145a405640 1 --2- 172.21.15.1:0/234349171 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f14340762d0 0x7f14340787e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1444009560 tx=0x7f144402e000 comp rx=0 tx=0).stop 2024-05-04T02:20:14.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:14.350+0000 7f145a405640 1 -- 172.21.15.1:0/234349171 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f145415c4a0 msgr2=0x7f14541f2a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:14.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:14.350+0000 7f145a405640 1 --2- 172.21.15.1:0/234349171 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f145415c4a0 0x7f14541f2a90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f145408fa30 tx=0x7f143c00ecd0 comp rx=0 tx=0).stop 2024-05-04T02:20:14.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:14.350+0000 7f145a405640 1 -- 172.21.15.1:0/234349171 shutdown_connections 2024-05-04T02:20:14.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:14.350+0000 7f145a405640 1 --2- 172.21.15.1:0/234349171 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f14340762d0 0x7f14340787e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:14.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:14.350+0000 7f145a405640 1 --2- 172.21.15.1:0/234349171 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f145415cdf0 0x7f145415b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:14.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:14.350+0000 7f145a405640 1 --2- 172.21.15.1:0/234349171 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f145415c4a0 0x7f14541f2a90 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:14.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:14.350+0000 7f145a405640 1 --2- 172.21.15.1:0/234349171 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f14540cdcf0 0x7f1454153e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:14.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:14.350+0000 7f145a405640 1 -- 172.21.15.1:0/234349171 >> 172.21.15.1:0/234349171 conn(0x7f14540ce960 msgr2=0x7f14540d0ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:14.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:14.350+0000 7f145a405640 1 -- 172.21.15.1:0/234349171 shutdown_connections 2024-05-04T02:20:14.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:14.350+0000 7f145a405640 1 -- 172.21.15.1:0/234349171 wait complete. 2024-05-04T02:20:14.364 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-04T02:20:14.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:14.479+0000 7ff70e372640 1 Processor -- start 2024-05-04T02:20:14.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:14.479+0000 7ff70e372640 1 -- start start 2024-05-04T02:20:14.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:14.481+0000 7ff70e372640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff708165e30 0x7ff708168250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:14.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:14.481+0000 7ff70e372640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff70815c5c0 con 0x7ff708156580 2024-05-04T02:20:14.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:14.481+0000 7ff70e372640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff708156990 con 0x7ff70806f0a0 2024-05-04T02:20:14.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:14.481+0000 7ff70e372640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7ff70806f6c0 con 0x7ff708165e30 2024-05-04T02:20:14.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:14.481+0000 7ff707fff640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7ff70806f0a0 0x7ff70815fa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.1:47700/0 (socket says 172.21.15.1:47700) 2024-05-04T02:20:14.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:14.481+0000 7ff707fff640 1 -- 172.21.15.1:0/3017234681 learned_addr learned my addr 172.21.15.1:0/3017234681 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-05-04T02:20:14.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:14.503+0000 7ff70c90f640 1 --2- 172.21.15.1:0/3017234681 >> v2:172.21.15.1:3300/0 conn(0x7ff708165e30 0x7ff708168250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:14.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:14.569+0000 7ff70c90f640 1 -- 172.21.15.1:0/3017234681 >> v1:172.21.15.107:6789/0 conn(0x7ff70806f0a0 legacy=0x7ff70815fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:14.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:14.569+0000 7ff70c90f640 1 -- 172.21.15.1:0/3017234681 >> v1:172.21.15.1:6789/0 conn(0x7ff708156580 legacy=0x7ff7080708b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:14.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:14.569+0000 7ff70c90f640 1 -- 172.21.15.1:0/3017234681 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff70815d310 con 0x7ff708165e30 2024-05-04T02:20:14.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:14.574+0000 7ff70c90f640 1 --2- 172.21.15.1:0/3017234681 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff708165e30 0x7ff708168250 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff700009d90 tx=0x7ff70002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b79c24e1fa061f8 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:14.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:14.601+0000 7ff706ffd640 1 -- 172.21.15.1:0/3017234681 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff700007740 con 0x7ff708165e30 2024-05-04T02:20:14.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:14.601+0000 7ff706ffd640 1 -- 172.21.15.1:0/3017234681 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7000078e0 con 0x7ff708165e30 2024-05-04T02:20:14.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:14.601+0000 7ff706ffd640 1 -- 172.21.15.1:0/3017234681 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff700007cb0 con 0x7ff708165e30 2024-05-04T02:20:14.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:14.602+0000 7ff70e372640 1 -- 172.21.15.1:0/3017234681 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff708165e30 msgr2=0x7ff708168250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:14.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:14.602+0000 7ff70e372640 1 --2- 172.21.15.1:0/3017234681 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff708165e30 0x7ff708168250 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff700009d90 tx=0x7ff70002a6f0 comp rx=0 tx=0).stop 2024-05-04T02:20:14.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:14.602+0000 7ff70e372640 1 -- 172.21.15.1:0/3017234681 shutdown_connections 2024-05-04T02:20:14.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:14.602+0000 7ff70e372640 1 --2- 172.21.15.1:0/3017234681 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff708165e30 0x7ff708168250 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:14.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:14.602+0000 7ff70e372640 1 -- 172.21.15.1:0/3017234681 >> 172.21.15.1:0/3017234681 conn(0x7ff7080cb8e0 msgr2=0x7ff7080ce5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:14.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:14.602+0000 7ff70e372640 1 -- 172.21.15.1:0/3017234681 shutdown_connections 2024-05-04T02:20:14.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:14.602+0000 7ff70e372640 1 -- 172.21.15.1:0/3017234681 wait complete. 2024-05-04T02:20:14.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:14.604+0000 7ff70e372640 1 Processor -- start 2024-05-04T02:20:14.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:14.604+0000 7ff70e372640 1 -- start start 2024-05-04T02:20:14.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:14.606+0000 7ff70e372640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff70806f0a0 0x7ff7081f4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:14.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:14.606+0000 7ff70e372640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff708156580 0x7ff708155020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:14.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:14.606+0000 7ff70e372640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff708165e30 0x7ff70814bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:14.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:14.606+0000 7ff70e372640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff70815cdf0 con 0x7ff708165e30 2024-05-04T02:20:14.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:14.606+0000 7ff70e372640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff70815cb10 con 0x7ff70806f0a0 2024-05-04T02:20:14.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:14.606+0000 7ff70e372640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff708160160 con 0x7ff708156580 2024-05-04T02:20:14.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:14.607+0000 7ff70c90f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff708165e30 0x7ff70814bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:14.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:14.607+0000 7ff70c90f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff708165e30 0x7ff70814bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46540/0 (socket says 172.21.15.1:46540) 2024-05-04T02:20:14.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:14.607+0000 7ff70c90f640 1 -- 172.21.15.1:0/4168165832 learned_addr learned my addr 172.21.15.1:0/4168165832 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:14.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:14.611+0000 7ff7077fe640 1 --2- 172.21.15.1:0/4168165832 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff708156580 0x7ff708155020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:14.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:14.616+0000 7ff7077fe640 1 -- 172.21.15.1:0/4168165832 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff70806f0a0 msgr2=0x7ff7081f4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:14.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:14.616+0000 7ff7077fe640 1 --2- 172.21.15.1:0/4168165832 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff70806f0a0 0x7ff7081f4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:14.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:14.616+0000 7ff7077fe640 1 -- 172.21.15.1:0/4168165832 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff708165e30 msgr2=0x7ff70814bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:14.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:14.616+0000 7ff7077fe640 1 --2- 172.21.15.1:0/4168165832 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff708165e30 0x7ff70814bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:14.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:14.616+0000 7ff7077fe640 1 -- 172.21.15.1:0/4168165832 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7081f4960 con 0x7ff708156580 2024-05-04T02:20:14.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:14.619+0000 7ff7077fe640 1 --2- 172.21.15.1:0/4168165832 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff708156580 0x7ff708155020 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc00c3f0 tx=0x7ff6fc00c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:14.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:14.623+0000 7ff704ff9640 1 -- 172.21.15.1:0/4168165832 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc017070 con 0x7ff708156580 2024-05-04T02:20:14.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:14.623+0000 7ff704ff9640 1 -- 172.21.15.1:0/4168165832 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6fc0052d0 con 0x7ff708156580 2024-05-04T02:20:14.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:14.623+0000 7ff704ff9640 1 -- 172.21.15.1:0/4168165832 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc003830 con 0x7ff708156580 2024-05-04T02:20:14.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:14.623+0000 7ff70e372640 1 -- 172.21.15.1:0/4168165832 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7080c67a0 con 0x7ff708156580 2024-05-04T02:20:14.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:14.623+0000 7ff70e372640 1 -- 172.21.15.1:0/4168165832 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7080c6a40 con 0x7ff708156580 2024-05-04T02:20:14.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:14.624+0000 7ff70e372640 1 -- 172.21.15.1:0/4168165832 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff708063fb0 con 0x7ff708156580 2024-05-04T02:20:14.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:14.907+0000 7ff704ff9640 1 -- 172.21.15.1:0/4168165832 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff6fc01a070 con 0x7ff708156580 2024-05-04T02:20:14.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:14.908+0000 7ff704ff9640 1 --2- 172.21.15.1:0/4168165832 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7ff6f40762d0 0x7ff6f40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:14.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:14.908+0000 7ff704ff9640 1 -- 172.21.15.1:0/4168165832 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(19..19 src has 1..19) ==== 5609+0+0 (secure 0 0 0) 0x7ff6fc096c00 con 0x7ff708156580 2024-05-04T02:20:14.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:14.908+0000 7ff707fff640 1 --2- 172.21.15.1:0/4168165832 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7ff6f40762d0 0x7ff6f40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:14.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:14.909+0000 7ff707fff640 1 --2- 172.21.15.1:0/4168165832 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7ff6f40762d0 0x7ff6f40787e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff6f8005880 tx=0x7ff6f8007a20 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:14.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:14.919+0000 7ff704ff9640 1 -- 172.21.15.1:0/4168165832 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff6fc021020 con 0x7ff708156580 2024-05-04T02:20:15.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:15.148+0000 7ff70e372640 1 -- 172.21.15.1:0/4168165832 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7ff7080cda50 con 0x7ff708156580 2024-05-04T02:20:16.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:16.679+0000 7ff704ff9640 1 -- 172.21.15.1:0/4168165832 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7ff7080cda50 con 0x7ff708156580 2024-05-04T02:20:16.682 INFO:teuthology.orchestra.run.smithi001.stderr:new fs with metadata pool 2 and data pool 3 2024-05-04T02:20:16.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:16.681+0000 7ff70e372640 1 -- 172.21.15.1:0/4168165832 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7ff6f40762d0 msgr2=0x7ff6f40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:16.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:16.681+0000 7ff70e372640 1 --2- 172.21.15.1:0/4168165832 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7ff6f40762d0 0x7ff6f40787e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff6f8005880 tx=0x7ff6f8007a20 comp rx=0 tx=0).stop 2024-05-04T02:20:16.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:16.681+0000 7ff70e372640 1 -- 172.21.15.1:0/4168165832 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff708156580 msgr2=0x7ff708155020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:16.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:16.681+0000 7ff70e372640 1 --2- 172.21.15.1:0/4168165832 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff708156580 0x7ff708155020 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc00c3f0 tx=0x7ff6fc00c8b0 comp rx=0 tx=0).stop 2024-05-04T02:20:16.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:16.681+0000 7ff70e372640 1 -- 172.21.15.1:0/4168165832 shutdown_connections 2024-05-04T02:20:16.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:16.681+0000 7ff70e372640 1 --2- 172.21.15.1:0/4168165832 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7ff6f40762d0 0x7ff6f40787e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:16.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:16.681+0000 7ff70e372640 1 --2- 172.21.15.1:0/4168165832 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff708165e30 0x7ff70814bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:16.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:16.681+0000 7ff70e372640 1 --2- 172.21.15.1:0/4168165832 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff708156580 0x7ff708155020 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:16.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:16.681+0000 7ff70e372640 1 --2- 172.21.15.1:0/4168165832 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff70806f0a0 0x7ff7081f4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:16.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:16.681+0000 7ff70e372640 1 -- 172.21.15.1:0/4168165832 >> 172.21.15.1:0/4168165832 conn(0x7ff7080cb8e0 msgr2=0x7ff7080cc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:16.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:16.681+0000 7ff70e372640 1 -- 172.21.15.1:0/4168165832 shutdown_connections 2024-05-04T02:20:16.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:16.681+0000 7ff70e372640 1 -- 172.21.15.1:0/4168165832 wait complete. 2024-05-04T02:20:16.694 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-04T02:20:16.810 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:16.808+0000 7f00bcca7640 1 Processor -- start 2024-05-04T02:20:16.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:16.808+0000 7f00bcca7640 1 -- start start 2024-05-04T02:20:16.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:16.810+0000 7f00bcca7640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f00b806de70 0x7f00b80b17d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:16.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:16.810+0000 7f00bcca7640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f00b80b1d10 0x7f00b815a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:16.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:16.810+0000 7f00bcca7640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00b815afa0 con 0x7f00b8154870 2024-05-04T02:20:16.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:16.810+0000 7f00bcca7640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f00b806f0c0 con 0x7f00b806de70 2024-05-04T02:20:16.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:16.810+0000 7f00bcca7640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f00b815b280 con 0x7f00b80b1d10 2024-05-04T02:20:16.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:16.810+0000 7f00b6d9d640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f00b80b1d10 0x7f00b815a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:16.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:16.811+0000 7f00b6d9d640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f00b80b1d10 0x7f00b815a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.1:33394/0 (socket says 172.21.15.1:33394) 2024-05-04T02:20:16.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:16.811+0000 7f00b6d9d640 1 -- 172.21.15.1:0/4272206734 learned_addr learned my addr 172.21.15.1:0/4272206734 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:16.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:16.816+0000 7f00b6d9d640 1 -- 172.21.15.1:0/4272206734 >> v2:172.21.15.1:3300/0 conn(0x7f00b806de70 msgr2=0x7f00b80b17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:16.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:16.816+0000 7f00b6d9d640 1 --2- 172.21.15.1:0/4272206734 >> v2:172.21.15.1:3300/0 conn(0x7f00b806de70 0x7f00b80b17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:16.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:16.816+0000 7f00b6d9d640 1 -- 172.21.15.1:0/4272206734 >> v1:172.21.15.107:6789/0 conn(0x7f00b8154870 legacy=0x7f00b806e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:16.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:16.816+0000 7f00b6d9d640 1 -- 172.21.15.1:0/4272206734 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00b815da00 con 0x7f00b80b1d10 2024-05-04T02:20:16.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:16.821+0000 7f00b6d9d640 1 --2- 172.21.15.1:0/4272206734 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f00b80b1d10 0x7f00b815a410 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f00b80722f0 tx=0x7f00a802a300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2aca9c420c8a30d server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:16.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:16.827+0000 7f00b559a640 1 -- 172.21.15.1:0/4272206734 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a8037070 con 0x7f00b80b1d10 2024-05-04T02:20:16.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:16.828+0000 7f00b559a640 1 -- 172.21.15.1:0/4272206734 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00a802ae50 con 0x7f00b80b1d10 2024-05-04T02:20:16.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:16.828+0000 7f00b559a640 1 -- 172.21.15.1:0/4272206734 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a8032860 con 0x7f00b80b1d10 2024-05-04T02:20:16.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:16.828+0000 7f00bcca7640 1 -- 172.21.15.1:0/4272206734 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f00b80b1d10 msgr2=0x7f00b815a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:16.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:16.828+0000 7f00bcca7640 1 --2- 172.21.15.1:0/4272206734 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f00b80b1d10 0x7f00b815a410 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f00b80722f0 tx=0x7f00a802a300 comp rx=0 tx=0).stop 2024-05-04T02:20:16.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:16.828+0000 7f00bcca7640 1 -- 172.21.15.1:0/4272206734 shutdown_connections 2024-05-04T02:20:16.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:16.828+0000 7f00bcca7640 1 --2- 172.21.15.1:0/4272206734 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f00b80b1d10 0x7f00b815a410 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:16.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:16.828+0000 7f00bcca7640 1 --2- 172.21.15.1:0/4272206734 >> v2:172.21.15.1:3300/0 conn(0x7f00b806de70 0x7f00b80b17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:16.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:16.828+0000 7f00bcca7640 1 -- 172.21.15.1:0/4272206734 >> 172.21.15.1:0/4272206734 conn(0x7f00b8070e50 msgr2=0x7f00b80ce770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:16.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:16.829+0000 7f00bcca7640 1 -- 172.21.15.1:0/4272206734 shutdown_connections 2024-05-04T02:20:16.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:16.829+0000 7f00bcca7640 1 -- 172.21.15.1:0/4272206734 wait complete. 2024-05-04T02:20:16.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:16.830+0000 7f00bcca7640 1 Processor -- start 2024-05-04T02:20:16.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:16.830+0000 7f00bcca7640 1 -- start start 2024-05-04T02:20:16.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:16.832+0000 7f00bcca7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f00b806de70 0x7f00b80c67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:16.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:16.832+0000 7f00bcca7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f00b80b1d10 0x7f00b8157940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:16.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:16.832+0000 7f00bcca7640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f00b8154870 0x7f00b8152f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:16.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:16.832+0000 7f00bcca7640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f00b815e2a0 con 0x7f00b80b1d10 2024-05-04T02:20:16.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:16.832+0000 7f00bcca7640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f00b815dfc0 con 0x7f00b806de70 2024-05-04T02:20:16.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:16.832+0000 7f00bcca7640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f00b815e7c0 con 0x7f00b8154870 2024-05-04T02:20:16.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:16.832+0000 7f00b6d9d640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f00b8154870 0x7f00b8152f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:16.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:16.832+0000 7f00b659c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f00b806de70 0x7f00b80c67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:16.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:16.833+0000 7f00b6d9d640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f00b8154870 0x7f00b8152f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.1:51974/0 (socket says 172.21.15.1:51974) 2024-05-04T02:20:16.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:16.833+0000 7f00b6d9d640 1 -- 172.21.15.1:0/3041270789 learned_addr learned my addr 172.21.15.1:0/3041270789 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:16.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:16.837+0000 7f00b6d9d640 1 -- 172.21.15.1:0/3041270789 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f00b806de70 msgr2=0x7f00b80c67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:16.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:16.837+0000 7f00b6d9d640 1 --2- 172.21.15.1:0/3041270789 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f00b806de70 0x7f00b80c67c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:16.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:16.837+0000 7f00b6d9d640 1 -- 172.21.15.1:0/3041270789 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f00b80b1d10 msgr2=0x7f00b8157940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:16.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:16.837+0000 7f00b6d9d640 1 --2- 172.21.15.1:0/3041270789 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f00b80b1d10 0x7f00b8157940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:16.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:16.837+0000 7f00b6d9d640 1 -- 172.21.15.1:0/3041270789 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00b815a340 con 0x7f00b8154870 2024-05-04T02:20:16.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:16.840+0000 7f00b6d9d640 1 --2- 172.21.15.1:0/3041270789 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f00b8154870 0x7f00b8152f80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f00a802a8f0 tx=0x7f00a80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:16.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:16.844+0000 7f00aeffd640 1 -- 172.21.15.1:0/3041270789 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a8042070 con 0x7f00b8154870 2024-05-04T02:20:16.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:16.844+0000 7f00aeffd640 1 -- 172.21.15.1:0/3041270789 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00a803e870 con 0x7f00b8154870 2024-05-04T02:20:16.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:16.844+0000 7f00aeffd640 1 -- 172.21.15.1:0/3041270789 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a8037040 con 0x7f00b8154870 2024-05-04T02:20:16.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:16.844+0000 7f00bcca7640 1 -- 172.21.15.1:0/3041270789 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00b81566c0 con 0x7f00b8154870 2024-05-04T02:20:16.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:16.844+0000 7f00bcca7640 1 -- 172.21.15.1:0/3041270789 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f00b81551c0 con 0x7f00b8154870 2024-05-04T02:20:16.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:16.845+0000 7f00bcca7640 1 -- 172.21.15.1:0/3041270789 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00b8069bc0 con 0x7f00b8154870 2024-05-04T02:20:17.131 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.129+0000 7f00aeffd640 1 -- 172.21.15.1:0/3041270789 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f00a8045070 con 0x7f00b8154870 2024-05-04T02:20:17.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.130+0000 7f00aeffd640 1 --2- 172.21.15.1:0/3041270789 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f0098076350 0x7f0098078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:17.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.130+0000 7f00b659c640 1 --2- 172.21.15.1:0/3041270789 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f0098076350 0x7f0098078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:17.132 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.131+0000 7f00b659c640 1 --2- 172.21.15.1:0/3041270789 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f0098076350 0x7f0098078860 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f00b00012e0 tx=0x7f00b0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:17.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.135+0000 7f00aeffd640 1 -- 172.21.15.1:0/3041270789 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f00a807da20 con 0x7f00b8154870 2024-05-04T02:20:17.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.145+0000 7f00aeffd640 1 -- 172.21.15.1:0/3041270789 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f00a8081790 con 0x7f00b8154870 2024-05-04T02:20:17.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.352+0000 7f00bcca7640 1 -- 172.21.15.1:0/3041270789 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f00b8157560 con 0x7f00b8154870 2024-05-04T02:20:17.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.475+0000 7f00aeffd640 1 -- 172.21.15.1:0/3041270789 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16545 (secure 0 0 0) 0x7f00a8085a90 con 0x7f00b8154870 2024-05-04T02:20:17.478 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:20:17.478 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":22,"fsid":"b45b4a9a-b84c-4a66-907b-43f0ca45e7c0","created":"2024-05-04T02:19:44.555410+0000","modified":"2024-05-04T02:20:16.732607+0000","last_up_change":"2024-05-04T02:20:00.162760+0000","last_in_change":"2024-05-04T02:19:50.811018+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-04T02:19:59.664283+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-04T02:20:12.783217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-04T02:20:13.872502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d8ad7964-7bd6-4ba9-ae4f-b55d7566b18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":2338132980},{"type":"v1","addr":"172.21.15.1:6801","nonce":2338132980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":2338132980},{"type":"v1","addr":"172.21.15.1:6803","nonce":2338132980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":2338132980},{"type":"v1","addr":"172.21.15.1:6807","nonce":2338132980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":2338132980},{"type":"v1","addr":"172.21.15.1:6805","nonce":2338132980}]},"public_addr":"172.21.15.1:6801/2338132980","cluster_addr":"172.21.15.1:6803/2338132980","heartbeat_back_addr":"172.21.15.1:6807/2338132980","heartbeat_front_addr":"172.21.15.1:6805/2338132980","state":["exists","up"]},{"osd":1,"uuid":"ce155f6d-7e0c-47c8-a0e0-fb53ff0c7726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":459131368},{"type":"v1","addr":"172.21.15.1:6817","nonce":459131368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":459131368},{"type":"v1","addr":"172.21.15.1:6819","nonce":459131368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":459131368},{"type":"v1","addr":"172.21.15.1:6823","nonce":459131368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":459131368},{"type":"v1","addr":"172.21.15.1:6821","nonce":459131368}]},"public_addr":"172.21.15.1:6817/459131368","cluster_addr":"172.21.15.1:6819/459131368","heartbeat_back_addr":"172.21.15.1:6823/459131368","heartbeat_front_addr":"172.21.15.1:6821/459131368","state":["exists","up"]},{"osd":2,"uuid":"7847c281-5da0-4d7d-b888-7f49d99a50b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":3463851105},{"type":"v1","addr":"172.21.15.1:6809","nonce":3463851105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":3463851105},{"type":"v1","addr":"172.21.15.1:6811","nonce":3463851105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":3463851105},{"type":"v1","addr":"172.21.15.1:6815","nonce":3463851105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":3463851105},{"type":"v1","addr":"172.21.15.1:6813","nonce":3463851105}]},"public_addr":"172.21.15.1:6809/3463851105","cluster_addr":"172.21.15.1:6811/3463851105","heartbeat_back_addr":"172.21.15.1:6815/3463851105","heartbeat_front_addr":"172.21.15.1:6813/3463851105","state":["exists","up"]},{"osd":3,"uuid":"26386eba-d106-4abe-8d6b-7dccdd106cb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":3859721636},{"type":"v1","addr":"172.21.15.1:6825","nonce":3859721636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":3859721636},{"type":"v1","addr":"172.21.15.1:6827","nonce":3859721636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":3859721636},{"type":"v1","addr":"172.21.15.1:6831","nonce":3859721636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":3859721636},{"type":"v1","addr":"172.21.15.1:6829","nonce":3859721636}]},"public_addr":"172.21.15.1:6825/3859721636","cluster_addr":"172.21.15.1:6827/3859721636","heartbeat_back_addr":"172.21.15.1:6831/3859721636","heartbeat_front_addr":"172.21.15.1:6829/3859721636","state":["exists","up"]},{"osd":4,"uuid":"2ba3d1b3-c5fa-4ff4-bf5d-772e77d79c59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":2335597098},{"type":"v1","addr":"172.21.15.107:6803","nonce":2335597098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":2335597098},{"type":"v1","addr":"172.21.15.107:6805","nonce":2335597098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2335597098},{"type":"v1","addr":"172.21.15.107:6810","nonce":2335597098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":2335597098},{"type":"v1","addr":"172.21.15.107:6807","nonce":2335597098}]},"public_addr":"172.21.15.107:6803/2335597098","cluster_addr":"172.21.15.107:6805/2335597098","heartbeat_back_addr":"172.21.15.107:6810/2335597098","heartbeat_front_addr":"172.21.15.107:6807/2335597098","state":["exists","up"]},{"osd":5,"uuid":"c42646eb-6e14-4b42-a7a3-54f99f1662bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":1274544305},{"type":"v1","addr":"172.21.15.107:6819","nonce":1274544305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":1274544305},{"type":"v1","addr":"172.21.15.107:6821","nonce":1274544305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":1274544305},{"type":"v1","addr":"172.21.15.107:6825","nonce":1274544305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":1274544305},{"type":"v1","addr":"172.21.15.107:6823","nonce":1274544305}]},"public_addr":"172.21.15.107:6819/1274544305","cluster_addr":"172.21.15.107:6821/1274544305","heartbeat_back_addr":"172.21.15.107:6825/1274544305","heartbeat_front_addr":"172.21.15.107:6823/1274544305","state":["exists","up"]},{"osd":6,"uuid":"a8a2dbb8-0107-4b8e-93c3-5fa7e6af15a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6809","nonce":941385299},{"type":"v1","addr":"172.21.15.107:6811","nonce":941385299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":941385299},{"type":"v1","addr":"172.21.15.107:6813","nonce":941385299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":941385299},{"type":"v1","addr":"172.21.15.107:6817","nonce":941385299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":941385299},{"type":"v1","addr":"172.21.15.107:6815","nonce":941385299}]},"public_addr":"172.21.15.107:6811/941385299","cluster_addr":"172.21.15.107:6813/941385299","heartbeat_back_addr":"172.21.15.107:6817/941385299","heartbeat_front_addr":"172.21.15.107:6815/941385299","state":["exists","up"]},{"osd":7,"uuid":"3b9bdc70-8831-4df9-8d50-362aa0f02aed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":1723298539},{"type":"v1","addr":"172.21.15.107:6827","nonce":1723298539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":1723298539},{"type":"v1","addr":"172.21.15.107:6829","nonce":1723298539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":1723298539},{"type":"v1","addr":"172.21.15.107:6833","nonce":1723298539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":1723298539},{"type":"v1","addr":"172.21.15.107:6831","nonce":1723298539}]},"public_addr":"172.21.15.107:6827/1723298539","cluster_addr":"172.21.15.107:6829/1723298539","heartbeat_back_addr":"172.21.15.107:6833/1723298539","heartbeat_front_addr":"172.21.15.107:6831/1723298539","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T02:19:56.277538+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T02:19:56.402984+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T02:19:56.374787+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T02:19:56.461914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T02:19:56.384856+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T02:19:56.469958+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T02:19:56.489376+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T02:19:56.393205+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-04T02:20:17.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.478+0000 7f00bcca7640 1 -- 172.21.15.1:0/3041270789 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f0098076350 msgr2=0x7f0098078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:17.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.478+0000 7f00bcca7640 1 --2- 172.21.15.1:0/3041270789 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f0098076350 0x7f0098078860 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f00b00012e0 tx=0x7f00b0009040 comp rx=0 tx=0).stop 2024-05-04T02:20:17.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.478+0000 7f00bcca7640 1 -- 172.21.15.1:0/3041270789 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f00b8154870 msgr2=0x7f00b8152f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:17.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.478+0000 7f00bcca7640 1 --2- 172.21.15.1:0/3041270789 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f00b8154870 0x7f00b8152f80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f00a802a8f0 tx=0x7f00a80046c0 comp rx=0 tx=0).stop 2024-05-04T02:20:17.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.478+0000 7f00bcca7640 1 -- 172.21.15.1:0/3041270789 shutdown_connections 2024-05-04T02:20:17.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.478+0000 7f00bcca7640 1 --2- 172.21.15.1:0/3041270789 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f0098076350 0x7f0098078860 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:17.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.478+0000 7f00bcca7640 1 --2- 172.21.15.1:0/3041270789 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f00b8154870 0x7f00b8152f80 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:17.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.478+0000 7f00bcca7640 1 --2- 172.21.15.1:0/3041270789 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f00b80b1d10 0x7f00b8157940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:17.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.478+0000 7f00bcca7640 1 --2- 172.21.15.1:0/3041270789 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f00b806de70 0x7f00b80c67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:17.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.478+0000 7f00bcca7640 1 -- 172.21.15.1:0/3041270789 >> 172.21.15.1:0/3041270789 conn(0x7f00b8070e50 msgr2=0x7f00b80c8e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:17.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.478+0000 7f00bcca7640 1 -- 172.21.15.1:0/3041270789 shutdown_connections 2024-05-04T02:20:17.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.478+0000 7f00bcca7640 1 -- 172.21.15.1:0/3041270789 wait complete. 2024-05-04T02:20:17.493 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-04T02:20:17.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.605+0000 7f8c6da22640 1 Processor -- start 2024-05-04T02:20:17.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.605+0000 7f8c6da22640 1 -- start start 2024-05-04T02:20:17.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.606+0000 7f8c6da22640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f8c680c8330 0x7f8c6815fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:17.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.606+0000 7f8c6da22640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f8c680c8740 0x7f8c68160140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:17.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.606+0000 7f8c6da22640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c6808d6f0 con 0x7f8c680c7e70 2024-05-04T02:20:17.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.606+0000 7f8c6da22640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f8c680c59f0 con 0x7f8c680c8330 2024-05-04T02:20:17.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.606+0000 7f8c6da22640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f8c680c3650 con 0x7f8c680c8740 2024-05-04T02:20:17.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.607+0000 7f8c677fe640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f8c680c8740 0x7f8c68160140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:17.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.607+0000 7f8c667fc640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f8c680c8330 0x7f8c6815fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:17.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.607+0000 7f8c66ffd640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f8c680c7e70 0x7f8c68159da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:38912/0 (socket says 172.21.15.1:38912) 2024-05-04T02:20:17.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.607+0000 7f8c66ffd640 1 -- 172.21.15.1:0/2861810128 learned_addr learned my addr 172.21.15.1:0/2861810128 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-05-04T02:20:17.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.610+0000 7f8c677fe640 1 -- 172.21.15.1:0/2861810128 >> v2:172.21.15.1:3300/0 conn(0x7f8c680c8330 msgr2=0x7f8c6815fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:17.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.610+0000 7f8c677fe640 1 --2- 172.21.15.1:0/2861810128 >> v2:172.21.15.1:3300/0 conn(0x7f8c680c8330 0x7f8c6815fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:17.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.610+0000 7f8c677fe640 1 -- 172.21.15.1:0/2861810128 >> v1:172.21.15.1:6789/0 conn(0x7f8c680c7e70 legacy=0x7f8c68159da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:17.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.611+0000 7f8c677fe640 1 -- 172.21.15.1:0/2861810128 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c680c4de0 con 0x7f8c680c8740 2024-05-04T02:20:17.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.613+0000 7f8c677fe640 1 --2- 172.21.15.1:0/2861810128 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8c680c8740 0x7f8c68160140 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8c680cbad0 tx=0x7f8c6002a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a4c0f9d25fb8fa9 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:17.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.617+0000 7f8c65ffb640 1 -- 172.21.15.1:0/2861810128 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c60007740 con 0x7f8c680c8740 2024-05-04T02:20:17.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.617+0000 7f8c65ffb640 1 -- 172.21.15.1:0/2861810128 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c600078e0 con 0x7f8c680c8740 2024-05-04T02:20:17.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.617+0000 7f8c65ffb640 1 -- 172.21.15.1:0/2861810128 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c60007cb0 con 0x7f8c680c8740 2024-05-04T02:20:17.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.618+0000 7f8c6da22640 1 -- 172.21.15.1:0/2861810128 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8c680c8740 msgr2=0x7f8c68160140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:17.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.618+0000 7f8c6da22640 1 --2- 172.21.15.1:0/2861810128 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8c680c8740 0x7f8c68160140 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8c680cbad0 tx=0x7f8c6002a710 comp rx=0 tx=0).stop 2024-05-04T02:20:17.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.618+0000 7f8c6da22640 1 -- 172.21.15.1:0/2861810128 shutdown_connections 2024-05-04T02:20:17.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.618+0000 7f8c6da22640 1 --2- 172.21.15.1:0/2861810128 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8c680c8740 0x7f8c68160140 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:17.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.618+0000 7f8c6da22640 1 --2- 172.21.15.1:0/2861810128 >> v2:172.21.15.1:3300/0 conn(0x7f8c680c8330 0x7f8c6815fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:17.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.618+0000 7f8c6da22640 1 -- 172.21.15.1:0/2861810128 >> 172.21.15.1:0/2861810128 conn(0x7f8c680cf6e0 msgr2=0x7f8c680cfaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:17.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.618+0000 7f8c6da22640 1 -- 172.21.15.1:0/2861810128 shutdown_connections 2024-05-04T02:20:17.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.618+0000 7f8c6da22640 1 -- 172.21.15.1:0/2861810128 wait complete. 2024-05-04T02:20:17.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.620+0000 7f8c6da22640 1 Processor -- start 2024-05-04T02:20:17.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.620+0000 7f8c6da22640 1 -- start start 2024-05-04T02:20:17.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.621+0000 7f8c6da22640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8c680c7e70 0x7f8c681f6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:17.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.621+0000 7f8c6da22640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8c680c8330 0x7f8c68070280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:17.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.621+0000 7f8c6da22640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8c680c8740 0x7f8c68156a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:17.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.621+0000 7f8c6da22640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8c680c5680 con 0x7f8c680c8330 2024-05-04T02:20:17.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.621+0000 7f8c6da22640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f8c680c53a0 con 0x7f8c680c8740 2024-05-04T02:20:17.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.621+0000 7f8c6da22640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f8c680c5e80 con 0x7f8c680c7e70 2024-05-04T02:20:17.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.622+0000 7f8c66ffd640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8c680c7e70 0x7f8c681f6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:17.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.622+0000 7f8c667fc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8c680c8330 0x7f8c68070280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:17.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.622+0000 7f8c677fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8c680c8740 0x7f8c68156a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:17.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.622+0000 7f8c66ffd640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8c680c7e70 0x7f8c681f6460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.1:51980/0 (socket says 172.21.15.1:51980) 2024-05-04T02:20:17.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.622+0000 7f8c66ffd640 1 -- 172.21.15.1:0/2828748446 learned_addr learned my addr 172.21.15.1:0/2828748446 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:17.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.626+0000 7f8c66ffd640 1 -- 172.21.15.1:0/2828748446 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8c680c8740 msgr2=0x7f8c68156a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:17.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.626+0000 7f8c66ffd640 1 --2- 172.21.15.1:0/2828748446 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8c680c8740 0x7f8c68156a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:17.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.626+0000 7f8c66ffd640 1 -- 172.21.15.1:0/2828748446 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8c680c8330 msgr2=0x7f8c68070280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:17.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.626+0000 7f8c66ffd640 1 --2- 172.21.15.1:0/2828748446 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8c680c8330 0x7f8c68070280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:17.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.626+0000 7f8c66ffd640 1 -- 172.21.15.1:0/2828748446 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c681f69a0 con 0x7f8c680c7e70 2024-05-04T02:20:17.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.629+0000 7f8c66ffd640 1 --2- 172.21.15.1:0/2828748446 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8c680c7e70 0x7f8c681f6460 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c00c400 tx=0x7f8c5c00c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:17.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.633+0000 7f8c4ffff640 1 -- 172.21.15.1:0/2828748446 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c5c017070 con 0x7f8c680c7e70 2024-05-04T02:20:17.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.633+0000 7f8c4ffff640 1 -- 172.21.15.1:0/2828748446 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c5c005d00 con 0x7f8c680c7e70 2024-05-04T02:20:17.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.633+0000 7f8c4ffff640 1 -- 172.21.15.1:0/2828748446 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c5c007310 con 0x7f8c680c7e70 2024-05-04T02:20:17.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.633+0000 7f8c6da22640 1 -- 172.21.15.1:0/2828748446 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c681e39e0 con 0x7f8c680c7e70 2024-05-04T02:20:17.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.633+0000 7f8c6da22640 1 -- 172.21.15.1:0/2828748446 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c681e4240 con 0x7f8c680c7e70 2024-05-04T02:20:17.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.634+0000 7f8c6da22640 1 -- 172.21.15.1:0/2828748446 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c68076740 con 0x7f8c680c7e70 2024-05-04T02:20:17.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.917+0000 7f8c4ffff640 1 -- 172.21.15.1:0/2828748446 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8c5c01a070 con 0x7f8c680c7e70 2024-05-04T02:20:17.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.917+0000 7f8c4ffff640 1 --2- 172.21.15.1:0/2828748446 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f8c54076300 0x7f8c54078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:17.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.917+0000 7f8c667fc640 1 --2- 172.21.15.1:0/2828748446 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f8c54076300 0x7f8c54078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:17.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.918+0000 7f8c667fc640 1 --2- 172.21.15.1:0/2828748446 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f8c54076300 0x7f8c54078810 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8c68076640 tx=0x7f8c58009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:17.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.922+0000 7f8c4ffff640 1 -- 172.21.15.1:0/2828748446 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f8c5c05c320 con 0x7f8c680c7e70 2024-05-04T02:20:17.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:17.936+0000 7f8c4ffff640 1 -- 172.21.15.1:0/2828748446 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8c5c021020 con 0x7f8c680c7e70 2024-05-04T02:20:18.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:18.139+0000 7f8c6da22640 1 -- 172.21.15.1:0/2828748446 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8c680cef40 con 0x7f8c680c7e70 2024-05-04T02:20:18.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:18.244+0000 7f8c4ffff640 1 -- 172.21.15.1:0/2828748446 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16545 (secure 0 0 0) 0x7f8c5c060090 con 0x7f8c680c7e70 2024-05-04T02:20:18.247 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:20:18.247 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":23,"fsid":"b45b4a9a-b84c-4a66-907b-43f0ca45e7c0","created":"2024-05-04T02:19:44.555410+0000","modified":"2024-05-04T02:20:17.793991+0000","last_up_change":"2024-05-04T02:20:00.162760+0000","last_in_change":"2024-05-04T02:19:50.811018+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-04T02:19:59.664283+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-04T02:20:12.783217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-04T02:20:13.872502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d8ad7964-7bd6-4ba9-ae4f-b55d7566b18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":2338132980},{"type":"v1","addr":"172.21.15.1:6801","nonce":2338132980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":2338132980},{"type":"v1","addr":"172.21.15.1:6803","nonce":2338132980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":2338132980},{"type":"v1","addr":"172.21.15.1:6807","nonce":2338132980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":2338132980},{"type":"v1","addr":"172.21.15.1:6805","nonce":2338132980}]},"public_addr":"172.21.15.1:6801/2338132980","cluster_addr":"172.21.15.1:6803/2338132980","heartbeat_back_addr":"172.21.15.1:6807/2338132980","heartbeat_front_addr":"172.21.15.1:6805/2338132980","state":["exists","up"]},{"osd":1,"uuid":"ce155f6d-7e0c-47c8-a0e0-fb53ff0c7726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":459131368},{"type":"v1","addr":"172.21.15.1:6817","nonce":459131368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":459131368},{"type":"v1","addr":"172.21.15.1:6819","nonce":459131368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":459131368},{"type":"v1","addr":"172.21.15.1:6823","nonce":459131368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":459131368},{"type":"v1","addr":"172.21.15.1:6821","nonce":459131368}]},"public_addr":"172.21.15.1:6817/459131368","cluster_addr":"172.21.15.1:6819/459131368","heartbeat_back_addr":"172.21.15.1:6823/459131368","heartbeat_front_addr":"172.21.15.1:6821/459131368","state":["exists","up"]},{"osd":2,"uuid":"7847c281-5da0-4d7d-b888-7f49d99a50b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":3463851105},{"type":"v1","addr":"172.21.15.1:6809","nonce":3463851105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":3463851105},{"type":"v1","addr":"172.21.15.1:6811","nonce":3463851105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":3463851105},{"type":"v1","addr":"172.21.15.1:6815","nonce":3463851105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":3463851105},{"type":"v1","addr":"172.21.15.1:6813","nonce":3463851105}]},"public_addr":"172.21.15.1:6809/3463851105","cluster_addr":"172.21.15.1:6811/3463851105","heartbeat_back_addr":"172.21.15.1:6815/3463851105","heartbeat_front_addr":"172.21.15.1:6813/3463851105","state":["exists","up"]},{"osd":3,"uuid":"26386eba-d106-4abe-8d6b-7dccdd106cb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":3859721636},{"type":"v1","addr":"172.21.15.1:6825","nonce":3859721636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":3859721636},{"type":"v1","addr":"172.21.15.1:6827","nonce":3859721636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":3859721636},{"type":"v1","addr":"172.21.15.1:6831","nonce":3859721636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":3859721636},{"type":"v1","addr":"172.21.15.1:6829","nonce":3859721636}]},"public_addr":"172.21.15.1:6825/3859721636","cluster_addr":"172.21.15.1:6827/3859721636","heartbeat_back_addr":"172.21.15.1:6831/3859721636","heartbeat_front_addr":"172.21.15.1:6829/3859721636","state":["exists","up"]},{"osd":4,"uuid":"2ba3d1b3-c5fa-4ff4-bf5d-772e77d79c59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":2335597098},{"type":"v1","addr":"172.21.15.107:6803","nonce":2335597098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":2335597098},{"type":"v1","addr":"172.21.15.107:6805","nonce":2335597098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2335597098},{"type":"v1","addr":"172.21.15.107:6810","nonce":2335597098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":2335597098},{"type":"v1","addr":"172.21.15.107:6807","nonce":2335597098}]},"public_addr":"172.21.15.107:6803/2335597098","cluster_addr":"172.21.15.107:6805/2335597098","heartbeat_back_addr":"172.21.15.107:6810/2335597098","heartbeat_front_addr":"172.21.15.107:6807/2335597098","state":["exists","up"]},{"osd":5,"uuid":"c42646eb-6e14-4b42-a7a3-54f99f1662bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":1274544305},{"type":"v1","addr":"172.21.15.107:6819","nonce":1274544305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":1274544305},{"type":"v1","addr":"172.21.15.107:6821","nonce":1274544305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":1274544305},{"type":"v1","addr":"172.21.15.107:6825","nonce":1274544305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":1274544305},{"type":"v1","addr":"172.21.15.107:6823","nonce":1274544305}]},"public_addr":"172.21.15.107:6819/1274544305","cluster_addr":"172.21.15.107:6821/1274544305","heartbeat_back_addr":"172.21.15.107:6825/1274544305","heartbeat_front_addr":"172.21.15.107:6823/1274544305","state":["exists","up"]},{"osd":6,"uuid":"a8a2dbb8-0107-4b8e-93c3-5fa7e6af15a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6809","nonce":941385299},{"type":"v1","addr":"172.21.15.107:6811","nonce":941385299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":941385299},{"type":"v1","addr":"172.21.15.107:6813","nonce":941385299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":941385299},{"type":"v1","addr":"172.21.15.107:6817","nonce":941385299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":941385299},{"type":"v1","addr":"172.21.15.107:6815","nonce":941385299}]},"public_addr":"172.21.15.107:6811/941385299","cluster_addr":"172.21.15.107:6813/941385299","heartbeat_back_addr":"172.21.15.107:6817/941385299","heartbeat_front_addr":"172.21.15.107:6815/941385299","state":["exists","up"]},{"osd":7,"uuid":"3b9bdc70-8831-4df9-8d50-362aa0f02aed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":1723298539},{"type":"v1","addr":"172.21.15.107:6827","nonce":1723298539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":1723298539},{"type":"v1","addr":"172.21.15.107:6829","nonce":1723298539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":1723298539},{"type":"v1","addr":"172.21.15.107:6833","nonce":1723298539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":1723298539},{"type":"v1","addr":"172.21.15.107:6831","nonce":1723298539}]},"public_addr":"172.21.15.107:6827/1723298539","cluster_addr":"172.21.15.107:6829/1723298539","heartbeat_back_addr":"172.21.15.107:6833/1723298539","heartbeat_front_addr":"172.21.15.107:6831/1723298539","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T02:19:56.277538+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T02:19:56.402984+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T02:19:56.374787+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T02:19:56.461914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T02:19:56.384856+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T02:19:56.469958+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T02:19:56.489376+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T02:19:56.393205+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-04T02:20:18.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:18.246+0000 7f8c6da22640 1 -- 172.21.15.1:0/2828748446 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f8c54076300 msgr2=0x7f8c54078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:18.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:18.246+0000 7f8c6da22640 1 --2- 172.21.15.1:0/2828748446 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f8c54076300 0x7f8c54078810 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8c68076640 tx=0x7f8c58009190 comp rx=0 tx=0).stop 2024-05-04T02:20:18.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:18.246+0000 7f8c6da22640 1 -- 172.21.15.1:0/2828748446 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8c680c7e70 msgr2=0x7f8c681f6460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:18.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:18.246+0000 7f8c6da22640 1 --2- 172.21.15.1:0/2828748446 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8c680c7e70 0x7f8c681f6460 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c00c400 tx=0x7f8c5c00c8c0 comp rx=0 tx=0).stop 2024-05-04T02:20:18.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:18.246+0000 7f8c6da22640 1 -- 172.21.15.1:0/2828748446 shutdown_connections 2024-05-04T02:20:18.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:18.246+0000 7f8c6da22640 1 --2- 172.21.15.1:0/2828748446 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f8c54076300 0x7f8c54078810 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:18.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:18.246+0000 7f8c6da22640 1 --2- 172.21.15.1:0/2828748446 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8c680c8740 0x7f8c68156a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:18.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:18.246+0000 7f8c6da22640 1 --2- 172.21.15.1:0/2828748446 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8c680c8330 0x7f8c68070280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:18.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:18.246+0000 7f8c6da22640 1 --2- 172.21.15.1:0/2828748446 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8c680c7e70 0x7f8c681f6460 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:18.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:18.246+0000 7f8c6da22640 1 -- 172.21.15.1:0/2828748446 >> 172.21.15.1:0/2828748446 conn(0x7f8c680cf6e0 msgr2=0x7f8c68159da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:18.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:18.246+0000 7f8c6da22640 1 -- 172.21.15.1:0/2828748446 shutdown_connections 2024-05-04T02:20:18.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:18.246+0000 7f8c6da22640 1 -- 172.21.15.1:0/2828748446 wait complete. 2024-05-04T02:20:18.261 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-04T02:20:18.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:18.377+0000 7fd7cb3f3640 1 Processor -- start 2024-05-04T02:20:18.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:18.377+0000 7fd7cb3f3640 1 -- start start 2024-05-04T02:20:18.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:18.379+0000 7fd7cb3f3640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fd7c406f0a0 0x7fd7c4156580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:18.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:18.379+0000 7fd7cb3f3640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd7c415fe60 0x7fd7c4166e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:18.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:18.379+0000 7fd7cb3f3640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7c415c5c0 con 0x7fd7c415fa50 2024-05-04T02:20:18.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:18.379+0000 7fd7cb3f3640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7fd7c406f6c0 con 0x7fd7c406f0a0 2024-05-04T02:20:18.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:18.379+0000 7fd7cb3f3640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd7c415d310 con 0x7fd7c415fe60 2024-05-04T02:20:18.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:18.379+0000 7fd7c9990640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd7c415fe60 0x7fd7c4166e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:18.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:18.379+0000 7fd7c918f640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fd7c406f0a0 0x7fd7c4156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:18.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:18.379+0000 7fd7c898e640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fd7c415fa50 0x7fd7c40708b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.1:47722/0 (socket says 172.21.15.1:47722) 2024-05-04T02:20:18.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:18.380+0000 7fd7c898e640 1 -- 172.21.15.1:0/1936469225 learned_addr learned my addr 172.21.15.1:0/1936469225 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-05-04T02:20:18.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:18.382+0000 7fd7c9990640 1 -- 172.21.15.1:0/1936469225 >> v2:172.21.15.1:3300/0 conn(0x7fd7c406f0a0 msgr2=0x7fd7c4156580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:18.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:18.382+0000 7fd7c9990640 1 --2- 172.21.15.1:0/1936469225 >> v2:172.21.15.1:3300/0 conn(0x7fd7c406f0a0 0x7fd7c4156580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:18.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:18.382+0000 7fd7c9990640 1 -- 172.21.15.1:0/1936469225 >> v1:172.21.15.107:6789/0 conn(0x7fd7c415fa50 legacy=0x7fd7c40708b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:18.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:18.382+0000 7fd7c9990640 1 -- 172.21.15.1:0/1936469225 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7c415c830 con 0x7fd7c415fe60 2024-05-04T02:20:18.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:18.384+0000 7fd7c9990640 1 --2- 172.21.15.1:0/1936469225 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd7c415fe60 0x7fd7c4166e30 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc009d90 tx=0x7fd7bc02a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dcbd65a5b9c6c6e6 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:18.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:18.388+0000 7fd7bbfff640 1 -- 172.21.15.1:0/1936469225 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7bc007740 con 0x7fd7c415fe60 2024-05-04T02:20:18.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:18.388+0000 7fd7bbfff640 1 -- 172.21.15.1:0/1936469225 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7bc0078e0 con 0x7fd7c415fe60 2024-05-04T02:20:18.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:18.388+0000 7fd7bbfff640 1 -- 172.21.15.1:0/1936469225 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7bc007cb0 con 0x7fd7c415fe60 2024-05-04T02:20:18.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:18.389+0000 7fd7cb3f3640 1 -- 172.21.15.1:0/1936469225 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd7c415fe60 msgr2=0x7fd7c4166e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:18.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:18.389+0000 7fd7cb3f3640 1 --2- 172.21.15.1:0/1936469225 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd7c415fe60 0x7fd7c4166e30 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc009d90 tx=0x7fd7bc02a660 comp rx=0 tx=0).stop 2024-05-04T02:20:18.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:18.389+0000 7fd7cb3f3640 1 -- 172.21.15.1:0/1936469225 shutdown_connections 2024-05-04T02:20:18.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:18.389+0000 7fd7cb3f3640 1 --2- 172.21.15.1:0/1936469225 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd7c415fe60 0x7fd7c4166e30 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:18.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:18.389+0000 7fd7cb3f3640 1 --2- 172.21.15.1:0/1936469225 >> v2:172.21.15.1:3300/0 conn(0x7fd7c406f0a0 0x7fd7c4156580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:18.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:18.389+0000 7fd7cb3f3640 1 -- 172.21.15.1:0/1936469225 >> 172.21.15.1:0/1936469225 conn(0x7fd7c40cb8e0 msgr2=0x7fd7c40ce5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:18.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:18.389+0000 7fd7cb3f3640 1 -- 172.21.15.1:0/1936469225 shutdown_connections 2024-05-04T02:20:18.393 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:18.389+0000 7fd7cb3f3640 1 -- 172.21.15.1:0/1936469225 wait complete. 2024-05-04T02:20:18.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:18.391+0000 7fd7cb3f3640 1 Processor -- start 2024-05-04T02:20:18.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:18.391+0000 7fd7cb3f3640 1 -- start start 2024-05-04T02:20:18.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:18.392+0000 7fd7cb3f3640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7c406f0a0 0x7fd7c414ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:18.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:18.392+0000 7fd7cb3f3640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd7c415fa50 0x7fd7c41f3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:18.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:18.392+0000 7fd7cb3f3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7c415fe60 0x7fd7c40c9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:18.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:18.392+0000 7fd7cb3f3640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c406f980 con 0x7fd7c415fe60 2024-05-04T02:20:18.396 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:18.392+0000 7fd7cb3f3640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c415cdf0 con 0x7fd7c406f0a0 2024-05-04T02:20:18.396 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:18.392+0000 7fd7cb3f3640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd7c40cc3b0 con 0x7fd7c415fa50 2024-05-04T02:20:18.396 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:18.393+0000 7fd7c9990640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7c415fe60 0x7fd7c40c9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:18.396 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:18.393+0000 7fd7c898e640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd7c415fa50 0x7fd7c41f3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:18.396 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:18.393+0000 7fd7c918f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7c406f0a0 0x7fd7c414ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:18.396 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:18.393+0000 7fd7c9990640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7c415fe60 0x7fd7c40c9fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46590/0 (socket says 172.21.15.1:46590) 2024-05-04T02:20:18.396 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:18.393+0000 7fd7c9990640 1 -- 172.21.15.1:0/2358832079 learned_addr learned my addr 172.21.15.1:0/2358832079 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:18.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:18.397+0000 7fd7c898e640 1 -- 172.21.15.1:0/2358832079 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7c406f0a0 msgr2=0x7fd7c414ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:18.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:18.397+0000 7fd7c898e640 1 --2- 172.21.15.1:0/2358832079 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7c406f0a0 0x7fd7c414ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:18.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:18.397+0000 7fd7c898e640 1 -- 172.21.15.1:0/2358832079 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7c415fe60 msgr2=0x7fd7c40c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:18.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:18.397+0000 7fd7c898e640 1 --2- 172.21.15.1:0/2358832079 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7c415fe60 0x7fd7c40c9fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:18.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:18.397+0000 7fd7c898e640 1 -- 172.21.15.1:0/2358832079 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7c41504a0 con 0x7fd7c415fa50 2024-05-04T02:20:18.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:18.399+0000 7fd7c898e640 1 --2- 172.21.15.1:0/2358832079 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd7c415fa50 0x7fd7c41f3520 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd7c000c310 tx=0x7fd7c000c7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:18.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:18.403+0000 7fd7b9ffb640 1 -- 172.21.15.1:0/2358832079 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7c0017070 con 0x7fd7c415fa50 2024-05-04T02:20:18.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:18.403+0000 7fd7b9ffb640 1 -- 172.21.15.1:0/2358832079 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7c0005ce0 con 0x7fd7c415fa50 2024-05-04T02:20:18.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:18.403+0000 7fd7cb3f3640 1 -- 172.21.15.1:0/2358832079 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7c414f4c0 con 0x7fd7c415fa50 2024-05-04T02:20:18.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:18.403+0000 7fd7b9ffb640 1 -- 172.21.15.1:0/2358832079 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7c0007310 con 0x7fd7c415fa50 2024-05-04T02:20:18.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:18.403+0000 7fd7cb3f3640 1 -- 172.21.15.1:0/2358832079 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7c406d980 con 0x7fd7c415fa50 2024-05-04T02:20:18.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:18.404+0000 7fd7cb3f3640 1 -- 172.21.15.1:0/2358832079 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7c4063fb0 con 0x7fd7c415fa50 2024-05-04T02:20:18.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:18.688+0000 7fd7b9ffb640 1 -- 172.21.15.1:0/2358832079 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd7c001a070 con 0x7fd7c415fa50 2024-05-04T02:20:18.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:18.688+0000 7fd7b9ffb640 1 --2- 172.21.15.1:0/2358832079 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fd7a8076350 0x7fd7a8078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:18.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:18.688+0000 7fd7b9ffb640 1 -- 172.21.15.1:0/2358832079 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fd7c0096ca0 con 0x7fd7c415fa50 2024-05-04T02:20:18.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:18.688+0000 7fd7c918f640 1 --2- 172.21.15.1:0/2358832079 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fd7a8076350 0x7fd7a8078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:18.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:18.689+0000 7fd7c918f640 1 --2- 172.21.15.1:0/2358832079 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fd7a8076350 0x7fd7a8078860 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd7b4009aa0 tx=0x7fd7b4009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:18.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:18.698+0000 7fd7b9ffb640 1 -- 172.21.15.1:0/2358832079 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd7c0021020 con 0x7fd7c415fa50 2024-05-04T02:20:18.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:18.927+0000 7fd7cb3f3640 1 -- 172.21.15.1:0/2358832079 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fd7c40cd960 con 0x7fd7c415fa50 2024-05-04T02:20:19.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:19.278+0000 7fd7b9ffb640 1 -- 172.21.15.1:0/2358832079 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) ==== 118+0+0 (secure 0 0 0) 0x7fd7c40cd960 con 0x7fd7c415fa50 2024-05-04T02:20:19.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:19.280+0000 7fd7cb3f3640 1 -- 172.21.15.1:0/2358832079 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fd7a8076350 msgr2=0x7fd7a8078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:19.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:19.280+0000 7fd7cb3f3640 1 --2- 172.21.15.1:0/2358832079 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fd7a8076350 0x7fd7a8078860 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd7b4009aa0 tx=0x7fd7b4009190 comp rx=0 tx=0).stop 2024-05-04T02:20:19.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:19.280+0000 7fd7cb3f3640 1 -- 172.21.15.1:0/2358832079 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd7c415fa50 msgr2=0x7fd7c41f3520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:19.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:19.280+0000 7fd7cb3f3640 1 --2- 172.21.15.1:0/2358832079 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd7c415fa50 0x7fd7c41f3520 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd7c000c310 tx=0x7fd7c000c7d0 comp rx=0 tx=0).stop 2024-05-04T02:20:19.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:19.280+0000 7fd7cb3f3640 1 -- 172.21.15.1:0/2358832079 shutdown_connections 2024-05-04T02:20:19.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:19.280+0000 7fd7cb3f3640 1 --2- 172.21.15.1:0/2358832079 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fd7a8076350 0x7fd7a8078860 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:19.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:19.280+0000 7fd7cb3f3640 1 --2- 172.21.15.1:0/2358832079 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd7c415fe60 0x7fd7c40c9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:19.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:19.280+0000 7fd7cb3f3640 1 --2- 172.21.15.1:0/2358832079 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd7c415fa50 0x7fd7c41f3520 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:19.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:19.280+0000 7fd7cb3f3640 1 --2- 172.21.15.1:0/2358832079 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd7c406f0a0 0x7fd7c414ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:19.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:19.280+0000 7fd7cb3f3640 1 -- 172.21.15.1:0/2358832079 >> 172.21.15.1:0/2358832079 conn(0x7fd7c40cb8e0 msgr2=0x7fd7c415d880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:19.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:19.280+0000 7fd7cb3f3640 1 -- 172.21.15.1:0/2358832079 shutdown_connections 2024-05-04T02:20:19.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:19.280+0000 7fd7cb3f3640 1 -- 172.21.15.1:0/2358832079 wait complete. 2024-05-04T02:20:19.293 DEBUG:tasks.cephfs.filesystem:fs_config: {'session_timeout': 300} 2024-05-04T02:20:19.294 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-04T02:20:19.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:19.407+0000 7f54d94f9640 1 Processor -- start 2024-05-04T02:20:19.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:19.408+0000 7f54d94f9640 1 -- start start 2024-05-04T02:20:19.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:19.409+0000 7f54d94f9640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f54d40cdcf0 0x7f54d406d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:19.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:19.409+0000 7f54d94f9640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f54d415c4a0 0x7f54d415c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:19.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:19.409+0000 7f54d94f9640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54d40cd3b0 con 0x7f54d415cdf0 2024-05-04T02:20:19.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:19.409+0000 7f54d94f9640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f54d40b74b0 con 0x7f54d40cdcf0 2024-05-04T02:20:19.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:19.409+0000 7f54d94f9640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f54d406d1a0 con 0x7f54d415c4a0 2024-05-04T02:20:19.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:19.410+0000 7f54d27fc640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f54d415c4a0 0x7f54d415c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:19.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:19.410+0000 7f54d2ffd640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f54d40cdcf0 0x7f54d406d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:19.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:19.410+0000 7f54d37fe640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f54d415cdf0 0x7f54d415fa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:38918/0 (socket says 172.21.15.1:38918) 2024-05-04T02:20:19.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:19.410+0000 7f54d37fe640 1 -- 172.21.15.1:0/3085386915 learned_addr learned my addr 172.21.15.1:0/3085386915 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-05-04T02:20:19.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:19.414+0000 7f54d27fc640 1 -- 172.21.15.1:0/3085386915 >> v2:172.21.15.1:3300/0 conn(0x7f54d40cdcf0 msgr2=0x7f54d406d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:19.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:19.414+0000 7f54d27fc640 1 --2- 172.21.15.1:0/3085386915 >> v2:172.21.15.1:3300/0 conn(0x7f54d40cdcf0 0x7f54d406d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:19.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:19.414+0000 7f54d27fc640 1 -- 172.21.15.1:0/3085386915 >> v1:172.21.15.1:6789/0 conn(0x7f54d415cdf0 legacy=0x7f54d415fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:19.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:19.414+0000 7f54d27fc640 1 -- 172.21.15.1:0/3085386915 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54d406d480 con 0x7f54d415c4a0 2024-05-04T02:20:19.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:19.417+0000 7f54d27fc640 1 --2- 172.21.15.1:0/3085386915 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f54d415c4a0 0x7f54d415c8b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f54d40cc610 tx=0x7f54c802a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2226fae0d1a60cb9 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:19.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:19.421+0000 7f54d1ffb640 1 -- 172.21.15.1:0/3085386915 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54c8037070 con 0x7f54d415c4a0 2024-05-04T02:20:19.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:19.421+0000 7f54d1ffb640 1 -- 172.21.15.1:0/3085386915 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54c8032440 con 0x7f54d415c4a0 2024-05-04T02:20:19.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:19.421+0000 7f54d1ffb640 1 -- 172.21.15.1:0/3085386915 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54c8032810 con 0x7f54d415c4a0 2024-05-04T02:20:19.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:19.422+0000 7f54d94f9640 1 -- 172.21.15.1:0/3085386915 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f54d415c4a0 msgr2=0x7f54d415c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:19.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:19.422+0000 7f54d94f9640 1 --2- 172.21.15.1:0/3085386915 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f54d415c4a0 0x7f54d415c8b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f54d40cc610 tx=0x7f54c802a230 comp rx=0 tx=0).stop 2024-05-04T02:20:19.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:19.422+0000 7f54d94f9640 1 -- 172.21.15.1:0/3085386915 shutdown_connections 2024-05-04T02:20:19.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:19.422+0000 7f54d94f9640 1 --2- 172.21.15.1:0/3085386915 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f54d415c4a0 0x7f54d415c8b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:19.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:19.422+0000 7f54d94f9640 1 --2- 172.21.15.1:0/3085386915 >> v2:172.21.15.1:3300/0 conn(0x7f54d40cdcf0 0x7f54d406d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:19.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:19.422+0000 7f54d94f9640 1 -- 172.21.15.1:0/3085386915 >> 172.21.15.1:0/3085386915 conn(0x7f54d40ce960 msgr2=0x7f54d408cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:19.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:19.422+0000 7f54d94f9640 1 -- 172.21.15.1:0/3085386915 shutdown_connections 2024-05-04T02:20:19.424 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:19.422+0000 7f54d94f9640 1 -- 172.21.15.1:0/3085386915 wait complete. 2024-05-04T02:20:19.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:19.424+0000 7f54d94f9640 1 Processor -- start 2024-05-04T02:20:19.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:19.424+0000 7f54d94f9640 1 -- start start 2024-05-04T02:20:19.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:19.425+0000 7f54d94f9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f54d40cdcf0 0x7f54d41f0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:19.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:19.425+0000 7f54d94f9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f54d415c4a0 0x7f54d40c5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:19.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:19.425+0000 7f54d94f9640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f54d415cdf0 0x7f54d40c90a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:19.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:19.425+0000 7f54d94f9640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f54d40b7790 con 0x7f54d40cdcf0 2024-05-04T02:20:19.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:19.425+0000 7f54d94f9640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f54d415d200 con 0x7f54d415c4a0 2024-05-04T02:20:19.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:19.425+0000 7f54d94f9640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f54d40cd7c0 con 0x7f54d415cdf0 2024-05-04T02:20:19.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:19.426+0000 7f54d2ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f54d40cdcf0 0x7f54d41f0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:19.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:19.426+0000 7f54d37fe640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f54d415cdf0 0x7f54d40c90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:19.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:19.426+0000 7f54d27fc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f54d415c4a0 0x7f54d40c5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:19.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:19.426+0000 7f54d2ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f54d40cdcf0 0x7f54d41f0c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46608/0 (socket says 172.21.15.1:46608) 2024-05-04T02:20:19.428 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:19.426+0000 7f54d2ffd640 1 -- 172.21.15.1:0/2013589613 learned_addr learned my addr 172.21.15.1:0/2013589613 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:19.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:19.430+0000 7f54d37fe640 1 -- 172.21.15.1:0/2013589613 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f54d415c4a0 msgr2=0x7f54d40c5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:19.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:19.430+0000 7f54d37fe640 1 --2- 172.21.15.1:0/2013589613 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f54d415c4a0 0x7f54d40c5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:19.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:19.430+0000 7f54d37fe640 1 -- 172.21.15.1:0/2013589613 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f54d40cdcf0 msgr2=0x7f54d41f0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:19.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:19.430+0000 7f54d37fe640 1 --2- 172.21.15.1:0/2013589613 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f54d40cdcf0 0x7f54d41f0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:19.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:19.430+0000 7f54d37fe640 1 -- 172.21.15.1:0/2013589613 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54d41f1170 con 0x7f54d415cdf0 2024-05-04T02:20:19.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:19.432+0000 7f54d37fe640 1 --2- 172.21.15.1:0/2013589613 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f54d415cdf0 0x7f54d40c90a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f54cc00caa0 tx=0x7f54cc00cf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:19.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:19.436+0000 7f54bb7fe640 1 -- 172.21.15.1:0/2013589613 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54cc017070 con 0x7f54d415cdf0 2024-05-04T02:20:19.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:19.436+0000 7f54bb7fe640 1 -- 172.21.15.1:0/2013589613 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54cc00aba0 con 0x7f54d415cdf0 2024-05-04T02:20:19.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:19.436+0000 7f54bb7fe640 1 -- 172.21.15.1:0/2013589613 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54cc012400 con 0x7f54d415cdf0 2024-05-04T02:20:19.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:19.436+0000 7f54d94f9640 1 -- 172.21.15.1:0/2013589613 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54d40ca270 con 0x7f54d415cdf0 2024-05-04T02:20:19.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:19.436+0000 7f54d94f9640 1 -- 172.21.15.1:0/2013589613 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f54d40ca830 con 0x7f54d415cdf0 2024-05-04T02:20:19.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:19.437+0000 7f54d94f9640 1 -- 172.21.15.1:0/2013589613 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54d4069c60 con 0x7f54d415cdf0 2024-05-04T02:20:19.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:19.459+0000 7f54bb7fe640 1 -- 172.21.15.1:0/2013589613 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f54cc01a070 con 0x7f54d415cdf0 2024-05-04T02:20:19.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:19.460+0000 7f54bb7fe640 1 --2- 172.21.15.1:0/2013589613 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f54c0076320 0x7f54c0078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:19.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:19.460+0000 7f54d2ffd640 1 --2- 172.21.15.1:0/2013589613 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f54c0076320 0x7f54c0078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:19.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:19.460+0000 7f54d2ffd640 1 --2- 172.21.15.1:0/2013589613 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f54c0076320 0x7f54c0078830 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f54c4009b60 tx=0x7f54c4009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:19.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:19.462+0000 7f54bb7fe640 1 -- 172.21.15.1:0/2013589613 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f54cc05cb20 con 0x7f54d415cdf0 2024-05-04T02:20:19.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:19.733+0000 7f54bb7fe640 1 -- 172.21.15.1:0/2013589613 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f54cc021020 con 0x7f54d415cdf0 2024-05-04T02:20:19.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:19.964+0000 7f54d94f9640 1 -- 172.21.15.1:0/2013589613 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f54d40c5530 con 0x7f54d415cdf0 2024-05-04T02:20:20.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.459+0000 7f54bb7fe640 1 -- 172.21.15.1:0/2013589613 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) ==== 122+0+0 (secure 0 0 0) 0x7f54cc060890 con 0x7f54d415cdf0 2024-05-04T02:20:20.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.461+0000 7f54d94f9640 1 -- 172.21.15.1:0/2013589613 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f54c0076320 msgr2=0x7f54c0078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:20.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.461+0000 7f54d94f9640 1 --2- 172.21.15.1:0/2013589613 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f54c0076320 0x7f54c0078830 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f54c4009b60 tx=0x7f54c4009190 comp rx=0 tx=0).stop 2024-05-04T02:20:20.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.461+0000 7f54d94f9640 1 -- 172.21.15.1:0/2013589613 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f54d415cdf0 msgr2=0x7f54d40c90a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:20.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.461+0000 7f54d94f9640 1 --2- 172.21.15.1:0/2013589613 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f54d415cdf0 0x7f54d40c90a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f54cc00caa0 tx=0x7f54cc00cf60 comp rx=0 tx=0).stop 2024-05-04T02:20:20.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.461+0000 7f54d94f9640 1 -- 172.21.15.1:0/2013589613 shutdown_connections 2024-05-04T02:20:20.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.461+0000 7f54d94f9640 1 --2- 172.21.15.1:0/2013589613 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f54c0076320 0x7f54c0078830 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:20.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.461+0000 7f54d94f9640 1 --2- 172.21.15.1:0/2013589613 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f54d415cdf0 0x7f54d40c90a0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:20.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.461+0000 7f54d94f9640 1 --2- 172.21.15.1:0/2013589613 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f54d415c4a0 0x7f54d40c5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:20.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.461+0000 7f54d94f9640 1 --2- 172.21.15.1:0/2013589613 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f54d40cdcf0 0x7f54d41f0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:20.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.461+0000 7f54d94f9640 1 -- 172.21.15.1:0/2013589613 >> 172.21.15.1:0/2013589613 conn(0x7f54d40ce960 msgr2=0x7f54d41e73a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:20.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.462+0000 7f54d94f9640 1 -- 172.21.15.1:0/2013589613 shutdown_connections 2024-05-04T02:20:20.465 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.462+0000 7f54d94f9640 1 -- 172.21.15.1:0/2013589613 wait complete. 2024-05-04T02:20:20.476 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-05-04T02:20:20.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.593+0000 7fd91db9d640 1 Processor -- start 2024-05-04T02:20:20.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.593+0000 7fd91db9d640 1 -- start start 2024-05-04T02:20:20.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.594+0000 7fd91db9d640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fd9180cb310 0x7fd91806d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:20.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.594+0000 7fd91db9d640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd91815a630 con 0x7fd918073f20 2024-05-04T02:20:20.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.594+0000 7fd91db9d640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd91815b170 con 0x7fd918150df0 2024-05-04T02:20:20.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.594+0000 7fd91db9d640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7fd91815a8d0 con 0x7fd9180cb310 2024-05-04T02:20:20.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.595+0000 7fd916ffd640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fd918150df0 0x7fd9180c6b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.1:47734/0 (socket says 172.21.15.1:47734) 2024-05-04T02:20:20.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.595+0000 7fd916ffd640 1 -- 172.21.15.1:0/1357831529 learned_addr learned my addr 172.21.15.1:0/1357831529 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-05-04T02:20:20.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.595+0000 7fd9177fe640 1 --2- 172.21.15.1:0/1357831529 >> v2:172.21.15.1:3300/0 conn(0x7fd9180cb310 0x7fd91806d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:20.599 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.597+0000 7fd9167fc640 1 -- 172.21.15.1:0/1357831529 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3099181066 0 0) 0x7fd91815b170 con 0x7fd918150df0 2024-05-04T02:20:20.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.597+0000 7fd9167fc640 1 -- 172.21.15.1:0/1357831529 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd900003520 con 0x7fd918150df0 2024-05-04T02:20:20.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.601+0000 7fd9167fc640 1 -- 172.21.15.1:0/1357831529 <== mon.1 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2661677210 0 0) 0x7fd900003520 con 0x7fd918150df0 2024-05-04T02:20:20.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.601+0000 7fd9167fc640 1 -- 172.21.15.1:0/1357831529 >> v2:172.21.15.1:3300/0 conn(0x7fd9180cb310 msgr2=0x7fd91806d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:20.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.601+0000 7fd9167fc640 1 --2- 172.21.15.1:0/1357831529 >> v2:172.21.15.1:3300/0 conn(0x7fd9180cb310 0x7fd91806d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:20.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.601+0000 7fd9167fc640 1 -- 172.21.15.1:0/1357831529 >> v1:172.21.15.1:6789/0 conn(0x7fd918073f20 legacy=0x7fd918074330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:20.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.601+0000 7fd9167fc640 1 -- 172.21.15.1:0/1357831529 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd91815abb0 con 0x7fd918150df0 2024-05-04T02:20:20.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.601+0000 7fd9167fc640 1 -- 172.21.15.1:0/1357831529 <== mon.1 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1418761865 0 0) 0x7fd90c0016f0 con 0x7fd918150df0 2024-05-04T02:20:20.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.601+0000 7fd9167fc640 1 -- 172.21.15.1:0/1357831529 >> v1:172.21.15.107:6789/0 conn(0x7fd918150df0 legacy=0x7fd9180c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:20.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.601+0000 7fd9167fc640 1 --2- 172.21.15.1:0/1357831529 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd900003aa0 0x7fd900003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:20.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.601+0000 7fd9167fc640 1 --2- 172.21.15.1:0/1357831529 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd900004800 0x7fd900004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:20.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.601+0000 7fd9167fc640 1 --2- 172.21.15.1:0/1357831529 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9000052a0 0x7fd90000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:20.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.601+0000 7fd9167fc640 1 -- 172.21.15.1:0/1357831529 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd91815a8d0 con 0x7fd900003aa0 2024-05-04T02:20:20.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.601+0000 7fd9167fc640 1 -- 172.21.15.1:0/1357831529 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd90000c230 con 0x7fd9000052a0 2024-05-04T02:20:20.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.601+0000 7fd9167fc640 1 -- 172.21.15.1:0/1357831529 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd90000c430 con 0x7fd900004800 2024-05-04T02:20:20.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.602+0000 7fd916ffd640 1 --2- 172.21.15.1:0/1357831529 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd900004800 0x7fd900004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:20.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.603+0000 7fd917fff640 1 --2- 172.21.15.1:0/1357831529 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9000052a0 0x7fd90000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:20.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.605+0000 7fd9177fe640 1 --2- 172.21.15.1:0/1357831529 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd900003aa0 0x7fd900003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:20.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.605+0000 7fd916ffd640 1 -- 172.21.15.1:0/1357831529 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9000052a0 msgr2=0x7fd90000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:20.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.605+0000 7fd916ffd640 1 --2- 172.21.15.1:0/1357831529 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9000052a0 0x7fd90000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:20.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.605+0000 7fd916ffd640 1 -- 172.21.15.1:0/1357831529 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd900003aa0 msgr2=0x7fd900003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:20.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.605+0000 7fd916ffd640 1 --2- 172.21.15.1:0/1357831529 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd900003aa0 0x7fd900003f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:20.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.605+0000 7fd917fff640 1 -- 172.21.15.1:0/1357831529 reap_dead start 2024-05-04T02:20:20.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.605+0000 7fd916ffd640 1 -- 172.21.15.1:0/1357831529 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd900003520 con 0x7fd900004800 2024-05-04T02:20:20.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.608+0000 7fd916ffd640 1 --2- 172.21.15.1:0/1357831529 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd900004800 0x7fd900004c10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd90c00c210 tx=0x7fd900005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=746100b9476ae1be server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:20.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.612+0000 7fd9167fc640 1 -- 172.21.15.1:0/1357831529 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd90c007ce0 con 0x7fd900004800 2024-05-04T02:20:20.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.612+0000 7fd9167fc640 1 -- 172.21.15.1:0/1357831529 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd90c005af0 con 0x7fd900004800 2024-05-04T02:20:20.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.612+0000 7fd9167fc640 1 -- 172.21.15.1:0/1357831529 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd90c007070 con 0x7fd900004800 2024-05-04T02:20:20.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.613+0000 7fd91db9d640 1 -- 172.21.15.1:0/1357831529 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd900004800 msgr2=0x7fd900004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:20.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.613+0000 7fd91db9d640 1 --2- 172.21.15.1:0/1357831529 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd900004800 0x7fd900004c10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd90c00c210 tx=0x7fd900005830 comp rx=0 tx=0).stop 2024-05-04T02:20:20.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.613+0000 7fd91db9d640 1 -- 172.21.15.1:0/1357831529 shutdown_connections 2024-05-04T02:20:20.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.613+0000 7fd91db9d640 1 --2- 172.21.15.1:0/1357831529 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd900004800 0x7fd900004c10 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:20.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.613+0000 7fd91db9d640 1 -- 172.21.15.1:0/1357831529 >> 172.21.15.1:0/1357831529 conn(0x7fd9180cd6a0 msgr2=0x7fd9180cdab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:20.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.614+0000 7fd91db9d640 1 -- 172.21.15.1:0/1357831529 shutdown_connections 2024-05-04T02:20:20.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.614+0000 7fd91db9d640 1 -- 172.21.15.1:0/1357831529 wait complete. 2024-05-04T02:20:20.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.615+0000 7fd91db9d640 1 Processor -- start 2024-05-04T02:20:20.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.616+0000 7fd91db9d640 1 -- start start 2024-05-04T02:20:20.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.617+0000 7fd91db9d640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd900004800 0x7fd918157630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:20.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.617+0000 7fd91db9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd918155780 0x7fd91814b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:20.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.617+0000 7fd91db9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd91814bd60 0x7fd9181eff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:20.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.617+0000 7fd91db9d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd91815a3d0 con 0x7fd918155780 2024-05-04T02:20:20.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.617+0000 7fd91db9d640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd91815a250 con 0x7fd91814bd60 2024-05-04T02:20:20.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.617+0000 7fd91db9d640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd9180cb310 con 0x7fd900004800 2024-05-04T02:20:20.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.617+0000 7fd916ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd918155780 0x7fd91814b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:20.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.617+0000 7fd917fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd91814bd60 0x7fd9181eff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:20.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.617+0000 7fd9177fe640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd900004800 0x7fd918157630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:20.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.618+0000 7fd916ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd918155780 0x7fd91814b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46624/0 (socket says 172.21.15.1:46624) 2024-05-04T02:20:20.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.618+0000 7fd916ffd640 1 -- 172.21.15.1:0/3007693412 learned_addr learned my addr 172.21.15.1:0/3007693412 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:20.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.622+0000 7fd9177fe640 1 -- 172.21.15.1:0/3007693412 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd91814bd60 msgr2=0x7fd9181eff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:20.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.622+0000 7fd9177fe640 1 --2- 172.21.15.1:0/3007693412 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd91814bd60 0x7fd9181eff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:20.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.622+0000 7fd9177fe640 1 -- 172.21.15.1:0/3007693412 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd918155780 msgr2=0x7fd91814b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:20.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.622+0000 7fd9177fe640 1 --2- 172.21.15.1:0/3007693412 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd918155780 0x7fd91814b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:20.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.622+0000 7fd9177fe640 1 -- 172.21.15.1:0/3007693412 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd918157b70 con 0x7fd900004800 2024-05-04T02:20:20.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.622+0000 7fd916ffd640 1 --2- 172.21.15.1:0/3007693412 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd918155780 0x7fd91814b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-04T02:20:20.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.625+0000 7fd9177fe640 1 --2- 172.21.15.1:0/3007693412 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd900004800 0x7fd918157630 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd9080106e0 tx=0x7fd908010ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:20.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.629+0000 7fd8fffff640 1 -- 172.21.15.1:0/3007693412 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd90800f040 con 0x7fd900004800 2024-05-04T02:20:20.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.629+0000 7fd8fffff640 1 -- 172.21.15.1:0/3007693412 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd90800e950 con 0x7fd900004800 2024-05-04T02:20:20.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.629+0000 7fd8fffff640 1 -- 172.21.15.1:0/3007693412 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd90800ed40 con 0x7fd900004800 2024-05-04T02:20:20.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.629+0000 7fd91db9d640 1 -- 172.21.15.1:0/3007693412 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd918156590 con 0x7fd900004800 2024-05-04T02:20:20.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.629+0000 7fd91db9d640 1 -- 172.21.15.1:0/3007693412 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd918156b50 con 0x7fd900004800 2024-05-04T02:20:20.632 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.630+0000 7fd91db9d640 1 -- 172.21.15.1:0/3007693412 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd918069c60 con 0x7fd900004800 2024-05-04T02:20:20.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.657+0000 7fd8fffff640 1 -- 172.21.15.1:0/3007693412 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd90801c400 con 0x7fd900004800 2024-05-04T02:20:20.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.657+0000 7fd8fffff640 1 --2- 172.21.15.1:0/3007693412 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fd904076320 0x7fd904078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:20.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.657+0000 7fd916ffd640 1 --2- 172.21.15.1:0/3007693412 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fd904076320 0x7fd904078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:20.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.658+0000 7fd916ffd640 1 --2- 172.21.15.1:0/3007693412 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fd904076320 0x7fd904078830 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd9180cdee0 tx=0x7fd90c009030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:20.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.913+0000 7fd8fffff640 1 -- 172.21.15.1:0/3007693412 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fd90801cd80 con 0x7fd900004800 2024-05-04T02:20:20.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:20.929+0000 7fd8fffff640 1 -- 172.21.15.1:0/3007693412 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd908018030 con 0x7fd900004800 2024-05-04T02:20:21.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:21.167+0000 7fd91db9d640 1 -- 172.21.15.1:0/3007693412 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7fd918074640 con 0x7fd900004800 2024-05-04T02:20:21.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:21.737+0000 7fd8fffff640 1 -- 172.21.15.1:0/3007693412 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v7) ==== 115+0+0 (secure 0 0 0) 0x7fd908061000 con 0x7fd900004800 2024-05-04T02:20:21.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:21.739+0000 7fd91db9d640 1 -- 172.21.15.1:0/3007693412 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fd904076320 msgr2=0x7fd904078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:21.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:21.739+0000 7fd91db9d640 1 --2- 172.21.15.1:0/3007693412 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fd904076320 0x7fd904078830 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd9180cdee0 tx=0x7fd90c009030 comp rx=0 tx=0).stop 2024-05-04T02:20:21.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:21.739+0000 7fd91db9d640 1 -- 172.21.15.1:0/3007693412 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd900004800 msgr2=0x7fd918157630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:21.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:21.739+0000 7fd91db9d640 1 --2- 172.21.15.1:0/3007693412 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd900004800 0x7fd918157630 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd9080106e0 tx=0x7fd908010ba0 comp rx=0 tx=0).stop 2024-05-04T02:20:21.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:21.739+0000 7fd91db9d640 1 -- 172.21.15.1:0/3007693412 shutdown_connections 2024-05-04T02:20:21.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:21.739+0000 7fd91db9d640 1 --2- 172.21.15.1:0/3007693412 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fd904076320 0x7fd904078830 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:21.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:21.739+0000 7fd91db9d640 1 --2- 172.21.15.1:0/3007693412 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd91814bd60 0x7fd9181eff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:21.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:21.739+0000 7fd91db9d640 1 --2- 172.21.15.1:0/3007693412 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd918155780 0x7fd91814b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:21.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:21.739+0000 7fd91db9d640 1 --2- 172.21.15.1:0/3007693412 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd900004800 0x7fd918157630 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:21.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:21.739+0000 7fd91db9d640 1 -- 172.21.15.1:0/3007693412 >> 172.21.15.1:0/3007693412 conn(0x7fd9180cd6a0 msgr2=0x7fd9180c6b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:21.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:21.740+0000 7fd91db9d640 1 -- 172.21.15.1:0/3007693412 shutdown_connections 2024-05-04T02:20:21.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:21.740+0000 7fd91db9d640 1 -- 172.21.15.1:0/3007693412 wait complete. 2024-05-04T02:20:21.753 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-04T02:20:21.753 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-04T02:20:21.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:21.863+0000 7f9c15a96640 1 Processor -- start 2024-05-04T02:20:21.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:21.863+0000 7f9c15a96640 1 -- start start 2024-05-04T02:20:21.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:21.864+0000 7f9c15a96640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f9c100caa30 0x7f9c101532d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:21.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:21.864+0000 7f9c15a96640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f9c100c3f10 0x7f9c100c4320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:21.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:21.864+0000 7f9c15a96640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c100cae40 con 0x7f9c100ce590 2024-05-04T02:20:21.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:21.864+0000 7f9c15a96640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f9c100c90a0 con 0x7f9c100c3f10 2024-05-04T02:20:21.866 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:21.864+0000 7f9c15a96640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f9c100c9380 con 0x7f9c100caa30 2024-05-04T02:20:21.867 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:21.865+0000 7f9c0f7fe640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f9c100caa30 0x7f9c101532d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:21.867 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:21.865+0000 7f9c0effd640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f9c100c3f10 0x7f9c100c4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:21.867 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:21.865+0000 7f9c0ffff640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f9c100ce590 0x7f9c10159560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:38932/0 (socket says 172.21.15.1:38932) 2024-05-04T02:20:21.867 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:21.865+0000 7f9c0ffff640 1 -- 172.21.15.1:0/1714862936 learned_addr learned my addr 172.21.15.1:0/1714862936 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-05-04T02:20:21.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:21.868+0000 7f9c0f7fe640 1 -- 172.21.15.1:0/1714862936 >> v2:172.21.15.1:3300/0 conn(0x7f9c100c3f10 msgr2=0x7f9c100c4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:21.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:21.868+0000 7f9c0f7fe640 1 --2- 172.21.15.1:0/1714862936 >> v2:172.21.15.1:3300/0 conn(0x7f9c100c3f10 0x7f9c100c4320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:21.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:21.868+0000 7f9c0f7fe640 1 -- 172.21.15.1:0/1714862936 >> v1:172.21.15.1:6789/0 conn(0x7f9c100ce590 legacy=0x7f9c10159560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:21.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:21.868+0000 7f9c0f7fe640 1 -- 172.21.15.1:0/1714862936 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c100c9660 con 0x7f9c100caa30 2024-05-04T02:20:21.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:21.870+0000 7f9c0f7fe640 1 --2- 172.21.15.1:0/1714862936 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c100caa30 0x7f9c101532d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9c100c5460 tx=0x7f9c0002c440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=806fcd64566dda31 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:21.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:21.874+0000 7f9c0e7fc640 1 -- 172.21.15.1:0/1714862936 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c00038070 con 0x7f9c100caa30 2024-05-04T02:20:21.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:21.874+0000 7f9c0e7fc640 1 -- 172.21.15.1:0/1714862936 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c00031710 con 0x7f9c100caa30 2024-05-04T02:20:21.876 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:21.874+0000 7f9c0e7fc640 1 -- 172.21.15.1:0/1714862936 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c00031ae0 con 0x7f9c100caa30 2024-05-04T02:20:21.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:21.875+0000 7f9c15a96640 1 -- 172.21.15.1:0/1714862936 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c100caa30 msgr2=0x7f9c101532d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:21.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:21.875+0000 7f9c15a96640 1 --2- 172.21.15.1:0/1714862936 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c100caa30 0x7f9c101532d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9c100c5460 tx=0x7f9c0002c440 comp rx=0 tx=0).stop 2024-05-04T02:20:21.877 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:21.875+0000 7f9c15a96640 1 -- 172.21.15.1:0/1714862936 shutdown_connections 2024-05-04T02:20:21.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:21.875+0000 7f9c15a96640 1 --2- 172.21.15.1:0/1714862936 >> v2:172.21.15.1:3300/0 conn(0x7f9c100c3f10 0x7f9c100c4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:21.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:21.875+0000 7f9c15a96640 1 --2- 172.21.15.1:0/1714862936 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c100caa30 0x7f9c101532d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:21.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:21.875+0000 7f9c15a96640 1 -- 172.21.15.1:0/1714862936 >> 172.21.15.1:0/1714862936 conn(0x7f9c100725c0 msgr2=0x7f9c100729d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:21.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:21.875+0000 7f9c15a96640 1 -- 172.21.15.1:0/1714862936 shutdown_connections 2024-05-04T02:20:21.878 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:21.875+0000 7f9c15a96640 1 -- 172.21.15.1:0/1714862936 wait complete. 2024-05-04T02:20:21.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:21.877+0000 7f9c15a96640 1 Processor -- start 2024-05-04T02:20:21.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:21.877+0000 7f9c15a96640 1 -- start start 2024-05-04T02:20:21.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:21.878+0000 7f9c15a96640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c100c3f10 0x7f9c1014fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:21.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:21.878+0000 7f9c15a96640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9c100caa30 0x7f9c1006e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:21.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:21.878+0000 7f9c15a96640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c100ce590 0x7f9c101e4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:21.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:21.878+0000 7f9c15a96640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9c10153810 con 0x7f9c100caa30 2024-05-04T02:20:21.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:21.878+0000 7f9c15a96640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f9c100c9c20 con 0x7f9c100ce590 2024-05-04T02:20:21.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:21.878+0000 7f9c15a96640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f9c10159c70 con 0x7f9c100c3f10 2024-05-04T02:20:21.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:21.879+0000 7f9c0effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9c100caa30 0x7f9c1006e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:21.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:21.879+0000 7f9c0ffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c100ce590 0x7f9c101e4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:21.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:21.879+0000 7f9c0f7fe640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c100c3f10 0x7f9c1014fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:21.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:21.879+0000 7f9c0effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9c100caa30 0x7f9c1006e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:46634/0 (socket says 172.21.15.1:46634) 2024-05-04T02:20:21.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:21.879+0000 7f9c0effd640 1 -- 172.21.15.1:0/3694847462 learned_addr learned my addr 172.21.15.1:0/3694847462 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:21.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:21.883+0000 7f9c0effd640 1 -- 172.21.15.1:0/3694847462 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c100c3f10 msgr2=0x7f9c1014fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:21.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:21.883+0000 7f9c0effd640 1 --2- 172.21.15.1:0/3694847462 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c100c3f10 0x7f9c1014fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:21.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:21.883+0000 7f9c0effd640 1 -- 172.21.15.1:0/3694847462 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c100ce590 msgr2=0x7f9c101e4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:21.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:21.883+0000 7f9c0effd640 1 --2- 172.21.15.1:0/3694847462 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c100ce590 0x7f9c101e4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:21.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:21.883+0000 7f9c0effd640 1 -- 172.21.15.1:0/3694847462 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c1006ea50 con 0x7f9c100caa30 2024-05-04T02:20:21.887 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:21.886+0000 7f9c0effd640 1 --2- 172.21.15.1:0/3694847462 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9c100caa30 0x7f9c1006e510 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9c0400e8a0 tx=0x7f9c0400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:21.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:21.890+0000 7f9bf7fff640 1 -- 172.21.15.1:0/3694847462 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c04017070 con 0x7f9c100caa30 2024-05-04T02:20:21.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:21.890+0000 7f9bf7fff640 1 -- 172.21.15.1:0/3694847462 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c0400c8e0 con 0x7f9c100caa30 2024-05-04T02:20:21.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:21.890+0000 7f9c15a96640 1 -- 172.21.15.1:0/3694847462 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c101e38c0 con 0x7f9c100caa30 2024-05-04T02:20:21.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:21.890+0000 7f9bf7fff640 1 -- 172.21.15.1:0/3694847462 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c0400ccd0 con 0x7f9c100caa30 2024-05-04T02:20:21.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:21.890+0000 7f9c15a96640 1 -- 172.21.15.1:0/3694847462 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c100b38d0 con 0x7f9c100caa30 2024-05-04T02:20:21.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:21.891+0000 7f9c15a96640 1 -- 172.21.15.1:0/3694847462 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c10076740 con 0x7f9c100caa30 2024-05-04T02:20:21.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:21.914+0000 7f9bf7fff640 1 -- 172.21.15.1:0/3694847462 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9c0401a070 con 0x7f9c100caa30 2024-05-04T02:20:21.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:21.915+0000 7f9bf7fff640 1 --2- 172.21.15.1:0/3694847462 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f9bfc0762d0 0x7f9bfc0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:21.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:21.915+0000 7f9c0f7fe640 1 --2- 172.21.15.1:0/3694847462 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f9bfc0762d0 0x7f9bfc0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:21.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:21.916+0000 7f9c0f7fe640 1 --2- 172.21.15.1:0/3694847462 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f9bfc0762d0 0x7f9bfc0787e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9c00035000 tx=0x7f9c00008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:22.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:22.205+0000 7f9bf7fff640 1 -- 172.21.15.1:0/3694847462 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f9c0405d180 con 0x7f9c100caa30 2024-05-04T02:20:22.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:22.205+0000 7f9bf7fff640 1 -- 172.21.15.1:0/3694847462 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9c04060ef0 con 0x7f9c100caa30 2024-05-04T02:20:22.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:22.435+0000 7f9c15a96640 1 -- 172.21.15.1:0/3694847462 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9c1006e0c0 con 0x7f9c100caa30 2024-05-04T02:20:22.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:22.458+0000 7f9bf7fff640 1 -- 172.21.15.1:0/3694847462 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+6818 (secure 0 0 0) 0x7f9c040651f0 con 0x7f9c100caa30 2024-05-04T02:20:22.460 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:20:22.460 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4214,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/2012070226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":2012070226},{"type":"v1","addr":"172.21.15.107:6837","nonce":2012070226}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4217,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/779417024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":779417024},{"type":"v1","addr":"172.21.15.107:6836","nonce":779417024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4223,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/4178520860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":4178520860},{"type":"v1","addr":"172.21.15.1:6837","nonce":4178520860}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4273,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6833/410847489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":410847489},{"type":"v1","addr":"172.21.15.1:6833","nonce":410847489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/1145100080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":1145100080},{"type":"v1","addr":"172.21.15.1:6835","nonce":1145100080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-04T02:20:15.309997+0000","modified":"2024-05-04T02:20:21.184612+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.107:6839/1807033208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":1807033208},{"type":"v1","addr":"172.21.15.107:6839","nonce":1807033208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4285,"qdb_cluster":[4285]},"id":1}]} 2024-05-04T02:20:22.460 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 7 2024-05-04T02:20:22.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:22.460+0000 7f9c15a96640 1 -- 172.21.15.1:0/3694847462 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f9bfc0762d0 msgr2=0x7f9bfc0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:22.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:22.460+0000 7f9c15a96640 1 --2- 172.21.15.1:0/3694847462 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f9bfc0762d0 0x7f9bfc0787e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9c00035000 tx=0x7f9c00008030 comp rx=0 tx=0).stop 2024-05-04T02:20:22.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:22.460+0000 7f9c15a96640 1 -- 172.21.15.1:0/3694847462 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9c100caa30 msgr2=0x7f9c1006e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:22.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:22.460+0000 7f9c15a96640 1 --2- 172.21.15.1:0/3694847462 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9c100caa30 0x7f9c1006e510 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9c0400e8a0 tx=0x7f9c0400ed60 comp rx=0 tx=0).stop 2024-05-04T02:20:22.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:22.460+0000 7f9c15a96640 1 -- 172.21.15.1:0/3694847462 shutdown_connections 2024-05-04T02:20:22.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:22.460+0000 7f9c15a96640 1 --2- 172.21.15.1:0/3694847462 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f9bfc0762d0 0x7f9bfc0787e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:22.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:22.460+0000 7f9c15a96640 1 --2- 172.21.15.1:0/3694847462 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9c100ce590 0x7f9c101e4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:22.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:22.460+0000 7f9c15a96640 1 --2- 172.21.15.1:0/3694847462 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9c100caa30 0x7f9c1006e510 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:22.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:22.460+0000 7f9c15a96640 1 --2- 172.21.15.1:0/3694847462 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f9c100c3f10 0x7f9c1014fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:22.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:22.460+0000 7f9c15a96640 1 -- 172.21.15.1:0/3694847462 >> 172.21.15.1:0/3694847462 conn(0x7f9c100725c0 msgr2=0x7f9c100cdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:22.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:22.460+0000 7f9c15a96640 1 -- 172.21.15.1:0/3694847462 shutdown_connections 2024-05-04T02:20:22.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:22.460+0000 7f9c15a96640 1 -- 172.21.15.1:0/3694847462 wait complete. 2024-05-04T02:20:22.473 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-04T02:20:22.526 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:20:22.528 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:20:22.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:22.583+0000 7fdf02314640 1 Processor -- start 2024-05-04T02:20:22.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:22.583+0000 7fdf02314640 1 -- start start 2024-05-04T02:20:22.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:22.584+0000 7fdf02314640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fdefc0c7da0 0x7fdefc15cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:22.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:22.584+0000 7fdf02314640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdefc0cc590 0x7fdefc0cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:22.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:22.584+0000 7fdf02314640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdefc0cd6c0 con 0x7fdefc0cde50 2024-05-04T02:20:22.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:22.584+0000 7fdf02314640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7fdefc0c7070 con 0x7fdefc0c7da0 2024-05-04T02:20:22.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:22.584+0000 7fdf02314640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fdefc0cd980 con 0x7fdefc0cc590 2024-05-04T02:20:22.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:22.585+0000 7fdf008b1640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdefc0cc590 0x7fdefc0cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:22.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:22.585+0000 7fdefb7fe640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fdefc0c7da0 0x7fdefc15cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:22.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:22.585+0000 7fdefbfff640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fdefc0cde50 0x7fdefc06c6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:38940/0 (socket says 172.21.15.1:38940) 2024-05-04T02:20:22.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:22.585+0000 7fdefbfff640 1 -- 172.21.15.1:0/1096520842 learned_addr learned my addr 172.21.15.1:0/1096520842 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-05-04T02:20:22.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:22.588+0000 7fdf008b1640 1 -- 172.21.15.1:0/1096520842 >> v2:172.21.15.1:3300/0 conn(0x7fdefc0c7da0 msgr2=0x7fdefc15cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:22.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:22.588+0000 7fdf008b1640 1 --2- 172.21.15.1:0/1096520842 >> v2:172.21.15.1:3300/0 conn(0x7fdefc0c7da0 0x7fdefc15cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:22.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:22.588+0000 7fdf008b1640 1 -- 172.21.15.1:0/1096520842 >> v1:172.21.15.1:6789/0 conn(0x7fdefc0cde50 legacy=0x7fdefc06c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:22.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:22.588+0000 7fdf008b1640 1 -- 172.21.15.1:0/1096520842 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdefc0c72c0 con 0x7fdefc0cc590 2024-05-04T02:20:22.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:22.590+0000 7fdf008b1640 1 --2- 172.21.15.1:0/1096520842 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdefc0cc590 0x7fdefc0cc9a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fdefc0c71f0 tx=0x7fdef402a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1cd7e74951c3d6fc server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:22.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:22.594+0000 7fdefaffd640 1 -- 172.21.15.1:0/1096520842 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef4007740 con 0x7fdefc0cc590 2024-05-04T02:20:22.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:22.595+0000 7fdefaffd640 1 -- 172.21.15.1:0/1096520842 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdef40078e0 con 0x7fdefc0cc590 2024-05-04T02:20:22.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:22.595+0000 7fdefaffd640 1 -- 172.21.15.1:0/1096520842 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef4007cb0 con 0x7fdefc0cc590 2024-05-04T02:20:22.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:22.595+0000 7fdf02314640 1 -- 172.21.15.1:0/1096520842 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdefc0cc590 msgr2=0x7fdefc0cc9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:22.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:22.595+0000 7fdf02314640 1 --2- 172.21.15.1:0/1096520842 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdefc0cc590 0x7fdefc0cc9a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fdefc0c71f0 tx=0x7fdef402a6d0 comp rx=0 tx=0).stop 2024-05-04T02:20:22.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:22.595+0000 7fdf02314640 1 -- 172.21.15.1:0/1096520842 shutdown_connections 2024-05-04T02:20:22.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:22.595+0000 7fdf02314640 1 --2- 172.21.15.1:0/1096520842 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdefc0cc590 0x7fdefc0cc9a0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:22.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:22.595+0000 7fdf02314640 1 --2- 172.21.15.1:0/1096520842 >> v2:172.21.15.1:3300/0 conn(0x7fdefc0c7da0 0x7fdefc15cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:22.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:22.595+0000 7fdf02314640 1 -- 172.21.15.1:0/1096520842 >> 172.21.15.1:0/1096520842 conn(0x7fdefc0d2590 msgr2=0x7fdefc0ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:22.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:22.595+0000 7fdf02314640 1 -- 172.21.15.1:0/1096520842 shutdown_connections 2024-05-04T02:20:22.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:22.595+0000 7fdf02314640 1 -- 172.21.15.1:0/1096520842 wait complete. 2024-05-04T02:20:22.599 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:22.597+0000 7fdf02314640 1 Processor -- start 2024-05-04T02:20:22.599 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:22.597+0000 7fdf02314640 1 -- start start 2024-05-04T02:20:22.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:22.599+0000 7fdf02314640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdefc0c7da0 0x7fdefc1574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:22.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:22.599+0000 7fdf02314640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdefc0cc590 0x7fdefc160040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:22.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:22.599+0000 7fdf02314640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdefc158870 0x7fdefc14e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:22.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:22.599+0000 7fdf02314640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fdefc156b40 con 0x7fdefc158870 2024-05-04T02:20:22.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:22.599+0000 7fdf02314640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fdefc0c7880 con 0x7fdefc0c7da0 2024-05-04T02:20:22.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:22.599+0000 7fdf02314640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fdefc0cd310 con 0x7fdefc0cc590 2024-05-04T02:20:22.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:22.599+0000 7fdf008b1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdefc158870 0x7fdefc14e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:22.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:22.599+0000 7fdefb7fe640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdefc0cc590 0x7fdefc160040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:22.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:22.599+0000 7fdefbfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdefc0c7da0 0x7fdefc1574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:22.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:22.599+0000 7fdf008b1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdefc158870 0x7fdefc14e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41332/0 (socket says 172.21.15.1:41332) 2024-05-04T02:20:22.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:22.599+0000 7fdf008b1640 1 -- 172.21.15.1:0/3295323575 learned_addr learned my addr 172.21.15.1:0/3295323575 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:22.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:22.603+0000 7fdefb7fe640 1 -- 172.21.15.1:0/3295323575 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdefc0c7da0 msgr2=0x7fdefc1574e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:22.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:22.603+0000 7fdefb7fe640 1 --2- 172.21.15.1:0/3295323575 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdefc0c7da0 0x7fdefc1574e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:22.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:22.603+0000 7fdefb7fe640 1 -- 172.21.15.1:0/3295323575 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdefc158870 msgr2=0x7fdefc14e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:22.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:22.603+0000 7fdefb7fe640 1 --2- 172.21.15.1:0/3295323575 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdefc158870 0x7fdefc14e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:22.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:22.603+0000 7fdefb7fe640 1 -- 172.21.15.1:0/3295323575 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdefc157a20 con 0x7fdefc0cc590 2024-05-04T02:20:22.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:22.606+0000 7fdefb7fe640 1 --2- 172.21.15.1:0/3295323575 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdefc0cc590 0x7fdefc160040 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fdeec00e870 tx=0x7fdeec00ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:22.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:22.609+0000 7fdef8ff9640 1 -- 172.21.15.1:0/3295323575 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeec017070 con 0x7fdefc0cc590 2024-05-04T02:20:22.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:22.609+0000 7fdef8ff9640 1 -- 172.21.15.1:0/3295323575 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdeec00ee60 con 0x7fdefc0cc590 2024-05-04T02:20:22.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:22.609+0000 7fdef8ff9640 1 -- 172.21.15.1:0/3295323575 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeec00cb60 con 0x7fdefc0cc590 2024-05-04T02:20:22.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:22.609+0000 7fdf02314640 1 -- 172.21.15.1:0/3295323575 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdefc15fc10 con 0x7fdefc0cc590 2024-05-04T02:20:22.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:22.610+0000 7fdf02314640 1 -- 172.21.15.1:0/3295323575 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdefc1f2e60 con 0x7fdefc0cc590 2024-05-04T02:20:22.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:22.610+0000 7fdf02314640 1 -- 172.21.15.1:0/3295323575 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdefc069bc0 con 0x7fdefc0cc590 2024-05-04T02:20:22.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:22.895+0000 7fdef8ff9640 1 -- 172.21.15.1:0/3295323575 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fdeec01a070 con 0x7fdefc0cc590 2024-05-04T02:20:22.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:22.895+0000 7fdef8ff9640 1 --2- 172.21.15.1:0/3295323575 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fdee8076320 0x7fdee8078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:22.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:22.896+0000 7fdefbfff640 1 --2- 172.21.15.1:0/3295323575 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fdee8076320 0x7fdee8078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:22.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:22.896+0000 7fdef8ff9640 1 -- 172.21.15.1:0/3295323575 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fdeec00cd00 con 0x7fdefc0cc590 2024-05-04T02:20:22.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:22.896+0000 7fdefbfff640 1 --2- 172.21.15.1:0/3295323575 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fdee8076320 0x7fdee8078830 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdef0000f60 tx=0x7fdef0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:22.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:22.907+0000 7fdef8ff9640 1 -- 172.21.15.1:0/3295323575 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fdeec0c5990 con 0x7fdefc0cc590 2024-05-04T02:20:23.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.123+0000 7fdf02314640 1 -- 172.21.15.1:0/3295323575 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdefc156e20 con 0x7fdefc0cc590 2024-05-04T02:20:23.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.163+0000 7fdef8ff9640 1 -- 172.21.15.1:0/3295323575 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16545 (secure 0 0 0) 0x7fdeec060e80 con 0x7fdefc0cc590 2024-05-04T02:20:23.165 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:20:23.166 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":23,"fsid":"b45b4a9a-b84c-4a66-907b-43f0ca45e7c0","created":"2024-05-04T02:19:44.555410+0000","modified":"2024-05-04T02:20:17.793991+0000","last_up_change":"2024-05-04T02:20:00.162760+0000","last_in_change":"2024-05-04T02:19:50.811018+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-04T02:19:59.664283+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-04T02:20:12.783217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-04T02:20:13.872502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d8ad7964-7bd6-4ba9-ae4f-b55d7566b18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":2338132980},{"type":"v1","addr":"172.21.15.1:6801","nonce":2338132980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":2338132980},{"type":"v1","addr":"172.21.15.1:6803","nonce":2338132980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":2338132980},{"type":"v1","addr":"172.21.15.1:6807","nonce":2338132980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":2338132980},{"type":"v1","addr":"172.21.15.1:6805","nonce":2338132980}]},"public_addr":"172.21.15.1:6801/2338132980","cluster_addr":"172.21.15.1:6803/2338132980","heartbeat_back_addr":"172.21.15.1:6807/2338132980","heartbeat_front_addr":"172.21.15.1:6805/2338132980","state":["exists","up"]},{"osd":1,"uuid":"ce155f6d-7e0c-47c8-a0e0-fb53ff0c7726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":459131368},{"type":"v1","addr":"172.21.15.1:6817","nonce":459131368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":459131368},{"type":"v1","addr":"172.21.15.1:6819","nonce":459131368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":459131368},{"type":"v1","addr":"172.21.15.1:6823","nonce":459131368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":459131368},{"type":"v1","addr":"172.21.15.1:6821","nonce":459131368}]},"public_addr":"172.21.15.1:6817/459131368","cluster_addr":"172.21.15.1:6819/459131368","heartbeat_back_addr":"172.21.15.1:6823/459131368","heartbeat_front_addr":"172.21.15.1:6821/459131368","state":["exists","up"]},{"osd":2,"uuid":"7847c281-5da0-4d7d-b888-7f49d99a50b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":3463851105},{"type":"v1","addr":"172.21.15.1:6809","nonce":3463851105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":3463851105},{"type":"v1","addr":"172.21.15.1:6811","nonce":3463851105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":3463851105},{"type":"v1","addr":"172.21.15.1:6815","nonce":3463851105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":3463851105},{"type":"v1","addr":"172.21.15.1:6813","nonce":3463851105}]},"public_addr":"172.21.15.1:6809/3463851105","cluster_addr":"172.21.15.1:6811/3463851105","heartbeat_back_addr":"172.21.15.1:6815/3463851105","heartbeat_front_addr":"172.21.15.1:6813/3463851105","state":["exists","up"]},{"osd":3,"uuid":"26386eba-d106-4abe-8d6b-7dccdd106cb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":3859721636},{"type":"v1","addr":"172.21.15.1:6825","nonce":3859721636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":3859721636},{"type":"v1","addr":"172.21.15.1:6827","nonce":3859721636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":3859721636},{"type":"v1","addr":"172.21.15.1:6831","nonce":3859721636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":3859721636},{"type":"v1","addr":"172.21.15.1:6829","nonce":3859721636}]},"public_addr":"172.21.15.1:6825/3859721636","cluster_addr":"172.21.15.1:6827/3859721636","heartbeat_back_addr":"172.21.15.1:6831/3859721636","heartbeat_front_addr":"172.21.15.1:6829/3859721636","state":["exists","up"]},{"osd":4,"uuid":"2ba3d1b3-c5fa-4ff4-bf5d-772e77d79c59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":2335597098},{"type":"v1","addr":"172.21.15.107:6803","nonce":2335597098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":2335597098},{"type":"v1","addr":"172.21.15.107:6805","nonce":2335597098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2335597098},{"type":"v1","addr":"172.21.15.107:6810","nonce":2335597098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":2335597098},{"type":"v1","addr":"172.21.15.107:6807","nonce":2335597098}]},"public_addr":"172.21.15.107:6803/2335597098","cluster_addr":"172.21.15.107:6805/2335597098","heartbeat_back_addr":"172.21.15.107:6810/2335597098","heartbeat_front_addr":"172.21.15.107:6807/2335597098","state":["exists","up"]},{"osd":5,"uuid":"c42646eb-6e14-4b42-a7a3-54f99f1662bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":1274544305},{"type":"v1","addr":"172.21.15.107:6819","nonce":1274544305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":1274544305},{"type":"v1","addr":"172.21.15.107:6821","nonce":1274544305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":1274544305},{"type":"v1","addr":"172.21.15.107:6825","nonce":1274544305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":1274544305},{"type":"v1","addr":"172.21.15.107:6823","nonce":1274544305}]},"public_addr":"172.21.15.107:6819/1274544305","cluster_addr":"172.21.15.107:6821/1274544305","heartbeat_back_addr":"172.21.15.107:6825/1274544305","heartbeat_front_addr":"172.21.15.107:6823/1274544305","state":["exists","up"]},{"osd":6,"uuid":"a8a2dbb8-0107-4b8e-93c3-5fa7e6af15a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6809","nonce":941385299},{"type":"v1","addr":"172.21.15.107:6811","nonce":941385299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":941385299},{"type":"v1","addr":"172.21.15.107:6813","nonce":941385299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":941385299},{"type":"v1","addr":"172.21.15.107:6817","nonce":941385299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":941385299},{"type":"v1","addr":"172.21.15.107:6815","nonce":941385299}]},"public_addr":"172.21.15.107:6811/941385299","cluster_addr":"172.21.15.107:6813/941385299","heartbeat_back_addr":"172.21.15.107:6817/941385299","heartbeat_front_addr":"172.21.15.107:6815/941385299","state":["exists","up"]},{"osd":7,"uuid":"3b9bdc70-8831-4df9-8d50-362aa0f02aed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":1723298539},{"type":"v1","addr":"172.21.15.107:6827","nonce":1723298539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":1723298539},{"type":"v1","addr":"172.21.15.107:6829","nonce":1723298539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":1723298539},{"type":"v1","addr":"172.21.15.107:6833","nonce":1723298539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":1723298539},{"type":"v1","addr":"172.21.15.107:6831","nonce":1723298539}]},"public_addr":"172.21.15.107:6827/1723298539","cluster_addr":"172.21.15.107:6829/1723298539","heartbeat_back_addr":"172.21.15.107:6833/1723298539","heartbeat_front_addr":"172.21.15.107:6831/1723298539","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T02:19:56.277538+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T02:19:56.402984+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T02:19:56.374787+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T02:19:56.461914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T02:19:56.384856+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T02:19:56.469958+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T02:19:56.489376+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T02:19:56.393205+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-04T02:20:23.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.165+0000 7fdf02314640 1 -- 172.21.15.1:0/3295323575 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fdee8076320 msgr2=0x7fdee8078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:23.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.165+0000 7fdf02314640 1 --2- 172.21.15.1:0/3295323575 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fdee8076320 0x7fdee8078830 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdef0000f60 tx=0x7fdef0009040 comp rx=0 tx=0).stop 2024-05-04T02:20:23.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.165+0000 7fdf02314640 1 -- 172.21.15.1:0/3295323575 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdefc0cc590 msgr2=0x7fdefc160040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:23.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.165+0000 7fdf02314640 1 --2- 172.21.15.1:0/3295323575 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdefc0cc590 0x7fdefc160040 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fdeec00e870 tx=0x7fdeec00ed30 comp rx=0 tx=0).stop 2024-05-04T02:20:23.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.165+0000 7fdf02314640 1 -- 172.21.15.1:0/3295323575 shutdown_connections 2024-05-04T02:20:23.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.165+0000 7fdf02314640 1 --2- 172.21.15.1:0/3295323575 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fdee8076320 0x7fdee8078830 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:23.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.165+0000 7fdf02314640 1 --2- 172.21.15.1:0/3295323575 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdefc158870 0x7fdefc14e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:23.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.165+0000 7fdf02314640 1 --2- 172.21.15.1:0/3295323575 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdefc0cc590 0x7fdefc160040 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:23.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.165+0000 7fdf02314640 1 --2- 172.21.15.1:0/3295323575 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdefc0c7da0 0x7fdefc1574e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:23.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.165+0000 7fdf02314640 1 -- 172.21.15.1:0/3295323575 >> 172.21.15.1:0/3295323575 conn(0x7fdefc0d2590 msgr2=0x7fdefc0ce3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:23.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.165+0000 7fdf02314640 1 -- 172.21.15.1:0/3295323575 shutdown_connections 2024-05-04T02:20:23.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.165+0000 7fdf02314640 1 -- 172.21.15.1:0/3295323575 wait complete. 2024-05-04T02:20:23.179 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-04T02:20:23.180 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-04T02:20:23.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.329+0000 7fa38d0d1640 1 Processor -- start 2024-05-04T02:20:23.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.329+0000 7fa38d0d1640 1 -- start start 2024-05-04T02:20:23.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.330+0000 7fa38d0d1640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa3880cdc20 0x7fa38806c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:23.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.331+0000 7fa38d0d1640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa388164df0 0x7fa388167210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:23.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.331+0000 7fa38d0d1640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3880c69e0 con 0x7fa3880c6f70 2024-05-04T02:20:23.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.331+0000 7fa38d0d1640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fa388160a20 con 0x7fa3880cdc20 2024-05-04T02:20:23.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.331+0000 7fa38d0d1640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa388160740 con 0x7fa388164df0 2024-05-04T02:20:23.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.331+0000 7fa38659c640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fa3880c6f70 0x7fa3880ccea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:56828/0 (socket says 172.21.15.1:56828) 2024-05-04T02:20:23.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.331+0000 7fa38659c640 1 -- 172.21.15.1:0/2141026345 learned_addr learned my addr 172.21.15.1:0/2141026345 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-05-04T02:20:23.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.331+0000 7fa38759e640 1 --2- 172.21.15.1:0/2141026345 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa388164df0 0x7fa388167210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:23.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.331+0000 7fa386d9d640 1 --2- 172.21.15.1:0/2141026345 >> v2:172.21.15.107:3300/0 conn(0x7fa3880cdc20 0x7fa38806c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:23.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.334+0000 7fa385d9b640 1 -- 172.21.15.1:0/2141026345 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1700896341 0 0) 0x7fa3880c69e0 con 0x7fa3880c6f70 2024-05-04T02:20:23.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.334+0000 7fa385d9b640 1 -- 172.21.15.1:0/2141026345 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa370003520 con 0x7fa3880c6f70 2024-05-04T02:20:23.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.335+0000 7fa38759e640 1 -- 172.21.15.1:0/2141026345 >> v2:172.21.15.107:3300/0 conn(0x7fa3880cdc20 msgr2=0x7fa38806c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:23.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.335+0000 7fa38759e640 1 --2- 172.21.15.1:0/2141026345 >> v2:172.21.15.107:3300/0 conn(0x7fa3880cdc20 0x7fa38806c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:23.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.335+0000 7fa38759e640 1 -- 172.21.15.1:0/2141026345 >> v1:172.21.15.1:6789/0 conn(0x7fa3880c6f70 legacy=0x7fa3880ccea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:23.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.335+0000 7fa38759e640 1 -- 172.21.15.1:0/2141026345 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3880c77f0 con 0x7fa388164df0 2024-05-04T02:20:23.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.338+0000 7fa38759e640 1 --2- 172.21.15.1:0/2141026345 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa388164df0 0x7fa388167210 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa378009d90 tx=0x7fa37802a6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6cfa610ba00bae8 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:23.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.342+0000 7fa385d9b640 1 -- 172.21.15.1:0/2141026345 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa378007740 con 0x7fa388164df0 2024-05-04T02:20:23.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.342+0000 7fa385d9b640 1 -- 172.21.15.1:0/2141026345 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3780078e0 con 0x7fa388164df0 2024-05-04T02:20:23.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.342+0000 7fa385d9b640 1 -- 172.21.15.1:0/2141026345 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa378007cb0 con 0x7fa388164df0 2024-05-04T02:20:23.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.343+0000 7fa38d0d1640 1 -- 172.21.15.1:0/2141026345 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa388164df0 msgr2=0x7fa388167210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:23.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.343+0000 7fa38d0d1640 1 --2- 172.21.15.1:0/2141026345 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa388164df0 0x7fa388167210 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa378009d90 tx=0x7fa37802a6f0 comp rx=0 tx=0).stop 2024-05-04T02:20:23.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.343+0000 7fa38d0d1640 1 -- 172.21.15.1:0/2141026345 shutdown_connections 2024-05-04T02:20:23.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.343+0000 7fa38d0d1640 1 --2- 172.21.15.1:0/2141026345 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa388164df0 0x7fa388167210 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:23.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.343+0000 7fa38d0d1640 1 --2- 172.21.15.1:0/2141026345 >> v2:172.21.15.107:3300/0 conn(0x7fa3880cdc20 0x7fa38806c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:23.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.343+0000 7fa38d0d1640 1 -- 172.21.15.1:0/2141026345 >> 172.21.15.1:0/2141026345 conn(0x7fa38808e210 msgr2=0x7fa3880d1960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:23.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.343+0000 7fa38d0d1640 1 -- 172.21.15.1:0/2141026345 shutdown_connections 2024-05-04T02:20:23.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.343+0000 7fa38d0d1640 1 -- 172.21.15.1:0/2141026345 wait complete. 2024-05-04T02:20:23.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.345+0000 7fa38d0d1640 1 Processor -- start 2024-05-04T02:20:23.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.345+0000 7fa38d0d1640 1 -- start start 2024-05-04T02:20:23.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.346+0000 7fa38d0d1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3880c6f70 0x7fa3881f2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:23.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.346+0000 7fa38d0d1640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa3880cdc20 0x7fa388148d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:23.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.346+0000 7fa38d0d1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa388164df0 0x7fa3880ca7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:23.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.346+0000 7fa38d0d1640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa3880c8090 con 0x7fa388164df0 2024-05-04T02:20:23.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.346+0000 7fa38d0d1640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa3880c7db0 con 0x7fa3880c6f70 2024-05-04T02:20:23.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.346+0000 7fa38d0d1640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa388160450 con 0x7fa3880cdc20 2024-05-04T02:20:23.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.347+0000 7fa38759e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa388164df0 0x7fa3880ca7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:23.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.347+0000 7fa38659c640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa3880cdc20 0x7fa388148d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:23.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.347+0000 7fa38759e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa388164df0 0x7fa3880ca7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41348/0 (socket says 172.21.15.1:41348) 2024-05-04T02:20:23.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.347+0000 7fa38759e640 1 -- 172.21.15.1:0/2559552083 learned_addr learned my addr 172.21.15.1:0/2559552083 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:23.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.347+0000 7fa386d9d640 1 --2- 172.21.15.1:0/2559552083 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3880c6f70 0x7fa3881f2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:23.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.351+0000 7fa38759e640 1 -- 172.21.15.1:0/2559552083 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa3880cdc20 msgr2=0x7fa388148d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:23.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.351+0000 7fa38759e640 1 --2- 172.21.15.1:0/2559552083 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa3880cdc20 0x7fa388148d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:23.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.351+0000 7fa38759e640 1 -- 172.21.15.1:0/2559552083 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3880c6f70 msgr2=0x7fa3881f2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:23.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.351+0000 7fa38759e640 1 --2- 172.21.15.1:0/2559552083 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3880c6f70 0x7fa3881f2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:23.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.351+0000 7fa38759e640 1 -- 172.21.15.1:0/2559552083 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3880d1700 con 0x7fa388164df0 2024-05-04T02:20:23.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.354+0000 7fa38759e640 1 --2- 172.21.15.1:0/2559552083 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa388164df0 0x7fa3880ca7c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa378009eb0 tx=0x7fa378004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:23.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.358+0000 7fa36f7fe640 1 -- 172.21.15.1:0/2559552083 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa378040030 con 0x7fa388164df0 2024-05-04T02:20:23.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.358+0000 7fa36f7fe640 1 -- 172.21.15.1:0/2559552083 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa378031940 con 0x7fa388164df0 2024-05-04T02:20:23.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.358+0000 7fa38d0d1640 1 -- 172.21.15.1:0/2559552083 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3881f6120 con 0x7fa388164df0 2024-05-04T02:20:23.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.358+0000 7fa36f7fe640 1 -- 172.21.15.1:0/2559552083 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa378031d10 con 0x7fa388164df0 2024-05-04T02:20:23.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.358+0000 7fa38d0d1640 1 -- 172.21.15.1:0/2559552083 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3880cfba0 con 0x7fa388164df0 2024-05-04T02:20:23.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.359+0000 7fa38d0d1640 1 -- 172.21.15.1:0/2559552083 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa388069bc0 con 0x7fa388164df0 2024-05-04T02:20:23.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.383+0000 7fa36f7fe640 1 -- 172.21.15.1:0/2559552083 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa378043030 con 0x7fa388164df0 2024-05-04T02:20:23.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.384+0000 7fa36f7fe640 1 --2- 172.21.15.1:0/2559552083 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fa374076300 0x7fa374078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:23.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.384+0000 7fa386d9d640 1 --2- 172.21.15.1:0/2559552083 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fa374076300 0x7fa374078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:23.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.384+0000 7fa386d9d640 1 --2- 172.21.15.1:0/2559552083 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fa374076300 0x7fa374078810 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa380009aa0 tx=0x7fa380009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:23.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.387+0000 7fa36f7fe640 1 -- 172.21.15.1:0/2559552083 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fa378007840 con 0x7fa388164df0 2024-05-04T02:20:23.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.673+0000 7fa36f7fe640 1 -- 172.21.15.1:0/2559552083 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa378081a00 con 0x7fa388164df0 2024-05-04T02:20:23.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.863+0000 7fa38d0d1640 1 -- 172.21.15.1:0/2559552083 --> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa388155420 con 0x7fa374076300 2024-05-04T02:20:23.872 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.870+0000 7fa36f7fe640 1 -- 172.21.15.1:0/2559552083 <== mgr.4108 v2:172.21.15.107:6800/3809222574 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251966 (secure 0 0 0) 0x7fa388155420 con 0x7fa374076300 2024-05-04T02:20:23.878 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:20:23.880 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-05-04T02:20:23.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.873+0000 7fa38d0d1640 1 -- 172.21.15.1:0/2559552083 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fa374076300 msgr2=0x7fa374078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:23.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.873+0000 7fa38d0d1640 1 --2- 172.21.15.1:0/2559552083 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fa374076300 0x7fa374078810 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa380009aa0 tx=0x7fa380009190 comp rx=0 tx=0).stop 2024-05-04T02:20:23.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.873+0000 7fa38d0d1640 1 -- 172.21.15.1:0/2559552083 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa388164df0 msgr2=0x7fa3880ca7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:23.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.873+0000 7fa38d0d1640 1 --2- 172.21.15.1:0/2559552083 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa388164df0 0x7fa3880ca7c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa378009eb0 tx=0x7fa378004a40 comp rx=0 tx=0).stop 2024-05-04T02:20:23.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.873+0000 7fa38d0d1640 1 -- 172.21.15.1:0/2559552083 shutdown_connections 2024-05-04T02:20:23.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.873+0000 7fa38d0d1640 1 --2- 172.21.15.1:0/2559552083 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fa374076300 0x7fa374078810 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:23.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.873+0000 7fa38d0d1640 1 --2- 172.21.15.1:0/2559552083 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa388164df0 0x7fa3880ca7c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:23.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.873+0000 7fa38d0d1640 1 --2- 172.21.15.1:0/2559552083 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa3880cdc20 0x7fa388148d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:23.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.873+0000 7fa38d0d1640 1 --2- 172.21.15.1:0/2559552083 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa3880c6f70 0x7fa3881f2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:23.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.873+0000 7fa38d0d1640 1 -- 172.21.15.1:0/2559552083 >> 172.21.15.1:0/2559552083 conn(0x7fa38808e210 msgr2=0x7fa3880cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:23.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.873+0000 7fa38d0d1640 1 -- 172.21.15.1:0/2559552083 shutdown_connections 2024-05-04T02:20:23.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:23.873+0000 7fa38d0d1640 1 -- 172.21.15.1:0/2559552083 wait complete. 2024-05-04T02:20:23.887 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2024-05-04T02:20:23.124161+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":234836,"kb_used_data":2004,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739884,"statfs":{"total":773094113280,"available":772853641216,"internally_reserved":0,"allocated":2052096,"data_stored":1855871,"data_compressed":65100,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.239877"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.547287+0000","last_change":"2024-05-04T02:20:15.298728+0000","last_active":"2024-05-04T02:20:18.547287+0000","last_peered":"2024-05-04T02:20:18.547287+0000","last_clean":"2024-05-04T02:20:18.547287+0000","last_became_active":"2024-05-04T02:20:15.298265+0000","last_became_peered":"2024-05-04T02:20:15.298265+0000","last_unstale":"2024-05-04T02:20:18.547287+0000","last_undegraded":"2024-05-04T02:20:18.547287+0000","last_fullsized":"2024-05-04T02:20:18.547287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:57:21.783118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.023924+0000","last_change":"2024-05-04T02:20:15.299265+0000","last_active":"2024-05-04T02:20:18.023924+0000","last_peered":"2024-05-04T02:20:18.023924+0000","last_clean":"2024-05-04T02:20:18.023924+0000","last_became_active":"2024-05-04T02:20:15.298956+0000","last_became_peered":"2024-05-04T02:20:15.298956+0000","last_unstale":"2024-05-04T02:20:18.023924+0000","last_undegraded":"2024-05-04T02:20:18.023924+0000","last_fullsized":"2024-05-04T02:20:18.023924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:23:25.157473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546733+0000","last_change":"2024-05-04T02:20:15.297447+0000","last_active":"2024-05-04T02:20:18.546733+0000","last_peered":"2024-05-04T02:20:18.546733+0000","last_clean":"2024-05-04T02:20:18.546733+0000","last_became_active":"2024-05-04T02:20:15.297150+0000","last_became_peered":"2024-05-04T02:20:15.297150+0000","last_unstale":"2024-05-04T02:20:18.546733+0000","last_undegraded":"2024-05-04T02:20:18.546733+0000","last_fullsized":"2024-05-04T02:20:18.546733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:10:27.059401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546433+0000","last_change":"2024-05-04T02:20:15.301427+0000","last_active":"2024-05-04T02:20:18.546433+0000","last_peered":"2024-05-04T02:20:18.546433+0000","last_clean":"2024-05-04T02:20:18.546433+0000","last_became_active":"2024-05-04T02:20:15.301113+0000","last_became_peered":"2024-05-04T02:20:15.301113+0000","last_unstale":"2024-05-04T02:20:18.546433+0000","last_undegraded":"2024-05-04T02:20:18.546433+0000","last_fullsized":"2024-05-04T02:20:18.546433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:06:48.185771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.547075+0000","last_change":"2024-05-04T02:20:15.297817+0000","last_active":"2024-05-04T02:20:18.547075+0000","last_peered":"2024-05-04T02:20:18.547075+0000","last_clean":"2024-05-04T02:20:18.547075+0000","last_became_active":"2024-05-04T02:20:15.297511+0000","last_became_peered":"2024-05-04T02:20:15.297511+0000","last_unstale":"2024-05-04T02:20:18.547075+0000","last_undegraded":"2024-05-04T02:20:18.547075+0000","last_fullsized":"2024-05-04T02:20:18.547075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:33:31.416768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546640+0000","last_change":"2024-05-04T02:20:15.306853+0000","last_active":"2024-05-04T02:20:18.546640+0000","last_peered":"2024-05-04T02:20:18.546640+0000","last_clean":"2024-05-04T02:20:18.546640+0000","last_became_active":"2024-05-04T02:20:15.306537+0000","last_became_peered":"2024-05-04T02:20:15.306537+0000","last_unstale":"2024-05-04T02:20:18.546640+0000","last_undegraded":"2024-05-04T02:20:18.546640+0000","last_fullsized":"2024-05-04T02:20:18.546640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:35:15.732585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546478+0000","last_change":"2024-05-04T02:20:15.299499+0000","last_active":"2024-05-04T02:20:18.546478+0000","last_peered":"2024-05-04T02:20:18.546478+0000","last_clean":"2024-05-04T02:20:18.546478+0000","last_became_active":"2024-05-04T02:20:15.299177+0000","last_became_peered":"2024-05-04T02:20:15.299177+0000","last_unstale":"2024-05-04T02:20:18.546478+0000","last_undegraded":"2024-05-04T02:20:18.546478+0000","last_fullsized":"2024-05-04T02:20:18.546478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:13:25.600467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.963063+0000","last_change":"2024-05-04T02:20:15.306964+0000","last_active":"2024-05-04T02:20:17.963063+0000","last_peered":"2024-05-04T02:20:17.963063+0000","last_clean":"2024-05-04T02:20:17.963063+0000","last_became_active":"2024-05-04T02:20:15.306663+0000","last_became_peered":"2024-05-04T02:20:15.306663+0000","last_unstale":"2024-05-04T02:20:17.963063+0000","last_undegraded":"2024-05-04T02:20:17.963063+0000","last_fullsized":"2024-05-04T02:20:17.963063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:52:22.299082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.547373+0000","last_change":"2024-05-04T02:20:15.303354+0000","last_active":"2024-05-04T02:20:18.547373+0000","last_peered":"2024-05-04T02:20:18.547373+0000","last_clean":"2024-05-04T02:20:18.547373+0000","last_became_active":"2024-05-04T02:20:15.303055+0000","last_became_peered":"2024-05-04T02:20:15.303055+0000","last_unstale":"2024-05-04T02:20:18.547373+0000","last_undegraded":"2024-05-04T02:20:18.547373+0000","last_fullsized":"2024-05-04T02:20:18.547373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:22:30.839899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.975983+0000","last_change":"2024-05-04T02:20:15.307433+0000","last_active":"2024-05-04T02:20:17.975983+0000","last_peered":"2024-05-04T02:20:17.975983+0000","last_clean":"2024-05-04T02:20:17.975983+0000","last_became_active":"2024-05-04T02:20:15.307124+0000","last_became_peered":"2024-05-04T02:20:15.307124+0000","last_unstale":"2024-05-04T02:20:17.975983+0000","last_undegraded":"2024-05-04T02:20:17.975983+0000","last_fullsized":"2024-05-04T02:20:17.975983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:22:04.903746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.975729+0000","last_change":"2024-05-04T02:20:15.306714+0000","last_active":"2024-05-04T02:20:17.975729+0000","last_peered":"2024-05-04T02:20:17.975729+0000","last_clean":"2024-05-04T02:20:17.975729+0000","last_became_active":"2024-05-04T02:20:15.306409+0000","last_became_peered":"2024-05-04T02:20:15.306409+0000","last_unstale":"2024-05-04T02:20:17.975729+0000","last_undegraded":"2024-05-04T02:20:17.975729+0000","last_fullsized":"2024-05-04T02:20:17.975729+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:51:58.828664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.964671+0000","last_change":"2024-05-04T02:20:15.296940+0000","last_active":"2024-05-04T02:20:17.964671+0000","last_peered":"2024-05-04T02:20:17.964671+0000","last_clean":"2024-05-04T02:20:17.964671+0000","last_became_active":"2024-05-04T02:20:15.296640+0000","last_became_peered":"2024-05-04T02:20:15.296640+0000","last_unstale":"2024-05-04T02:20:17.964671+0000","last_undegraded":"2024-05-04T02:20:17.964671+0000","last_fullsized":"2024-05-04T02:20:17.964671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:25:44.598454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.963262+0000","last_change":"2024-05-04T02:20:15.294287+0000","last_active":"2024-05-04T02:20:17.963262+0000","last_peered":"2024-05-04T02:20:17.963262+0000","last_clean":"2024-05-04T02:20:17.963262+0000","last_became_active":"2024-05-04T02:20:15.293909+0000","last_became_peered":"2024-05-04T02:20:15.293909+0000","last_unstale":"2024-05-04T02:20:17.963262+0000","last_undegraded":"2024-05-04T02:20:17.963262+0000","last_fullsized":"2024-05-04T02:20:17.963262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:31:26.635672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546404+0000","last_change":"2024-05-04T02:20:15.293837+0000","last_active":"2024-05-04T02:20:18.546404+0000","last_peered":"2024-05-04T02:20:18.546404+0000","last_clean":"2024-05-04T02:20:18.546404+0000","last_became_active":"2024-05-04T02:20:15.293550+0000","last_became_peered":"2024-05-04T02:20:15.293550+0000","last_unstale":"2024-05-04T02:20:18.546404+0000","last_undegraded":"2024-05-04T02:20:18.546404+0000","last_fullsized":"2024-05-04T02:20:18.546404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:55:35.975972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.023439+0000","last_change":"2024-05-04T02:20:15.306005+0000","last_active":"2024-05-04T02:20:18.023439+0000","last_peered":"2024-05-04T02:20:18.023439+0000","last_clean":"2024-05-04T02:20:18.023439+0000","last_became_active":"2024-05-04T02:20:15.305549+0000","last_became_peered":"2024-05-04T02:20:15.305549+0000","last_unstale":"2024-05-04T02:20:18.023439+0000","last_undegraded":"2024-05-04T02:20:18.023439+0000","last_fullsized":"2024-05-04T02:20:18.023439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:58:55.400048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546265+0000","last_change":"2024-05-04T02:20:15.305322+0000","last_active":"2024-05-04T02:20:18.546265+0000","last_peered":"2024-05-04T02:20:18.546265+0000","last_clean":"2024-05-04T02:20:18.546265+0000","last_became_active":"2024-05-04T02:20:15.301515+0000","last_became_peered":"2024-05-04T02:20:15.301515+0000","last_unstale":"2024-05-04T02:20:18.546265+0000","last_undegraded":"2024-05-04T02:20:18.546265+0000","last_fullsized":"2024-05-04T02:20:18.546265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:10:21.048301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546917+0000","last_change":"2024-05-04T02:20:15.301042+0000","last_active":"2024-05-04T02:20:18.546917+0000","last_peered":"2024-05-04T02:20:18.546917+0000","last_clean":"2024-05-04T02:20:18.546917+0000","last_became_active":"2024-05-04T02:20:15.300707+0000","last_became_peered":"2024-05-04T02:20:15.300707+0000","last_unstale":"2024-05-04T02:20:18.546917+0000","last_undegraded":"2024-05-04T02:20:18.546917+0000","last_fullsized":"2024-05-04T02:20:18.546917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:36:19.111702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546693+0000","last_change":"2024-05-04T02:20:15.292059+0000","last_active":"2024-05-04T02:20:18.546693+0000","last_peered":"2024-05-04T02:20:18.546693+0000","last_clean":"2024-05-04T02:20:18.546693+0000","last_became_active":"2024-05-04T02:20:15.291766+0000","last_became_peered":"2024-05-04T02:20:15.291766+0000","last_unstale":"2024-05-04T02:20:18.546693+0000","last_undegraded":"2024-05-04T02:20:18.546693+0000","last_fullsized":"2024-05-04T02:20:18.546693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:49:41.728826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.547413+0000","last_change":"2024-05-04T02:20:15.297861+0000","last_active":"2024-05-04T02:20:18.547413+0000","last_peered":"2024-05-04T02:20:18.547413+0000","last_clean":"2024-05-04T02:20:18.547413+0000","last_became_active":"2024-05-04T02:20:15.297568+0000","last_became_peered":"2024-05-04T02:20:15.297568+0000","last_unstale":"2024-05-04T02:20:18.547413+0000","last_undegraded":"2024-05-04T02:20:18.547413+0000","last_fullsized":"2024-05-04T02:20:18.547413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:52:52.278453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.975867+0000","last_change":"2024-05-04T02:20:15.303036+0000","last_active":"2024-05-04T02:20:17.975867+0000","last_peered":"2024-05-04T02:20:17.975867+0000","last_clean":"2024-05-04T02:20:17.975867+0000","last_became_active":"2024-05-04T02:20:15.302743+0000","last_became_peered":"2024-05-04T02:20:15.302743+0000","last_unstale":"2024-05-04T02:20:17.975867+0000","last_undegraded":"2024-05-04T02:20:17.975867+0000","last_fullsized":"2024-05-04T02:20:17.975867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:58:55.400048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546536+0000","last_change":"2024-05-04T02:20:15.300987+0000","last_active":"2024-05-04T02:20:18.546536+0000","last_peered":"2024-05-04T02:20:18.546536+0000","last_clean":"2024-05-04T02:20:18.546536+0000","last_became_active":"2024-05-04T02:20:15.300709+0000","last_became_peered":"2024-05-04T02:20:15.300709+0000","last_unstale":"2024-05-04T02:20:18.546536+0000","last_undegraded":"2024-05-04T02:20:18.546536+0000","last_fullsized":"2024-05-04T02:20:18.546536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:15:46.319755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546742+0000","last_change":"2024-05-04T02:20:15.301545+0000","last_active":"2024-05-04T02:20:18.546742+0000","last_peered":"2024-05-04T02:20:18.546742+0000","last_clean":"2024-05-04T02:20:18.546742+0000","last_became_active":"2024-05-04T02:20:15.300848+0000","last_became_peered":"2024-05-04T02:20:15.300848+0000","last_unstale":"2024-05-04T02:20:18.546742+0000","last_undegraded":"2024-05-04T02:20:18.546742+0000","last_fullsized":"2024-05-04T02:20:18.546742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:26:17.650165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.963300+0000","last_change":"2024-05-04T02:20:15.302188+0000","last_active":"2024-05-04T02:20:17.963300+0000","last_peered":"2024-05-04T02:20:17.963300+0000","last_clean":"2024-05-04T02:20:17.963300+0000","last_became_active":"2024-05-04T02:20:15.301879+0000","last_became_peered":"2024-05-04T02:20:15.301879+0000","last_unstale":"2024-05-04T02:20:17.963300+0000","last_undegraded":"2024-05-04T02:20:17.963300+0000","last_fullsized":"2024-05-04T02:20:17.963300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:51:58.828664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546335+0000","last_change":"2024-05-04T02:20:15.305583+0000","last_active":"2024-05-04T02:20:18.546335+0000","last_peered":"2024-05-04T02:20:18.546335+0000","last_clean":"2024-05-04T02:20:18.546335+0000","last_became_active":"2024-05-04T02:20:15.302385+0000","last_became_peered":"2024-05-04T02:20:15.302385+0000","last_unstale":"2024-05-04T02:20:18.546335+0000","last_undegraded":"2024-05-04T02:20:18.546335+0000","last_fullsized":"2024-05-04T02:20:18.546335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:15:56.592451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.963538+0000","last_change":"2024-05-04T02:20:15.301659+0000","last_active":"2024-05-04T02:20:17.963538+0000","last_peered":"2024-05-04T02:20:17.963538+0000","last_clean":"2024-05-04T02:20:17.963538+0000","last_became_active":"2024-05-04T02:20:15.301363+0000","last_became_peered":"2024-05-04T02:20:15.301363+0000","last_unstale":"2024-05-04T02:20:17.963538+0000","last_undegraded":"2024-05-04T02:20:17.963538+0000","last_fullsized":"2024-05-04T02:20:17.963538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:23:25.157473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.976005+0000","last_change":"2024-05-04T02:20:15.295843+0000","last_active":"2024-05-04T02:20:17.976005+0000","last_peered":"2024-05-04T02:20:17.976005+0000","last_clean":"2024-05-04T02:20:17.976005+0000","last_became_active":"2024-05-04T02:20:15.295577+0000","last_became_peered":"2024-05-04T02:20:15.295577+0000","last_unstale":"2024-05-04T02:20:17.976005+0000","last_undegraded":"2024-05-04T02:20:17.976005+0000","last_fullsized":"2024-05-04T02:20:17.976005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:23:25.157473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.023622+0000","last_change":"2024-05-04T02:20:15.299661+0000","last_active":"2024-05-04T02:20:18.023622+0000","last_peered":"2024-05-04T02:20:18.023622+0000","last_clean":"2024-05-04T02:20:18.023622+0000","last_became_active":"2024-05-04T02:20:15.299230+0000","last_became_peered":"2024-05-04T02:20:15.299230+0000","last_unstale":"2024-05-04T02:20:18.023622+0000","last_undegraded":"2024-05-04T02:20:18.023622+0000","last_fullsized":"2024-05-04T02:20:18.023622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:51:58.828664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.963907+0000","last_change":"2024-05-04T02:20:15.302719+0000","last_active":"2024-05-04T02:20:17.963907+0000","last_peered":"2024-05-04T02:20:17.963907+0000","last_clean":"2024-05-04T02:20:17.963907+0000","last_became_active":"2024-05-04T02:20:15.302456+0000","last_became_peered":"2024-05-04T02:20:15.302456+0000","last_unstale":"2024-05-04T02:20:17.963907+0000","last_undegraded":"2024-05-04T02:20:17.963907+0000","last_fullsized":"2024-05-04T02:20:17.963907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:06:48.185771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546634+0000","last_change":"2024-05-04T02:20:15.296567+0000","last_active":"2024-05-04T02:20:18.546634+0000","last_peered":"2024-05-04T02:20:18.546634+0000","last_clean":"2024-05-04T02:20:18.546634+0000","last_became_active":"2024-05-04T02:20:15.296235+0000","last_became_peered":"2024-05-04T02:20:15.296235+0000","last_unstale":"2024-05-04T02:20:18.546634+0000","last_undegraded":"2024-05-04T02:20:18.546634+0000","last_fullsized":"2024-05-04T02:20:18.546634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:32:20.652776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546840+0000","last_change":"2024-05-04T02:20:15.302190+0000","last_active":"2024-05-04T02:20:18.546840+0000","last_peered":"2024-05-04T02:20:18.546840+0000","last_clean":"2024-05-04T02:20:18.546840+0000","last_became_active":"2024-05-04T02:20:15.301184+0000","last_became_peered":"2024-05-04T02:20:15.301184+0000","last_unstale":"2024-05-04T02:20:18.546840+0000","last_undegraded":"2024-05-04T02:20:18.546840+0000","last_fullsized":"2024-05-04T02:20:18.546840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:52:52.278453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546581+0000","last_change":"2024-05-04T02:20:15.301739+0000","last_active":"2024-05-04T02:20:18.546581+0000","last_peered":"2024-05-04T02:20:18.546581+0000","last_clean":"2024-05-04T02:20:18.546581+0000","last_became_active":"2024-05-04T02:20:15.301424+0000","last_became_peered":"2024-05-04T02:20:15.301424+0000","last_unstale":"2024-05-04T02:20:18.546581+0000","last_undegraded":"2024-05-04T02:20:18.546581+0000","last_fullsized":"2024-05-04T02:20:18.546581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:40:19.927293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.975804+0000","last_change":"2024-05-04T02:20:15.293189+0000","last_active":"2024-05-04T02:20:17.975804+0000","last_peered":"2024-05-04T02:20:17.975804+0000","last_clean":"2024-05-04T02:20:17.975804+0000","last_became_active":"2024-05-04T02:20:15.292840+0000","last_became_peered":"2024-05-04T02:20:15.292840+0000","last_unstale":"2024-05-04T02:20:17.975804+0000","last_undegraded":"2024-05-04T02:20:17.975804+0000","last_fullsized":"2024-05-04T02:20:17.975804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:01:57.617230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.964296+0000","last_change":"2024-05-04T02:20:15.297718+0000","last_active":"2024-05-04T02:20:17.964296+0000","last_peered":"2024-05-04T02:20:17.964296+0000","last_clean":"2024-05-04T02:20:17.964296+0000","last_became_active":"2024-05-04T02:20:15.297415+0000","last_became_peered":"2024-05-04T02:20:15.297415+0000","last_unstale":"2024-05-04T02:20:17.964296+0000","last_undegraded":"2024-05-04T02:20:17.964296+0000","last_fullsized":"2024-05-04T02:20:17.964296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:03:46.054307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.963488+0000","last_change":"2024-05-04T02:20:14.290469+0000","last_active":"2024-05-04T02:20:17.963488+0000","last_peered":"2024-05-04T02:20:17.963488+0000","last_clean":"2024-05-04T02:20:17.963488+0000","last_became_active":"2024-05-04T02:20:14.289651+0000","last_became_peered":"2024-05-04T02:20:14.289651+0000","last_unstale":"2024-05-04T02:20:17.963488+0000","last_undegraded":"2024-05-04T02:20:17.963488+0000","last_fullsized":"2024-05-04T02:20:17.963488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:57:10.542857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546730+0000","last_change":"2024-05-04T02:20:15.305933+0000","last_active":"2024-05-04T02:20:18.546730+0000","last_peered":"2024-05-04T02:20:18.546730+0000","last_clean":"2024-05-04T02:20:18.546730+0000","last_became_active":"2024-05-04T02:20:15.305597+0000","last_became_peered":"2024-05-04T02:20:15.305597+0000","last_unstale":"2024-05-04T02:20:18.546730+0000","last_undegraded":"2024-05-04T02:20:18.546730+0000","last_fullsized":"2024-05-04T02:20:18.546730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:50:29.983685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.975696+0000","last_change":"2024-05-04T02:20:14.359094+0000","last_active":"2024-05-04T02:20:17.975696+0000","last_peered":"2024-05-04T02:20:17.975696+0000","last_clean":"2024-05-04T02:20:17.975696+0000","last_became_active":"2024-05-04T02:20:14.358394+0000","last_became_peered":"2024-05-04T02:20:14.358394+0000","last_unstale":"2024-05-04T02:20:17.975696+0000","last_undegraded":"2024-05-04T02:20:17.975696+0000","last_fullsized":"2024-05-04T02:20:17.975696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:57:26.889464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.963182+0000","last_change":"2024-05-04T02:20:14.356259+0000","last_active":"2024-05-04T02:20:17.963182+0000","last_peered":"2024-05-04T02:20:17.963182+0000","last_clean":"2024-05-04T02:20:17.963182+0000","last_became_active":"2024-05-04T02:20:14.355988+0000","last_became_peered":"2024-05-04T02:20:14.355988+0000","last_unstale":"2024-05-04T02:20:17.963182+0000","last_undegraded":"2024-05-04T02:20:17.963182+0000","last_fullsized":"2024-05-04T02:20:17.963182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:40:36.439339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.963128+0000","last_change":"2024-05-04T02:20:15.295517+0000","last_active":"2024-05-04T02:20:17.963128+0000","last_peered":"2024-05-04T02:20:17.963128+0000","last_clean":"2024-05-04T02:20:17.963128+0000","last_became_active":"2024-05-04T02:20:15.295222+0000","last_became_peered":"2024-05-04T02:20:15.295222+0000","last_unstale":"2024-05-04T02:20:17.963128+0000","last_undegraded":"2024-05-04T02:20:17.963128+0000","last_fullsized":"2024-05-04T02:20:17.963128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:58:55.400048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546388+0000","last_change":"2024-05-04T02:20:14.291543+0000","last_active":"2024-05-04T02:20:18.546388+0000","last_peered":"2024-05-04T02:20:18.546388+0000","last_clean":"2024-05-04T02:20:18.546388+0000","last_became_active":"2024-05-04T02:20:14.290893+0000","last_became_peered":"2024-05-04T02:20:14.290893+0000","last_unstale":"2024-05-04T02:20:18.546388+0000","last_undegraded":"2024-05-04T02:20:18.546388+0000","last_fullsized":"2024-05-04T02:20:18.546388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:57:10.542857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.023655+0000","last_change":"2024-05-04T02:20:15.291991+0000","last_active":"2024-05-04T02:20:18.023655+0000","last_peered":"2024-05-04T02:20:18.023655+0000","last_clean":"2024-05-04T02:20:18.023655+0000","last_became_active":"2024-05-04T02:20:15.291704+0000","last_became_peered":"2024-05-04T02:20:15.291704+0000","last_unstale":"2024-05-04T02:20:18.023655+0000","last_undegraded":"2024-05-04T02:20:18.023655+0000","last_fullsized":"2024-05-04T02:20:18.023655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:52:22.299082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.976029+0000","last_change":"2024-05-04T02:20:14.359336+0000","last_active":"2024-05-04T02:20:17.976029+0000","last_peered":"2024-05-04T02:20:17.976029+0000","last_clean":"2024-05-04T02:20:17.976029+0000","last_became_active":"2024-05-04T02:20:14.357940+0000","last_became_peered":"2024-05-04T02:20:14.357940+0000","last_unstale":"2024-05-04T02:20:17.976029+0000","last_undegraded":"2024-05-04T02:20:17.976029+0000","last_fullsized":"2024-05-04T02:20:17.976029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:48:24.055870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546559+0000","last_change":"2024-05-04T02:20:15.301852+0000","last_active":"2024-05-04T02:20:18.546559+0000","last_peered":"2024-05-04T02:20:18.546559+0000","last_clean":"2024-05-04T02:20:18.546559+0000","last_became_active":"2024-05-04T02:20:15.300374+0000","last_became_peered":"2024-05-04T02:20:15.300374+0000","last_unstale":"2024-05-04T02:20:18.546559+0000","last_undegraded":"2024-05-04T02:20:18.546559+0000","last_fullsized":"2024-05-04T02:20:18.546559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:16:20.585860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546660+0000","last_change":"2024-05-04T02:20:14.358952+0000","last_active":"2024-05-04T02:20:18.546660+0000","last_peered":"2024-05-04T02:20:18.546660+0000","last_clean":"2024-05-04T02:20:18.546660+0000","last_became_active":"2024-05-04T02:20:14.358625+0000","last_became_peered":"2024-05-04T02:20:14.358625+0000","last_unstale":"2024-05-04T02:20:18.546660+0000","last_undegraded":"2024-05-04T02:20:18.546660+0000","last_fullsized":"2024-05-04T02:20:18.546660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:52:21.185127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.547067+0000","last_change":"2024-05-04T02:20:15.307242+0000","last_active":"2024-05-04T02:20:18.547067+0000","last_peered":"2024-05-04T02:20:18.547067+0000","last_clean":"2024-05-04T02:20:18.547067+0000","last_became_active":"2024-05-04T02:20:15.306572+0000","last_became_peered":"2024-05-04T02:20:15.306572+0000","last_unstale":"2024-05-04T02:20:18.547067+0000","last_undegraded":"2024-05-04T02:20:18.547067+0000","last_fullsized":"2024-05-04T02:20:18.547067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:31:36.578679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.023779+0000","last_change":"2024-05-04T02:20:14.292979+0000","last_active":"2024-05-04T02:20:18.023779+0000","last_peered":"2024-05-04T02:20:18.023779+0000","last_clean":"2024-05-04T02:20:18.023779+0000","last_became_active":"2024-05-04T02:20:14.292564+0000","last_became_peered":"2024-05-04T02:20:14.292564+0000","last_unstale":"2024-05-04T02:20:18.023779+0000","last_undegraded":"2024-05-04T02:20:18.023779+0000","last_fullsized":"2024-05-04T02:20:18.023779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:34:37.703735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.964726+0000","last_change":"2024-05-04T02:20:15.298392+0000","last_active":"2024-05-04T02:20:17.964726+0000","last_peered":"2024-05-04T02:20:17.964726+0000","last_clean":"2024-05-04T02:20:17.964726+0000","last_became_active":"2024-05-04T02:20:15.298018+0000","last_became_peered":"2024-05-04T02:20:15.298018+0000","last_unstale":"2024-05-04T02:20:17.964726+0000","last_undegraded":"2024-05-04T02:20:17.964726+0000","last_fullsized":"2024-05-04T02:20:17.964726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:42:57.398678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.975964+0000","last_change":"2024-05-04T02:20:14.360237+0000","last_active":"2024-05-04T02:20:17.975964+0000","last_peered":"2024-05-04T02:20:17.975964+0000","last_clean":"2024-05-04T02:20:17.975964+0000","last_became_active":"2024-05-04T02:20:14.359886+0000","last_became_peered":"2024-05-04T02:20:14.359886+0000","last_unstale":"2024-05-04T02:20:17.975964+0000","last_undegraded":"2024-05-04T02:20:17.975964+0000","last_fullsized":"2024-05-04T02:20:17.975964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:34:37.703735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.547226+0000","last_change":"2024-05-04T02:20:15.299908+0000","last_active":"2024-05-04T02:20:18.547226+0000","last_peered":"2024-05-04T02:20:18.547226+0000","last_clean":"2024-05-04T02:20:18.547226+0000","last_became_active":"2024-05-04T02:20:15.299336+0000","last_became_peered":"2024-05-04T02:20:15.299336+0000","last_unstale":"2024-05-04T02:20:18.547226+0000","last_undegraded":"2024-05-04T02:20:18.547226+0000","last_fullsized":"2024-05-04T02:20:18.547226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:36:19.111702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546789+0000","last_change":"2024-05-04T02:20:14.274932+0000","last_active":"2024-05-04T02:20:18.546789+0000","last_peered":"2024-05-04T02:20:18.546789+0000","last_clean":"2024-05-04T02:20:18.546789+0000","last_became_active":"2024-05-04T02:20:14.274604+0000","last_became_peered":"2024-05-04T02:20:14.274604+0000","last_unstale":"2024-05-04T02:20:18.546789+0000","last_undegraded":"2024-05-04T02:20:18.546789+0000","last_fullsized":"2024-05-04T02:20:18.546789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:35:43.182599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546447+0000","last_change":"2024-05-04T02:20:15.300355+0000","last_active":"2024-05-04T02:20:18.546447+0000","last_peered":"2024-05-04T02:20:18.546447+0000","last_clean":"2024-05-04T02:20:18.546447+0000","last_became_active":"2024-05-04T02:20:15.300052+0000","last_became_peered":"2024-05-04T02:20:15.300052+0000","last_unstale":"2024-05-04T02:20:18.546447+0000","last_undegraded":"2024-05-04T02:20:18.546447+0000","last_fullsized":"2024-05-04T02:20:18.546447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:06:27.072275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546935+0000","last_change":"2024-05-04T02:20:14.290125+0000","last_active":"2024-05-04T02:20:18.546935+0000","last_peered":"2024-05-04T02:20:18.546935+0000","last_clean":"2024-05-04T02:20:18.546935+0000","last_became_active":"2024-05-04T02:20:14.289826+0000","last_became_peered":"2024-05-04T02:20:14.289826+0000","last_unstale":"2024-05-04T02:20:18.546935+0000","last_undegraded":"2024-05-04T02:20:18.546935+0000","last_fullsized":"2024-05-04T02:20:18.546935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:39:23.112031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.547089+0000","last_change":"2024-05-04T02:20:15.303257+0000","last_active":"2024-05-04T02:20:18.547089+0000","last_peered":"2024-05-04T02:20:18.547089+0000","last_clean":"2024-05-04T02:20:18.547089+0000","last_became_active":"2024-05-04T02:20:15.302963+0000","last_became_peered":"2024-05-04T02:20:15.302963+0000","last_unstale":"2024-05-04T02:20:18.547089+0000","last_undegraded":"2024-05-04T02:20:18.547089+0000","last_fullsized":"2024-05-04T02:20:18.547089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:05:46.729556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.975686+0000","last_change":"2024-05-04T02:20:14.359226+0000","last_active":"2024-05-04T02:20:17.975686+0000","last_peered":"2024-05-04T02:20:17.975686+0000","last_clean":"2024-05-04T02:20:17.975686+0000","last_became_active":"2024-05-04T02:20:14.358494+0000","last_became_peered":"2024-05-04T02:20:14.358494+0000","last_unstale":"2024-05-04T02:20:17.975686+0000","last_undegraded":"2024-05-04T02:20:17.975686+0000","last_fullsized":"2024-05-04T02:20:17.975686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:43:19.283728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.975673+0000","last_change":"2024-05-04T02:20:15.294689+0000","last_active":"2024-05-04T02:20:17.975673+0000","last_peered":"2024-05-04T02:20:17.975673+0000","last_clean":"2024-05-04T02:20:17.975673+0000","last_became_active":"2024-05-04T02:20:15.294400+0000","last_became_peered":"2024-05-04T02:20:15.294400+0000","last_unstale":"2024-05-04T02:20:17.975673+0000","last_undegraded":"2024-05-04T02:20:17.975673+0000","last_fullsized":"2024-05-04T02:20:17.975673+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:22:33.019301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546431+0000","last_change":"2024-05-04T02:20:14.269539+0000","last_active":"2024-05-04T02:20:18.546431+0000","last_peered":"2024-05-04T02:20:18.546431+0000","last_clean":"2024-05-04T02:20:18.546431+0000","last_became_active":"2024-05-04T02:20:14.269238+0000","last_became_peered":"2024-05-04T02:20:14.269238+0000","last_unstale":"2024-05-04T02:20:18.546431+0000","last_undegraded":"2024-05-04T02:20:18.546431+0000","last_fullsized":"2024-05-04T02:20:18.546431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:19:48.082162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546599+0000","last_change":"2024-05-04T02:20:15.304355+0000","last_active":"2024-05-04T02:20:18.546599+0000","last_peered":"2024-05-04T02:20:18.546599+0000","last_clean":"2024-05-04T02:20:18.546599+0000","last_became_active":"2024-05-04T02:20:15.302736+0000","last_became_peered":"2024-05-04T02:20:15.302736+0000","last_unstale":"2024-05-04T02:20:18.546599+0000","last_undegraded":"2024-05-04T02:20:18.546599+0000","last_fullsized":"2024-05-04T02:20:18.546599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:35:15.732585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.964800+0000","last_change":"2024-05-04T02:20:14.272218+0000","last_active":"2024-05-04T02:20:17.964800+0000","last_peered":"2024-05-04T02:20:17.964800+0000","last_clean":"2024-05-04T02:20:17.964800+0000","last_became_active":"2024-05-04T02:20:14.271883+0000","last_became_peered":"2024-05-04T02:20:14.271883+0000","last_unstale":"2024-05-04T02:20:17.964800+0000","last_undegraded":"2024-05-04T02:20:17.964800+0000","last_fullsized":"2024-05-04T02:20:17.964800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:32:55.463882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.547349+0000","last_change":"2024-05-04T02:20:15.302202+0000","last_active":"2024-05-04T02:20:18.547349+0000","last_peered":"2024-05-04T02:20:18.547349+0000","last_clean":"2024-05-04T02:20:18.547349+0000","last_became_active":"2024-05-04T02:20:15.301880+0000","last_became_peered":"2024-05-04T02:20:15.301880+0000","last_unstale":"2024-05-04T02:20:18.547349+0000","last_undegraded":"2024-05-04T02:20:18.547349+0000","last_fullsized":"2024-05-04T02:20:18.547349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:32:43.559282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546821+0000","last_change":"2024-05-04T02:20:14.292107+0000","last_active":"2024-05-04T02:20:18.546821+0000","last_peered":"2024-05-04T02:20:18.546821+0000","last_clean":"2024-05-04T02:20:18.546821+0000","last_became_active":"2024-05-04T02:20:14.290132+0000","last_became_peered":"2024-05-04T02:20:14.290132+0000","last_unstale":"2024-05-04T02:20:18.546821+0000","last_undegraded":"2024-05-04T02:20:18.546821+0000","last_fullsized":"2024-05-04T02:20:18.546821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:40:35.516308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.547411+0000","last_change":"2024-05-04T02:20:15.302140+0000","last_active":"2024-05-04T02:20:18.547411+0000","last_peered":"2024-05-04T02:20:18.547411+0000","last_clean":"2024-05-04T02:20:18.547411+0000","last_became_active":"2024-05-04T02:20:15.301798+0000","last_became_peered":"2024-05-04T02:20:15.301798+0000","last_unstale":"2024-05-04T02:20:18.547411+0000","last_undegraded":"2024-05-04T02:20:18.547411+0000","last_fullsized":"2024-05-04T02:20:18.547411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:20:28.069809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.023816+0000","last_change":"2024-05-04T02:20:14.274965+0000","last_active":"2024-05-04T02:20:18.023816+0000","last_peered":"2024-05-04T02:20:18.023816+0000","last_clean":"2024-05-04T02:20:18.023816+0000","last_became_active":"2024-05-04T02:20:14.274609+0000","last_became_peered":"2024-05-04T02:20:14.274609+0000","last_unstale":"2024-05-04T02:20:18.023816+0000","last_undegraded":"2024-05-04T02:20:18.023816+0000","last_fullsized":"2024-05-04T02:20:18.023816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:43:19.283728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546618+0000","last_change":"2024-05-04T02:20:15.305486+0000","last_active":"2024-05-04T02:20:18.546618+0000","last_peered":"2024-05-04T02:20:18.546618+0000","last_clean":"2024-05-04T02:20:18.546618+0000","last_became_active":"2024-05-04T02:20:15.301880+0000","last_became_peered":"2024-05-04T02:20:15.301880+0000","last_unstale":"2024-05-04T02:20:18.546618+0000","last_undegraded":"2024-05-04T02:20:18.546618+0000","last_fullsized":"2024-05-04T02:20:18.546618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:13:25.600467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546688+0000","last_change":"2024-05-04T02:20:14.288834+0000","last_active":"2024-05-04T02:20:18.546688+0000","last_peered":"2024-05-04T02:20:18.546688+0000","last_clean":"2024-05-04T02:20:18.546688+0000","last_became_active":"2024-05-04T02:20:14.287992+0000","last_became_peered":"2024-05-04T02:20:14.287992+0000","last_unstale":"2024-05-04T02:20:18.546688+0000","last_undegraded":"2024-05-04T02:20:18.546688+0000","last_fullsized":"2024-05-04T02:20:18.546688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:39:08.143762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.547284+0000","last_change":"2024-05-04T02:20:15.303880+0000","last_active":"2024-05-04T02:20:18.547284+0000","last_peered":"2024-05-04T02:20:18.547284+0000","last_clean":"2024-05-04T02:20:18.547284+0000","last_became_active":"2024-05-04T02:20:15.303601+0000","last_became_peered":"2024-05-04T02:20:15.303601+0000","last_unstale":"2024-05-04T02:20:18.547284+0000","last_undegraded":"2024-05-04T02:20:18.547284+0000","last_fullsized":"2024-05-04T02:20:18.547284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:26:17.650165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":114,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546844+0000","last_change":"2024-05-04T02:20:02.920020+0000","last_active":"2024-05-04T02:20:18.546844+0000","last_peered":"2024-05-04T02:20:18.546844+0000","last_clean":"2024-05-04T02:20:18.546844+0000","last_became_active":"2024-05-04T02:20:02.918859+0000","last_became_peered":"2024-05-04T02:20:02.918859+0000","last_unstale":"2024-05-04T02:20:18.546844+0000","last_undegraded":"2024-05-04T02:20:18.546844+0000","last_fullsized":"2024-05-04T02:20:18.546844+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:00.162760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:00.162760+0000","last_clean_scrub_stamp":"2024-05-04T02:20:00.162760+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:25:04.934922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546389+0000","last_change":"2024-05-04T02:20:14.290136+0000","last_active":"2024-05-04T02:20:18.546389+0000","last_peered":"2024-05-04T02:20:18.546389+0000","last_clean":"2024-05-04T02:20:18.546389+0000","last_became_active":"2024-05-04T02:20:14.289597+0000","last_became_peered":"2024-05-04T02:20:14.289597+0000","last_unstale":"2024-05-04T02:20:18.546389+0000","last_undegraded":"2024-05-04T02:20:18.546389+0000","last_fullsized":"2024-05-04T02:20:18.546389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:43:19.283728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.963442+0000","last_change":"2024-05-04T02:20:15.306971+0000","last_active":"2024-05-04T02:20:17.963442+0000","last_peered":"2024-05-04T02:20:17.963442+0000","last_clean":"2024-05-04T02:20:17.963442+0000","last_became_active":"2024-05-04T02:20:15.306640+0000","last_became_peered":"2024-05-04T02:20:15.306640+0000","last_unstale":"2024-05-04T02:20:17.963442+0000","last_undegraded":"2024-05-04T02:20:17.963442+0000","last_fullsized":"2024-05-04T02:20:17.963442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:22:04.903746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546739+0000","last_change":"2024-05-04T02:20:14.291379+0000","last_active":"2024-05-04T02:20:18.546739+0000","last_peered":"2024-05-04T02:20:18.546739+0000","last_clean":"2024-05-04T02:20:18.546739+0000","last_became_active":"2024-05-04T02:20:14.291044+0000","last_became_peered":"2024-05-04T02:20:14.291044+0000","last_unstale":"2024-05-04T02:20:18.546739+0000","last_undegraded":"2024-05-04T02:20:18.546739+0000","last_fullsized":"2024-05-04T02:20:18.546739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:58:54.286093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546344+0000","last_change":"2024-05-04T02:20:15.305870+0000","last_active":"2024-05-04T02:20:18.546344+0000","last_peered":"2024-05-04T02:20:18.546344+0000","last_clean":"2024-05-04T02:20:18.546344+0000","last_became_active":"2024-05-04T02:20:15.305512+0000","last_became_peered":"2024-05-04T02:20:15.305512+0000","last_unstale":"2024-05-04T02:20:18.546344+0000","last_undegraded":"2024-05-04T02:20:18.546344+0000","last_fullsized":"2024-05-04T02:20:18.546344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:11:17.529449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546641+0000","last_change":"2024-05-04T02:20:14.287676+0000","last_active":"2024-05-04T02:20:18.546641+0000","last_peered":"2024-05-04T02:20:18.546641+0000","last_clean":"2024-05-04T02:20:18.546641+0000","last_became_active":"2024-05-04T02:20:14.287335+0000","last_became_peered":"2024-05-04T02:20:14.287335+0000","last_unstale":"2024-05-04T02:20:18.546641+0000","last_undegraded":"2024-05-04T02:20:18.546641+0000","last_fullsized":"2024-05-04T02:20:18.546641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:54:20.482900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.023390+0000","last_change":"2024-05-04T02:20:15.297316+0000","last_active":"2024-05-04T02:20:18.023390+0000","last_peered":"2024-05-04T02:20:18.023390+0000","last_clean":"2024-05-04T02:20:18.023390+0000","last_became_active":"2024-05-04T02:20:15.297010+0000","last_became_peered":"2024-05-04T02:20:15.297010+0000","last_unstale":"2024-05-04T02:20:18.023390+0000","last_undegraded":"2024-05-04T02:20:18.023390+0000","last_fullsized":"2024-05-04T02:20:18.023390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:22:33.019301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.547029+0000","last_change":"2024-05-04T02:20:14.292802+0000","last_active":"2024-05-04T02:20:18.547029+0000","last_peered":"2024-05-04T02:20:18.547029+0000","last_clean":"2024-05-04T02:20:18.547029+0000","last_became_active":"2024-05-04T02:20:14.292595+0000","last_became_peered":"2024-05-04T02:20:14.292595+0000","last_unstale":"2024-05-04T02:20:18.547029+0000","last_undegraded":"2024-05-04T02:20:18.547029+0000","last_fullsized":"2024-05-04T02:20:18.547029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:31:25.521717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.964423+0000","last_change":"2024-05-04T02:20:15.296358+0000","last_active":"2024-05-04T02:20:17.964423+0000","last_peered":"2024-05-04T02:20:17.964423+0000","last_clean":"2024-05-04T02:20:17.964423+0000","last_became_active":"2024-05-04T02:20:15.296075+0000","last_became_peered":"2024-05-04T02:20:15.296075+0000","last_unstale":"2024-05-04T02:20:17.964423+0000","last_undegraded":"2024-05-04T02:20:17.964423+0000","last_fullsized":"2024-05-04T02:20:17.964423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:30:50.014584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.023655+0000","last_change":"2024-05-04T02:20:14.253846+0000","last_active":"2024-05-04T02:20:18.023655+0000","last_peered":"2024-05-04T02:20:18.023655+0000","last_clean":"2024-05-04T02:20:18.023655+0000","last_became_active":"2024-05-04T02:20:14.253513+0000","last_became_peered":"2024-05-04T02:20:14.253513+0000","last_unstale":"2024-05-04T02:20:18.023655+0000","last_undegraded":"2024-05-04T02:20:18.023655+0000","last_fullsized":"2024-05-04T02:20:18.023655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:40:36.439339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546859+0000","last_change":"2024-05-04T02:20:15.300702+0000","last_active":"2024-05-04T02:20:18.546859+0000","last_peered":"2024-05-04T02:20:18.546859+0000","last_clean":"2024-05-04T02:20:18.546859+0000","last_became_active":"2024-05-04T02:20:15.300251+0000","last_became_peered":"2024-05-04T02:20:15.300251+0000","last_unstale":"2024-05-04T02:20:18.546859+0000","last_undegraded":"2024-05-04T02:20:18.546859+0000","last_fullsized":"2024-05-04T02:20:18.546859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:05:46.729556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.547456+0000","last_change":"2024-05-04T02:20:14.291304+0000","last_active":"2024-05-04T02:20:18.547456+0000","last_peered":"2024-05-04T02:20:18.547456+0000","last_clean":"2024-05-04T02:20:18.547456+0000","last_became_active":"2024-05-04T02:20:14.290952+0000","last_became_peered":"2024-05-04T02:20:14.290952+0000","last_unstale":"2024-05-04T02:20:18.547456+0000","last_undegraded":"2024-05-04T02:20:18.547456+0000","last_fullsized":"2024-05-04T02:20:18.547456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:15:55.478496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.023562+0000","last_change":"2024-05-04T02:20:15.296895+0000","last_active":"2024-05-04T02:20:18.023562+0000","last_peered":"2024-05-04T02:20:18.023562+0000","last_clean":"2024-05-04T02:20:18.023562+0000","last_became_active":"2024-05-04T02:20:15.296562+0000","last_became_peered":"2024-05-04T02:20:15.296562+0000","last_unstale":"2024-05-04T02:20:18.023562+0000","last_undegraded":"2024-05-04T02:20:18.023562+0000","last_fullsized":"2024-05-04T02:20:18.023562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:22:04.903746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.024002+0000","last_change":"2024-05-04T02:20:14.358920+0000","last_active":"2024-05-04T02:20:18.024002+0000","last_peered":"2024-05-04T02:20:18.024002+0000","last_clean":"2024-05-04T02:20:18.024002+0000","last_became_active":"2024-05-04T02:20:14.358621+0000","last_became_peered":"2024-05-04T02:20:14.358621+0000","last_unstale":"2024-05-04T02:20:18.024002+0000","last_undegraded":"2024-05-04T02:20:18.024002+0000","last_fullsized":"2024-05-04T02:20:18.024002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:57:10.542857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.963661+0000","last_change":"2024-05-04T02:20:15.299992+0000","last_active":"2024-05-04T02:20:17.963661+0000","last_peered":"2024-05-04T02:20:17.963661+0000","last_clean":"2024-05-04T02:20:17.963661+0000","last_became_active":"2024-05-04T02:20:15.299678+0000","last_became_peered":"2024-05-04T02:20:15.299678+0000","last_unstale":"2024-05-04T02:20:17.963661+0000","last_undegraded":"2024-05-04T02:20:17.963661+0000","last_fullsized":"2024-05-04T02:20:17.963661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:39:43.029499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.976082+0000","last_change":"2024-05-04T02:20:14.359479+0000","last_active":"2024-05-04T02:20:17.976082+0000","last_peered":"2024-05-04T02:20:17.976082+0000","last_clean":"2024-05-04T02:20:17.976082+0000","last_became_active":"2024-05-04T02:20:14.358524+0000","last_became_peered":"2024-05-04T02:20:14.358524+0000","last_unstale":"2024-05-04T02:20:17.976082+0000","last_undegraded":"2024-05-04T02:20:17.976082+0000","last_fullsized":"2024-05-04T02:20:17.976082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:40:36.439339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.547004+0000","last_change":"2024-05-04T02:20:15.293908+0000","last_active":"2024-05-04T02:20:18.547004+0000","last_peered":"2024-05-04T02:20:18.547004+0000","last_clean":"2024-05-04T02:20:18.547004+0000","last_became_active":"2024-05-04T02:20:15.293602+0000","last_became_peered":"2024-05-04T02:20:15.293602+0000","last_unstale":"2024-05-04T02:20:18.547004+0000","last_undegraded":"2024-05-04T02:20:18.547004+0000","last_fullsized":"2024-05-04T02:20:18.547004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:18:03.065030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546622+0000","last_change":"2024-05-04T02:20:14.291515+0000","last_active":"2024-05-04T02:20:18.546622+0000","last_peered":"2024-05-04T02:20:18.546622+0000","last_clean":"2024-05-04T02:20:18.546622+0000","last_became_active":"2024-05-04T02:20:14.291068+0000","last_became_peered":"2024-05-04T02:20:14.291068+0000","last_unstale":"2024-05-04T02:20:18.546622+0000","last_undegraded":"2024-05-04T02:20:18.546622+0000","last_fullsized":"2024-05-04T02:20:18.546622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:57:10.542857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.964360+0000","last_change":"2024-05-04T02:20:15.247885+0000","last_active":"2024-05-04T02:20:17.964360+0000","last_peered":"2024-05-04T02:20:17.964360+0000","last_clean":"2024-05-04T02:20:17.964360+0000","last_became_active":"2024-05-04T02:20:15.247583+0000","last_became_peered":"2024-05-04T02:20:15.247583+0000","last_unstale":"2024-05-04T02:20:17.964360+0000","last_undegraded":"2024-05-04T02:20:17.964360+0000","last_fullsized":"2024-05-04T02:20:17.964360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:39:16.967443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.023555+0000","last_change":"2024-05-04T02:20:14.289690+0000","last_active":"2024-05-04T02:20:18.023555+0000","last_peered":"2024-05-04T02:20:18.023555+0000","last_clean":"2024-05-04T02:20:18.023555+0000","last_became_active":"2024-05-04T02:20:14.289360+0000","last_became_peered":"2024-05-04T02:20:14.289360+0000","last_unstale":"2024-05-04T02:20:18.023555+0000","last_undegraded":"2024-05-04T02:20:18.023555+0000","last_fullsized":"2024-05-04T02:20:18.023555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:57:26.889464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.963256+0000","last_change":"2024-05-04T02:20:15.296623+0000","last_active":"2024-05-04T02:20:17.963256+0000","last_peered":"2024-05-04T02:20:17.963256+0000","last_clean":"2024-05-04T02:20:17.963256+0000","last_became_active":"2024-05-04T02:20:15.296330+0000","last_became_peered":"2024-05-04T02:20:15.296330+0000","last_unstale":"2024-05-04T02:20:17.963256+0000","last_undegraded":"2024-05-04T02:20:17.963256+0000","last_fullsized":"2024-05-04T02:20:17.963256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:39:18.114604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.023764+0000","last_change":"2024-05-04T02:20:14.289113+0000","last_active":"2024-05-04T02:20:18.023764+0000","last_peered":"2024-05-04T02:20:18.023764+0000","last_clean":"2024-05-04T02:20:18.023764+0000","last_became_active":"2024-05-04T02:20:14.288769+0000","last_became_peered":"2024-05-04T02:20:14.288769+0000","last_unstale":"2024-05-04T02:20:18.023764+0000","last_undegraded":"2024-05-04T02:20:18.023764+0000","last_fullsized":"2024-05-04T02:20:18.023764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:48:24.055870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.963379+0000","last_change":"2024-05-04T02:20:15.295428+0000","last_active":"2024-05-04T02:20:17.963379+0000","last_peered":"2024-05-04T02:20:17.963379+0000","last_clean":"2024-05-04T02:20:17.963379+0000","last_became_active":"2024-05-04T02:20:15.295128+0000","last_became_peered":"2024-05-04T02:20:15.295128+0000","last_unstale":"2024-05-04T02:20:17.963379+0000","last_undegraded":"2024-05-04T02:20:17.963379+0000","last_fullsized":"2024-05-04T02:20:17.963379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:10:21.048301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.547224+0000","last_change":"2024-05-04T02:20:14.294321+0000","last_active":"2024-05-04T02:20:18.547224+0000","last_peered":"2024-05-04T02:20:18.547224+0000","last_clean":"2024-05-04T02:20:18.547224+0000","last_became_active":"2024-05-04T02:20:14.293862+0000","last_became_peered":"2024-05-04T02:20:14.293862+0000","last_unstale":"2024-05-04T02:20:18.547224+0000","last_undegraded":"2024-05-04T02:20:18.547224+0000","last_fullsized":"2024-05-04T02:20:18.547224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:39:17.000649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.975812+0000","last_change":"2024-05-04T02:20:15.296883+0000","last_active":"2024-05-04T02:20:17.975812+0000","last_peered":"2024-05-04T02:20:17.975812+0000","last_clean":"2024-05-04T02:20:17.975812+0000","last_became_active":"2024-05-04T02:20:15.296544+0000","last_became_peered":"2024-05-04T02:20:15.296544+0000","last_unstale":"2024-05-04T02:20:17.975812+0000","last_undegraded":"2024-05-04T02:20:17.975812+0000","last_fullsized":"2024-05-04T02:20:17.975812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:52:22.299082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546509+0000","last_change":"2024-05-04T02:20:15.306263+0000","last_active":"2024-05-04T02:20:18.546509+0000","last_peered":"2024-05-04T02:20:18.546509+0000","last_clean":"2024-05-04T02:20:18.546509+0000","last_became_active":"2024-05-04T02:20:15.305941+0000","last_became_peered":"2024-05-04T02:20:15.305941+0000","last_unstale":"2024-05-04T02:20:18.546509+0000","last_undegraded":"2024-05-04T02:20:18.546509+0000","last_fullsized":"2024-05-04T02:20:18.546509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:33:31.416768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.547164+0000","last_change":"2024-05-04T02:20:14.294204+0000","last_active":"2024-05-04T02:20:18.547164+0000","last_peered":"2024-05-04T02:20:18.547164+0000","last_clean":"2024-05-04T02:20:18.547164+0000","last_became_active":"2024-05-04T02:20:14.293788+0000","last_became_peered":"2024-05-04T02:20:14.293788+0000","last_unstale":"2024-05-04T02:20:18.547164+0000","last_undegraded":"2024-05-04T02:20:18.547164+0000","last_fullsized":"2024-05-04T02:20:18.547164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:52:21.185127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546530+0000","last_change":"2024-05-04T02:20:15.306357+0000","last_active":"2024-05-04T02:20:18.546530+0000","last_peered":"2024-05-04T02:20:18.546530+0000","last_clean":"2024-05-04T02:20:18.546530+0000","last_became_active":"2024-05-04T02:20:15.306050+0000","last_became_peered":"2024-05-04T02:20:15.306050+0000","last_unstale":"2024-05-04T02:20:18.546530+0000","last_undegraded":"2024-05-04T02:20:18.546530+0000","last_fullsized":"2024-05-04T02:20:18.546530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:39:18.114604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.547329+0000","last_change":"2024-05-04T02:20:14.357677+0000","last_active":"2024-05-04T02:20:18.547329+0000","last_peered":"2024-05-04T02:20:18.547329+0000","last_clean":"2024-05-04T02:20:18.547329+0000","last_became_active":"2024-05-04T02:20:14.357368+0000","last_became_peered":"2024-05-04T02:20:14.357368+0000","last_unstale":"2024-05-04T02:20:18.547329+0000","last_undegraded":"2024-05-04T02:20:18.547329+0000","last_fullsized":"2024-05-04T02:20:18.547329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:10:19.934346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546966+0000","last_change":"2024-05-04T02:20:15.307496+0000","last_active":"2024-05-04T02:20:18.546966+0000","last_peered":"2024-05-04T02:20:18.546966+0000","last_clean":"2024-05-04T02:20:18.546966+0000","last_became_active":"2024-05-04T02:20:15.306956+0000","last_became_peered":"2024-05-04T02:20:15.306956+0000","last_unstale":"2024-05-04T02:20:18.546966+0000","last_undegraded":"2024-05-04T02:20:18.546966+0000","last_fullsized":"2024-05-04T02:20:18.546966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:19:48.110866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.963458+0000","last_change":"2024-05-04T02:20:14.291632+0000","last_active":"2024-05-04T02:20:17.963458+0000","last_peered":"2024-05-04T02:20:17.963458+0000","last_clean":"2024-05-04T02:20:17.963458+0000","last_became_active":"2024-05-04T02:20:14.291331+0000","last_became_peered":"2024-05-04T02:20:14.291331+0000","last_unstale":"2024-05-04T02:20:17.963458+0000","last_undegraded":"2024-05-04T02:20:17.963458+0000","last_fullsized":"2024-05-04T02:20:17.963458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:22:31.905346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.963350+0000","last_change":"2024-05-04T02:20:15.294309+0000","last_active":"2024-05-04T02:20:17.963350+0000","last_peered":"2024-05-04T02:20:17.963350+0000","last_clean":"2024-05-04T02:20:17.963350+0000","last_became_active":"2024-05-04T02:20:15.294026+0000","last_became_peered":"2024-05-04T02:20:15.294026+0000","last_unstale":"2024-05-04T02:20:17.963350+0000","last_undegraded":"2024-05-04T02:20:17.963350+0000","last_fullsized":"2024-05-04T02:20:17.963350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:39:24.225985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.547102+0000","last_change":"2024-05-04T02:20:14.291633+0000","last_active":"2024-05-04T02:20:18.547102+0000","last_peered":"2024-05-04T02:20:18.547102+0000","last_clean":"2024-05-04T02:20:18.547102+0000","last_became_active":"2024-05-04T02:20:14.291313+0000","last_became_peered":"2024-05-04T02:20:14.291313+0000","last_unstale":"2024-05-04T02:20:18.547102+0000","last_undegraded":"2024-05-04T02:20:18.547102+0000","last_fullsized":"2024-05-04T02:20:18.547102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:48:36.710163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65100,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":303104,"data_stored":675478,"data_compressed":32550,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":245760,"data_stored":86140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509448,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":237568,"data_stored":84618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":245760,"data_stored":86140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509448,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":233472,"data_stored":84528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31420,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340420,"statfs":{"total":96636764160,"available":96604590080,"internally_reserved":0,"allocated":241664,"data_stored":84688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542152,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":245760,"data_stored":84654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31476,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340364,"statfs":{"total":96636764160,"available":96604532736,"internally_reserved":0,"allocated":299008,"data_stored":669625,"data_compressed":32550,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32550,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32550,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-04T02:20:23.892 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-04T02:20:24.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.039+0000 7f413857d640 1 Processor -- start 2024-05-04T02:20:24.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.039+0000 7f413857d640 1 -- start start 2024-05-04T02:20:24.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.041+0000 7f413857d640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f41300b3840 0x7f41301565c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:24.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.041+0000 7f413857d640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f413015c5a0 0x7f413015c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:24.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.041+0000 7f413857d640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41300b0fa0 con 0x7f41300ca980 2024-05-04T02:20:24.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.041+0000 7f413857d640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f41300b1fa0 con 0x7f41300b3840 2024-05-04T02:20:24.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.041+0000 7f413857d640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f41300b1560 con 0x7f413015c5a0 2024-05-04T02:20:24.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.042+0000 7f4136b1a640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f413015c5a0 0x7f413015c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:24.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.042+0000 7f4135b18640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f41300ca980 0x7f41300cb200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.1:54712/0 (socket says 172.21.15.1:54712) 2024-05-04T02:20:24.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.042+0000 7f4135b18640 1 -- 172.21.15.1:0/1717006863 learned_addr learned my addr 172.21.15.1:0/1717006863 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-05-04T02:20:24.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.045+0000 7f4136b1a640 1 -- 172.21.15.1:0/1717006863 >> v2:172.21.15.1:3300/0 conn(0x7f41300b3840 msgr2=0x7f41301565c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:24.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.045+0000 7f4136b1a640 1 --2- 172.21.15.1:0/1717006863 >> v2:172.21.15.1:3300/0 conn(0x7f41300b3840 0x7f41301565c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:24.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.045+0000 7f4136b1a640 1 -- 172.21.15.1:0/1717006863 >> v1:172.21.15.107:6789/0 conn(0x7f41300ca980 legacy=0x7f41300cb200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:24.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.045+0000 7f4136b1a640 1 -- 172.21.15.1:0/1717006863 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41300b1280 con 0x7f413015c5a0 2024-05-04T02:20:24.049 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.047+0000 7f4136b1a640 1 --2- 172.21.15.1:0/1717006863 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f413015c5a0 0x7f413015c9b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4128009d90 tx=0x7f412802a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8b8f9e82d5d5371 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:24.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.051+0000 7f4135317640 1 -- 172.21.15.1:0/1717006863 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4128007740 con 0x7f413015c5a0 2024-05-04T02:20:24.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.051+0000 7f4135317640 1 -- 172.21.15.1:0/1717006863 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41280078e0 con 0x7f413015c5a0 2024-05-04T02:20:24.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.051+0000 7f4135317640 1 -- 172.21.15.1:0/1717006863 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4128007cb0 con 0x7f413015c5a0 2024-05-04T02:20:24.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.051+0000 7f413857d640 1 -- 172.21.15.1:0/1717006863 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f413015c5a0 msgr2=0x7f413015c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:24.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.051+0000 7f413857d640 1 --2- 172.21.15.1:0/1717006863 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f413015c5a0 0x7f413015c9b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4128009d90 tx=0x7f412802a660 comp rx=0 tx=0).stop 2024-05-04T02:20:24.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.052+0000 7f413857d640 1 -- 172.21.15.1:0/1717006863 shutdown_connections 2024-05-04T02:20:24.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.052+0000 7f413857d640 1 --2- 172.21.15.1:0/1717006863 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f413015c5a0 0x7f413015c9b0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:24.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.052+0000 7f413857d640 1 --2- 172.21.15.1:0/1717006863 >> v2:172.21.15.1:3300/0 conn(0x7f41300b3840 0x7f41301565c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:24.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.052+0000 7f413857d640 1 -- 172.21.15.1:0/1717006863 >> 172.21.15.1:0/1717006863 conn(0x7f41300731f0 msgr2=0x7f41300706c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:24.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.052+0000 7f413857d640 1 -- 172.21.15.1:0/1717006863 shutdown_connections 2024-05-04T02:20:24.054 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.052+0000 7f413857d640 1 -- 172.21.15.1:0/1717006863 wait complete. 2024-05-04T02:20:24.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.053+0000 7f413857d640 1 Processor -- start 2024-05-04T02:20:24.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.053+0000 7f413857d640 1 -- start start 2024-05-04T02:20:24.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.055+0000 7f413857d640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f41300b3840 0x7f413015f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:24.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.055+0000 7f413857d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f41300ca980 0x7f413015e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:24.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.055+0000 7f413857d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f413015c5a0 0x7f41301464e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:24.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.055+0000 7f413857d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f41300b33b0 con 0x7f41300ca980 2024-05-04T02:20:24.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.055+0000 7f413857d640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f41300b1c30 con 0x7f413015c5a0 2024-05-04T02:20:24.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.055+0000 7f413857d640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f413015cef0 con 0x7f41300b3840 2024-05-04T02:20:24.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.055+0000 7f4136319640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f41300b3840 0x7f413015f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:24.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.055+0000 7f4136b1a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f413015c5a0 0x7f41301464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:24.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.056+0000 7f4136319640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f41300b3840 0x7f413015f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.1:49658/0 (socket says 172.21.15.1:49658) 2024-05-04T02:20:24.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.056+0000 7f4136319640 1 -- 172.21.15.1:0/2469974856 learned_addr learned my addr 172.21.15.1:0/2469974856 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:24.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.059+0000 7f4136319640 1 -- 172.21.15.1:0/2469974856 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f413015c5a0 msgr2=0x7f41301464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:24.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.059+0000 7f4136319640 1 --2- 172.21.15.1:0/2469974856 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f413015c5a0 0x7f41301464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:24.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.059+0000 7f4136319640 1 -- 172.21.15.1:0/2469974856 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f41300ca980 msgr2=0x7f413015e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:24.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.059+0000 7f4136319640 1 --2- 172.21.15.1:0/2469974856 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f41300ca980 0x7f413015e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:24.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.059+0000 7f4136319640 1 -- 172.21.15.1:0/2469974856 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4130155d60 con 0x7f41300b3840 2024-05-04T02:20:24.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.062+0000 7f4136319640 1 --2- 172.21.15.1:0/2469974856 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f41300b3840 0x7f413015f6d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f412c00b410 tx=0x7f412c00b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:24.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.066+0000 7f4126ffd640 1 -- 172.21.15.1:0/2469974856 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f412c015020 con 0x7f41300b3840 2024-05-04T02:20:24.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.066+0000 7f4126ffd640 1 -- 172.21.15.1:0/2469974856 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f412c011830 con 0x7f41300b3840 2024-05-04T02:20:24.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.066+0000 7f4126ffd640 1 -- 172.21.15.1:0/2469974856 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f412c011c20 con 0x7f41300b3840 2024-05-04T02:20:24.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.066+0000 7f413857d640 1 -- 172.21.15.1:0/2469974856 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f413015d800 con 0x7f41300b3840 2024-05-04T02:20:24.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.066+0000 7f413857d640 1 -- 172.21.15.1:0/2469974856 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f413015ddc0 con 0x7f41300b3840 2024-05-04T02:20:24.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.067+0000 7f413857d640 1 -- 172.21.15.1:0/2469974856 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4130076740 con 0x7f41300b3840 2024-05-04T02:20:24.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.345+0000 7f4126ffd640 1 -- 172.21.15.1:0/2469974856 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f412c018020 con 0x7f41300b3840 2024-05-04T02:20:24.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.346+0000 7f4126ffd640 1 --2- 172.21.15.1:0/2469974856 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f4114076320 0x7f4114078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:24.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.346+0000 7f4135b18640 1 --2- 172.21.15.1:0/2469974856 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f4114076320 0x7f4114078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:24.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.347+0000 7f4135b18640 1 --2- 172.21.15.1:0/2469974856 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f4114076320 0x7f4114078830 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f413015b590 tx=0x7f4120007a40 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:24.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.351+0000 7f4126ffd640 1 -- 172.21.15.1:0/2469974856 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f412c011dc0 con 0x7f41300b3840 2024-05-04T02:20:24.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.363+0000 7f4126ffd640 1 -- 172.21.15.1:0/2469974856 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f412c01f030 con 0x7f41300b3840 2024-05-04T02:20:24.557 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.555+0000 7f413857d640 1 -- 172.21.15.1:0/2469974856 --> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f413015ccd0 con 0x7f4114076320 2024-05-04T02:20:24.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.561+0000 7f4126ffd640 1 -- 172.21.15.1:0/2469974856 <== mgr.4108 v2:172.21.15.107:6800/3809222574 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251966 (secure 0 0 0) 0x7f413015ccd0 con 0x7f4114076320 2024-05-04T02:20:24.566 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:20:24.567 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-05-04T02:20:24.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.564+0000 7f413857d640 1 -- 172.21.15.1:0/2469974856 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f4114076320 msgr2=0x7f4114078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:24.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.564+0000 7f413857d640 1 --2- 172.21.15.1:0/2469974856 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f4114076320 0x7f4114078830 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f413015b590 tx=0x7f4120007a40 comp rx=0 tx=0).stop 2024-05-04T02:20:24.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.564+0000 7f413857d640 1 -- 172.21.15.1:0/2469974856 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f41300b3840 msgr2=0x7f413015f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:24.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.564+0000 7f413857d640 1 --2- 172.21.15.1:0/2469974856 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f41300b3840 0x7f413015f6d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f412c00b410 tx=0x7f412c00b8d0 comp rx=0 tx=0).stop 2024-05-04T02:20:24.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.564+0000 7f413857d640 1 -- 172.21.15.1:0/2469974856 shutdown_connections 2024-05-04T02:20:24.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.564+0000 7f413857d640 1 --2- 172.21.15.1:0/2469974856 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f4114076320 0x7f4114078830 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:24.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.564+0000 7f413857d640 1 --2- 172.21.15.1:0/2469974856 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f413015c5a0 0x7f41301464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:24.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.564+0000 7f413857d640 1 --2- 172.21.15.1:0/2469974856 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f41300ca980 0x7f413015e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:24.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.564+0000 7f413857d640 1 --2- 172.21.15.1:0/2469974856 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f41300b3840 0x7f413015f6d0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:24.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.564+0000 7f413857d640 1 -- 172.21.15.1:0/2469974856 >> 172.21.15.1:0/2469974856 conn(0x7f41300731f0 msgr2=0x7f4130070690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:24.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.565+0000 7f413857d640 1 -- 172.21.15.1:0/2469974856 shutdown_connections 2024-05-04T02:20:24.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.565+0000 7f413857d640 1 -- 172.21.15.1:0/2469974856 wait complete. 2024-05-04T02:20:24.577 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2024-05-04T02:20:23.124161+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":234836,"kb_used_data":2004,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739884,"statfs":{"total":773094113280,"available":772853641216,"internally_reserved":0,"allocated":2052096,"data_stored":1855871,"data_compressed":65100,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.239877"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.547287+0000","last_change":"2024-05-04T02:20:15.298728+0000","last_active":"2024-05-04T02:20:18.547287+0000","last_peered":"2024-05-04T02:20:18.547287+0000","last_clean":"2024-05-04T02:20:18.547287+0000","last_became_active":"2024-05-04T02:20:15.298265+0000","last_became_peered":"2024-05-04T02:20:15.298265+0000","last_unstale":"2024-05-04T02:20:18.547287+0000","last_undegraded":"2024-05-04T02:20:18.547287+0000","last_fullsized":"2024-05-04T02:20:18.547287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:57:21.783118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.023924+0000","last_change":"2024-05-04T02:20:15.299265+0000","last_active":"2024-05-04T02:20:18.023924+0000","last_peered":"2024-05-04T02:20:18.023924+0000","last_clean":"2024-05-04T02:20:18.023924+0000","last_became_active":"2024-05-04T02:20:15.298956+0000","last_became_peered":"2024-05-04T02:20:15.298956+0000","last_unstale":"2024-05-04T02:20:18.023924+0000","last_undegraded":"2024-05-04T02:20:18.023924+0000","last_fullsized":"2024-05-04T02:20:18.023924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:23:25.157473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546733+0000","last_change":"2024-05-04T02:20:15.297447+0000","last_active":"2024-05-04T02:20:18.546733+0000","last_peered":"2024-05-04T02:20:18.546733+0000","last_clean":"2024-05-04T02:20:18.546733+0000","last_became_active":"2024-05-04T02:20:15.297150+0000","last_became_peered":"2024-05-04T02:20:15.297150+0000","last_unstale":"2024-05-04T02:20:18.546733+0000","last_undegraded":"2024-05-04T02:20:18.546733+0000","last_fullsized":"2024-05-04T02:20:18.546733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:10:27.059401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546433+0000","last_change":"2024-05-04T02:20:15.301427+0000","last_active":"2024-05-04T02:20:18.546433+0000","last_peered":"2024-05-04T02:20:18.546433+0000","last_clean":"2024-05-04T02:20:18.546433+0000","last_became_active":"2024-05-04T02:20:15.301113+0000","last_became_peered":"2024-05-04T02:20:15.301113+0000","last_unstale":"2024-05-04T02:20:18.546433+0000","last_undegraded":"2024-05-04T02:20:18.546433+0000","last_fullsized":"2024-05-04T02:20:18.546433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:06:48.185771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.547075+0000","last_change":"2024-05-04T02:20:15.297817+0000","last_active":"2024-05-04T02:20:18.547075+0000","last_peered":"2024-05-04T02:20:18.547075+0000","last_clean":"2024-05-04T02:20:18.547075+0000","last_became_active":"2024-05-04T02:20:15.297511+0000","last_became_peered":"2024-05-04T02:20:15.297511+0000","last_unstale":"2024-05-04T02:20:18.547075+0000","last_undegraded":"2024-05-04T02:20:18.547075+0000","last_fullsized":"2024-05-04T02:20:18.547075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:33:31.416768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546640+0000","last_change":"2024-05-04T02:20:15.306853+0000","last_active":"2024-05-04T02:20:18.546640+0000","last_peered":"2024-05-04T02:20:18.546640+0000","last_clean":"2024-05-04T02:20:18.546640+0000","last_became_active":"2024-05-04T02:20:15.306537+0000","last_became_peered":"2024-05-04T02:20:15.306537+0000","last_unstale":"2024-05-04T02:20:18.546640+0000","last_undegraded":"2024-05-04T02:20:18.546640+0000","last_fullsized":"2024-05-04T02:20:18.546640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:35:15.732585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546478+0000","last_change":"2024-05-04T02:20:15.299499+0000","last_active":"2024-05-04T02:20:18.546478+0000","last_peered":"2024-05-04T02:20:18.546478+0000","last_clean":"2024-05-04T02:20:18.546478+0000","last_became_active":"2024-05-04T02:20:15.299177+0000","last_became_peered":"2024-05-04T02:20:15.299177+0000","last_unstale":"2024-05-04T02:20:18.546478+0000","last_undegraded":"2024-05-04T02:20:18.546478+0000","last_fullsized":"2024-05-04T02:20:18.546478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:13:25.600467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.963063+0000","last_change":"2024-05-04T02:20:15.306964+0000","last_active":"2024-05-04T02:20:17.963063+0000","last_peered":"2024-05-04T02:20:17.963063+0000","last_clean":"2024-05-04T02:20:17.963063+0000","last_became_active":"2024-05-04T02:20:15.306663+0000","last_became_peered":"2024-05-04T02:20:15.306663+0000","last_unstale":"2024-05-04T02:20:17.963063+0000","last_undegraded":"2024-05-04T02:20:17.963063+0000","last_fullsized":"2024-05-04T02:20:17.963063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:52:22.299082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.547373+0000","last_change":"2024-05-04T02:20:15.303354+0000","last_active":"2024-05-04T02:20:18.547373+0000","last_peered":"2024-05-04T02:20:18.547373+0000","last_clean":"2024-05-04T02:20:18.547373+0000","last_became_active":"2024-05-04T02:20:15.303055+0000","last_became_peered":"2024-05-04T02:20:15.303055+0000","last_unstale":"2024-05-04T02:20:18.547373+0000","last_undegraded":"2024-05-04T02:20:18.547373+0000","last_fullsized":"2024-05-04T02:20:18.547373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:22:30.839899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.975983+0000","last_change":"2024-05-04T02:20:15.307433+0000","last_active":"2024-05-04T02:20:17.975983+0000","last_peered":"2024-05-04T02:20:17.975983+0000","last_clean":"2024-05-04T02:20:17.975983+0000","last_became_active":"2024-05-04T02:20:15.307124+0000","last_became_peered":"2024-05-04T02:20:15.307124+0000","last_unstale":"2024-05-04T02:20:17.975983+0000","last_undegraded":"2024-05-04T02:20:17.975983+0000","last_fullsized":"2024-05-04T02:20:17.975983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:22:04.903746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.975729+0000","last_change":"2024-05-04T02:20:15.306714+0000","last_active":"2024-05-04T02:20:17.975729+0000","last_peered":"2024-05-04T02:20:17.975729+0000","last_clean":"2024-05-04T02:20:17.975729+0000","last_became_active":"2024-05-04T02:20:15.306409+0000","last_became_peered":"2024-05-04T02:20:15.306409+0000","last_unstale":"2024-05-04T02:20:17.975729+0000","last_undegraded":"2024-05-04T02:20:17.975729+0000","last_fullsized":"2024-05-04T02:20:17.975729+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:51:58.828664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.964671+0000","last_change":"2024-05-04T02:20:15.296940+0000","last_active":"2024-05-04T02:20:17.964671+0000","last_peered":"2024-05-04T02:20:17.964671+0000","last_clean":"2024-05-04T02:20:17.964671+0000","last_became_active":"2024-05-04T02:20:15.296640+0000","last_became_peered":"2024-05-04T02:20:15.296640+0000","last_unstale":"2024-05-04T02:20:17.964671+0000","last_undegraded":"2024-05-04T02:20:17.964671+0000","last_fullsized":"2024-05-04T02:20:17.964671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:25:44.598454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.963262+0000","last_change":"2024-05-04T02:20:15.294287+0000","last_active":"2024-05-04T02:20:17.963262+0000","last_peered":"2024-05-04T02:20:17.963262+0000","last_clean":"2024-05-04T02:20:17.963262+0000","last_became_active":"2024-05-04T02:20:15.293909+0000","last_became_peered":"2024-05-04T02:20:15.293909+0000","last_unstale":"2024-05-04T02:20:17.963262+0000","last_undegraded":"2024-05-04T02:20:17.963262+0000","last_fullsized":"2024-05-04T02:20:17.963262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:31:26.635672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546404+0000","last_change":"2024-05-04T02:20:15.293837+0000","last_active":"2024-05-04T02:20:18.546404+0000","last_peered":"2024-05-04T02:20:18.546404+0000","last_clean":"2024-05-04T02:20:18.546404+0000","last_became_active":"2024-05-04T02:20:15.293550+0000","last_became_peered":"2024-05-04T02:20:15.293550+0000","last_unstale":"2024-05-04T02:20:18.546404+0000","last_undegraded":"2024-05-04T02:20:18.546404+0000","last_fullsized":"2024-05-04T02:20:18.546404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:55:35.975972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.023439+0000","last_change":"2024-05-04T02:20:15.306005+0000","last_active":"2024-05-04T02:20:18.023439+0000","last_peered":"2024-05-04T02:20:18.023439+0000","last_clean":"2024-05-04T02:20:18.023439+0000","last_became_active":"2024-05-04T02:20:15.305549+0000","last_became_peered":"2024-05-04T02:20:15.305549+0000","last_unstale":"2024-05-04T02:20:18.023439+0000","last_undegraded":"2024-05-04T02:20:18.023439+0000","last_fullsized":"2024-05-04T02:20:18.023439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:58:55.400048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546265+0000","last_change":"2024-05-04T02:20:15.305322+0000","last_active":"2024-05-04T02:20:18.546265+0000","last_peered":"2024-05-04T02:20:18.546265+0000","last_clean":"2024-05-04T02:20:18.546265+0000","last_became_active":"2024-05-04T02:20:15.301515+0000","last_became_peered":"2024-05-04T02:20:15.301515+0000","last_unstale":"2024-05-04T02:20:18.546265+0000","last_undegraded":"2024-05-04T02:20:18.546265+0000","last_fullsized":"2024-05-04T02:20:18.546265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:10:21.048301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546917+0000","last_change":"2024-05-04T02:20:15.301042+0000","last_active":"2024-05-04T02:20:18.546917+0000","last_peered":"2024-05-04T02:20:18.546917+0000","last_clean":"2024-05-04T02:20:18.546917+0000","last_became_active":"2024-05-04T02:20:15.300707+0000","last_became_peered":"2024-05-04T02:20:15.300707+0000","last_unstale":"2024-05-04T02:20:18.546917+0000","last_undegraded":"2024-05-04T02:20:18.546917+0000","last_fullsized":"2024-05-04T02:20:18.546917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:36:19.111702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546693+0000","last_change":"2024-05-04T02:20:15.292059+0000","last_active":"2024-05-04T02:20:18.546693+0000","last_peered":"2024-05-04T02:20:18.546693+0000","last_clean":"2024-05-04T02:20:18.546693+0000","last_became_active":"2024-05-04T02:20:15.291766+0000","last_became_peered":"2024-05-04T02:20:15.291766+0000","last_unstale":"2024-05-04T02:20:18.546693+0000","last_undegraded":"2024-05-04T02:20:18.546693+0000","last_fullsized":"2024-05-04T02:20:18.546693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:49:41.728826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.547413+0000","last_change":"2024-05-04T02:20:15.297861+0000","last_active":"2024-05-04T02:20:18.547413+0000","last_peered":"2024-05-04T02:20:18.547413+0000","last_clean":"2024-05-04T02:20:18.547413+0000","last_became_active":"2024-05-04T02:20:15.297568+0000","last_became_peered":"2024-05-04T02:20:15.297568+0000","last_unstale":"2024-05-04T02:20:18.547413+0000","last_undegraded":"2024-05-04T02:20:18.547413+0000","last_fullsized":"2024-05-04T02:20:18.547413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:52:52.278453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.975867+0000","last_change":"2024-05-04T02:20:15.303036+0000","last_active":"2024-05-04T02:20:17.975867+0000","last_peered":"2024-05-04T02:20:17.975867+0000","last_clean":"2024-05-04T02:20:17.975867+0000","last_became_active":"2024-05-04T02:20:15.302743+0000","last_became_peered":"2024-05-04T02:20:15.302743+0000","last_unstale":"2024-05-04T02:20:17.975867+0000","last_undegraded":"2024-05-04T02:20:17.975867+0000","last_fullsized":"2024-05-04T02:20:17.975867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:58:55.400048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546536+0000","last_change":"2024-05-04T02:20:15.300987+0000","last_active":"2024-05-04T02:20:18.546536+0000","last_peered":"2024-05-04T02:20:18.546536+0000","last_clean":"2024-05-04T02:20:18.546536+0000","last_became_active":"2024-05-04T02:20:15.300709+0000","last_became_peered":"2024-05-04T02:20:15.300709+0000","last_unstale":"2024-05-04T02:20:18.546536+0000","last_undegraded":"2024-05-04T02:20:18.546536+0000","last_fullsized":"2024-05-04T02:20:18.546536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:15:46.319755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546742+0000","last_change":"2024-05-04T02:20:15.301545+0000","last_active":"2024-05-04T02:20:18.546742+0000","last_peered":"2024-05-04T02:20:18.546742+0000","last_clean":"2024-05-04T02:20:18.546742+0000","last_became_active":"2024-05-04T02:20:15.300848+0000","last_became_peered":"2024-05-04T02:20:15.300848+0000","last_unstale":"2024-05-04T02:20:18.546742+0000","last_undegraded":"2024-05-04T02:20:18.546742+0000","last_fullsized":"2024-05-04T02:20:18.546742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:26:17.650165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.963300+0000","last_change":"2024-05-04T02:20:15.302188+0000","last_active":"2024-05-04T02:20:17.963300+0000","last_peered":"2024-05-04T02:20:17.963300+0000","last_clean":"2024-05-04T02:20:17.963300+0000","last_became_active":"2024-05-04T02:20:15.301879+0000","last_became_peered":"2024-05-04T02:20:15.301879+0000","last_unstale":"2024-05-04T02:20:17.963300+0000","last_undegraded":"2024-05-04T02:20:17.963300+0000","last_fullsized":"2024-05-04T02:20:17.963300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:51:58.828664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546335+0000","last_change":"2024-05-04T02:20:15.305583+0000","last_active":"2024-05-04T02:20:18.546335+0000","last_peered":"2024-05-04T02:20:18.546335+0000","last_clean":"2024-05-04T02:20:18.546335+0000","last_became_active":"2024-05-04T02:20:15.302385+0000","last_became_peered":"2024-05-04T02:20:15.302385+0000","last_unstale":"2024-05-04T02:20:18.546335+0000","last_undegraded":"2024-05-04T02:20:18.546335+0000","last_fullsized":"2024-05-04T02:20:18.546335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:15:56.592451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.963538+0000","last_change":"2024-05-04T02:20:15.301659+0000","last_active":"2024-05-04T02:20:17.963538+0000","last_peered":"2024-05-04T02:20:17.963538+0000","last_clean":"2024-05-04T02:20:17.963538+0000","last_became_active":"2024-05-04T02:20:15.301363+0000","last_became_peered":"2024-05-04T02:20:15.301363+0000","last_unstale":"2024-05-04T02:20:17.963538+0000","last_undegraded":"2024-05-04T02:20:17.963538+0000","last_fullsized":"2024-05-04T02:20:17.963538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:23:25.157473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.976005+0000","last_change":"2024-05-04T02:20:15.295843+0000","last_active":"2024-05-04T02:20:17.976005+0000","last_peered":"2024-05-04T02:20:17.976005+0000","last_clean":"2024-05-04T02:20:17.976005+0000","last_became_active":"2024-05-04T02:20:15.295577+0000","last_became_peered":"2024-05-04T02:20:15.295577+0000","last_unstale":"2024-05-04T02:20:17.976005+0000","last_undegraded":"2024-05-04T02:20:17.976005+0000","last_fullsized":"2024-05-04T02:20:17.976005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:23:25.157473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.023622+0000","last_change":"2024-05-04T02:20:15.299661+0000","last_active":"2024-05-04T02:20:18.023622+0000","last_peered":"2024-05-04T02:20:18.023622+0000","last_clean":"2024-05-04T02:20:18.023622+0000","last_became_active":"2024-05-04T02:20:15.299230+0000","last_became_peered":"2024-05-04T02:20:15.299230+0000","last_unstale":"2024-05-04T02:20:18.023622+0000","last_undegraded":"2024-05-04T02:20:18.023622+0000","last_fullsized":"2024-05-04T02:20:18.023622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:51:58.828664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.963907+0000","last_change":"2024-05-04T02:20:15.302719+0000","last_active":"2024-05-04T02:20:17.963907+0000","last_peered":"2024-05-04T02:20:17.963907+0000","last_clean":"2024-05-04T02:20:17.963907+0000","last_became_active":"2024-05-04T02:20:15.302456+0000","last_became_peered":"2024-05-04T02:20:15.302456+0000","last_unstale":"2024-05-04T02:20:17.963907+0000","last_undegraded":"2024-05-04T02:20:17.963907+0000","last_fullsized":"2024-05-04T02:20:17.963907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:06:48.185771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546634+0000","last_change":"2024-05-04T02:20:15.296567+0000","last_active":"2024-05-04T02:20:18.546634+0000","last_peered":"2024-05-04T02:20:18.546634+0000","last_clean":"2024-05-04T02:20:18.546634+0000","last_became_active":"2024-05-04T02:20:15.296235+0000","last_became_peered":"2024-05-04T02:20:15.296235+0000","last_unstale":"2024-05-04T02:20:18.546634+0000","last_undegraded":"2024-05-04T02:20:18.546634+0000","last_fullsized":"2024-05-04T02:20:18.546634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:32:20.652776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546840+0000","last_change":"2024-05-04T02:20:15.302190+0000","last_active":"2024-05-04T02:20:18.546840+0000","last_peered":"2024-05-04T02:20:18.546840+0000","last_clean":"2024-05-04T02:20:18.546840+0000","last_became_active":"2024-05-04T02:20:15.301184+0000","last_became_peered":"2024-05-04T02:20:15.301184+0000","last_unstale":"2024-05-04T02:20:18.546840+0000","last_undegraded":"2024-05-04T02:20:18.546840+0000","last_fullsized":"2024-05-04T02:20:18.546840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:52:52.278453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546581+0000","last_change":"2024-05-04T02:20:15.301739+0000","last_active":"2024-05-04T02:20:18.546581+0000","last_peered":"2024-05-04T02:20:18.546581+0000","last_clean":"2024-05-04T02:20:18.546581+0000","last_became_active":"2024-05-04T02:20:15.301424+0000","last_became_peered":"2024-05-04T02:20:15.301424+0000","last_unstale":"2024-05-04T02:20:18.546581+0000","last_undegraded":"2024-05-04T02:20:18.546581+0000","last_fullsized":"2024-05-04T02:20:18.546581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:40:19.927293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.975804+0000","last_change":"2024-05-04T02:20:15.293189+0000","last_active":"2024-05-04T02:20:17.975804+0000","last_peered":"2024-05-04T02:20:17.975804+0000","last_clean":"2024-05-04T02:20:17.975804+0000","last_became_active":"2024-05-04T02:20:15.292840+0000","last_became_peered":"2024-05-04T02:20:15.292840+0000","last_unstale":"2024-05-04T02:20:17.975804+0000","last_undegraded":"2024-05-04T02:20:17.975804+0000","last_fullsized":"2024-05-04T02:20:17.975804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:01:57.617230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.964296+0000","last_change":"2024-05-04T02:20:15.297718+0000","last_active":"2024-05-04T02:20:17.964296+0000","last_peered":"2024-05-04T02:20:17.964296+0000","last_clean":"2024-05-04T02:20:17.964296+0000","last_became_active":"2024-05-04T02:20:15.297415+0000","last_became_peered":"2024-05-04T02:20:15.297415+0000","last_unstale":"2024-05-04T02:20:17.964296+0000","last_undegraded":"2024-05-04T02:20:17.964296+0000","last_fullsized":"2024-05-04T02:20:17.964296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:03:46.054307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.963488+0000","last_change":"2024-05-04T02:20:14.290469+0000","last_active":"2024-05-04T02:20:17.963488+0000","last_peered":"2024-05-04T02:20:17.963488+0000","last_clean":"2024-05-04T02:20:17.963488+0000","last_became_active":"2024-05-04T02:20:14.289651+0000","last_became_peered":"2024-05-04T02:20:14.289651+0000","last_unstale":"2024-05-04T02:20:17.963488+0000","last_undegraded":"2024-05-04T02:20:17.963488+0000","last_fullsized":"2024-05-04T02:20:17.963488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:57:10.542857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546730+0000","last_change":"2024-05-04T02:20:15.305933+0000","last_active":"2024-05-04T02:20:18.546730+0000","last_peered":"2024-05-04T02:20:18.546730+0000","last_clean":"2024-05-04T02:20:18.546730+0000","last_became_active":"2024-05-04T02:20:15.305597+0000","last_became_peered":"2024-05-04T02:20:15.305597+0000","last_unstale":"2024-05-04T02:20:18.546730+0000","last_undegraded":"2024-05-04T02:20:18.546730+0000","last_fullsized":"2024-05-04T02:20:18.546730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:50:29.983685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.975696+0000","last_change":"2024-05-04T02:20:14.359094+0000","last_active":"2024-05-04T02:20:17.975696+0000","last_peered":"2024-05-04T02:20:17.975696+0000","last_clean":"2024-05-04T02:20:17.975696+0000","last_became_active":"2024-05-04T02:20:14.358394+0000","last_became_peered":"2024-05-04T02:20:14.358394+0000","last_unstale":"2024-05-04T02:20:17.975696+0000","last_undegraded":"2024-05-04T02:20:17.975696+0000","last_fullsized":"2024-05-04T02:20:17.975696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:57:26.889464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.963182+0000","last_change":"2024-05-04T02:20:14.356259+0000","last_active":"2024-05-04T02:20:17.963182+0000","last_peered":"2024-05-04T02:20:17.963182+0000","last_clean":"2024-05-04T02:20:17.963182+0000","last_became_active":"2024-05-04T02:20:14.355988+0000","last_became_peered":"2024-05-04T02:20:14.355988+0000","last_unstale":"2024-05-04T02:20:17.963182+0000","last_undegraded":"2024-05-04T02:20:17.963182+0000","last_fullsized":"2024-05-04T02:20:17.963182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:40:36.439339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.963128+0000","last_change":"2024-05-04T02:20:15.295517+0000","last_active":"2024-05-04T02:20:17.963128+0000","last_peered":"2024-05-04T02:20:17.963128+0000","last_clean":"2024-05-04T02:20:17.963128+0000","last_became_active":"2024-05-04T02:20:15.295222+0000","last_became_peered":"2024-05-04T02:20:15.295222+0000","last_unstale":"2024-05-04T02:20:17.963128+0000","last_undegraded":"2024-05-04T02:20:17.963128+0000","last_fullsized":"2024-05-04T02:20:17.963128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:58:55.400048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546388+0000","last_change":"2024-05-04T02:20:14.291543+0000","last_active":"2024-05-04T02:20:18.546388+0000","last_peered":"2024-05-04T02:20:18.546388+0000","last_clean":"2024-05-04T02:20:18.546388+0000","last_became_active":"2024-05-04T02:20:14.290893+0000","last_became_peered":"2024-05-04T02:20:14.290893+0000","last_unstale":"2024-05-04T02:20:18.546388+0000","last_undegraded":"2024-05-04T02:20:18.546388+0000","last_fullsized":"2024-05-04T02:20:18.546388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:57:10.542857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.023655+0000","last_change":"2024-05-04T02:20:15.291991+0000","last_active":"2024-05-04T02:20:18.023655+0000","last_peered":"2024-05-04T02:20:18.023655+0000","last_clean":"2024-05-04T02:20:18.023655+0000","last_became_active":"2024-05-04T02:20:15.291704+0000","last_became_peered":"2024-05-04T02:20:15.291704+0000","last_unstale":"2024-05-04T02:20:18.023655+0000","last_undegraded":"2024-05-04T02:20:18.023655+0000","last_fullsized":"2024-05-04T02:20:18.023655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:52:22.299082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.976029+0000","last_change":"2024-05-04T02:20:14.359336+0000","last_active":"2024-05-04T02:20:17.976029+0000","last_peered":"2024-05-04T02:20:17.976029+0000","last_clean":"2024-05-04T02:20:17.976029+0000","last_became_active":"2024-05-04T02:20:14.357940+0000","last_became_peered":"2024-05-04T02:20:14.357940+0000","last_unstale":"2024-05-04T02:20:17.976029+0000","last_undegraded":"2024-05-04T02:20:17.976029+0000","last_fullsized":"2024-05-04T02:20:17.976029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:48:24.055870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546559+0000","last_change":"2024-05-04T02:20:15.301852+0000","last_active":"2024-05-04T02:20:18.546559+0000","last_peered":"2024-05-04T02:20:18.546559+0000","last_clean":"2024-05-04T02:20:18.546559+0000","last_became_active":"2024-05-04T02:20:15.300374+0000","last_became_peered":"2024-05-04T02:20:15.300374+0000","last_unstale":"2024-05-04T02:20:18.546559+0000","last_undegraded":"2024-05-04T02:20:18.546559+0000","last_fullsized":"2024-05-04T02:20:18.546559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:16:20.585860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546660+0000","last_change":"2024-05-04T02:20:14.358952+0000","last_active":"2024-05-04T02:20:18.546660+0000","last_peered":"2024-05-04T02:20:18.546660+0000","last_clean":"2024-05-04T02:20:18.546660+0000","last_became_active":"2024-05-04T02:20:14.358625+0000","last_became_peered":"2024-05-04T02:20:14.358625+0000","last_unstale":"2024-05-04T02:20:18.546660+0000","last_undegraded":"2024-05-04T02:20:18.546660+0000","last_fullsized":"2024-05-04T02:20:18.546660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:52:21.185127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.547067+0000","last_change":"2024-05-04T02:20:15.307242+0000","last_active":"2024-05-04T02:20:18.547067+0000","last_peered":"2024-05-04T02:20:18.547067+0000","last_clean":"2024-05-04T02:20:18.547067+0000","last_became_active":"2024-05-04T02:20:15.306572+0000","last_became_peered":"2024-05-04T02:20:15.306572+0000","last_unstale":"2024-05-04T02:20:18.547067+0000","last_undegraded":"2024-05-04T02:20:18.547067+0000","last_fullsized":"2024-05-04T02:20:18.547067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:31:36.578679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.023779+0000","last_change":"2024-05-04T02:20:14.292979+0000","last_active":"2024-05-04T02:20:18.023779+0000","last_peered":"2024-05-04T02:20:18.023779+0000","last_clean":"2024-05-04T02:20:18.023779+0000","last_became_active":"2024-05-04T02:20:14.292564+0000","last_became_peered":"2024-05-04T02:20:14.292564+0000","last_unstale":"2024-05-04T02:20:18.023779+0000","last_undegraded":"2024-05-04T02:20:18.023779+0000","last_fullsized":"2024-05-04T02:20:18.023779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:34:37.703735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.964726+0000","last_change":"2024-05-04T02:20:15.298392+0000","last_active":"2024-05-04T02:20:17.964726+0000","last_peered":"2024-05-04T02:20:17.964726+0000","last_clean":"2024-05-04T02:20:17.964726+0000","last_became_active":"2024-05-04T02:20:15.298018+0000","last_became_peered":"2024-05-04T02:20:15.298018+0000","last_unstale":"2024-05-04T02:20:17.964726+0000","last_undegraded":"2024-05-04T02:20:17.964726+0000","last_fullsized":"2024-05-04T02:20:17.964726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:42:57.398678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.975964+0000","last_change":"2024-05-04T02:20:14.360237+0000","last_active":"2024-05-04T02:20:17.975964+0000","last_peered":"2024-05-04T02:20:17.975964+0000","last_clean":"2024-05-04T02:20:17.975964+0000","last_became_active":"2024-05-04T02:20:14.359886+0000","last_became_peered":"2024-05-04T02:20:14.359886+0000","last_unstale":"2024-05-04T02:20:17.975964+0000","last_undegraded":"2024-05-04T02:20:17.975964+0000","last_fullsized":"2024-05-04T02:20:17.975964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:34:37.703735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.547226+0000","last_change":"2024-05-04T02:20:15.299908+0000","last_active":"2024-05-04T02:20:18.547226+0000","last_peered":"2024-05-04T02:20:18.547226+0000","last_clean":"2024-05-04T02:20:18.547226+0000","last_became_active":"2024-05-04T02:20:15.299336+0000","last_became_peered":"2024-05-04T02:20:15.299336+0000","last_unstale":"2024-05-04T02:20:18.547226+0000","last_undegraded":"2024-05-04T02:20:18.547226+0000","last_fullsized":"2024-05-04T02:20:18.547226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:36:19.111702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546789+0000","last_change":"2024-05-04T02:20:14.274932+0000","last_active":"2024-05-04T02:20:18.546789+0000","last_peered":"2024-05-04T02:20:18.546789+0000","last_clean":"2024-05-04T02:20:18.546789+0000","last_became_active":"2024-05-04T02:20:14.274604+0000","last_became_peered":"2024-05-04T02:20:14.274604+0000","last_unstale":"2024-05-04T02:20:18.546789+0000","last_undegraded":"2024-05-04T02:20:18.546789+0000","last_fullsized":"2024-05-04T02:20:18.546789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:35:43.182599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546447+0000","last_change":"2024-05-04T02:20:15.300355+0000","last_active":"2024-05-04T02:20:18.546447+0000","last_peered":"2024-05-04T02:20:18.546447+0000","last_clean":"2024-05-04T02:20:18.546447+0000","last_became_active":"2024-05-04T02:20:15.300052+0000","last_became_peered":"2024-05-04T02:20:15.300052+0000","last_unstale":"2024-05-04T02:20:18.546447+0000","last_undegraded":"2024-05-04T02:20:18.546447+0000","last_fullsized":"2024-05-04T02:20:18.546447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:06:27.072275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546935+0000","last_change":"2024-05-04T02:20:14.290125+0000","last_active":"2024-05-04T02:20:18.546935+0000","last_peered":"2024-05-04T02:20:18.546935+0000","last_clean":"2024-05-04T02:20:18.546935+0000","last_became_active":"2024-05-04T02:20:14.289826+0000","last_became_peered":"2024-05-04T02:20:14.289826+0000","last_unstale":"2024-05-04T02:20:18.546935+0000","last_undegraded":"2024-05-04T02:20:18.546935+0000","last_fullsized":"2024-05-04T02:20:18.546935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:39:23.112031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.547089+0000","last_change":"2024-05-04T02:20:15.303257+0000","last_active":"2024-05-04T02:20:18.547089+0000","last_peered":"2024-05-04T02:20:18.547089+0000","last_clean":"2024-05-04T02:20:18.547089+0000","last_became_active":"2024-05-04T02:20:15.302963+0000","last_became_peered":"2024-05-04T02:20:15.302963+0000","last_unstale":"2024-05-04T02:20:18.547089+0000","last_undegraded":"2024-05-04T02:20:18.547089+0000","last_fullsized":"2024-05-04T02:20:18.547089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:05:46.729556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.975686+0000","last_change":"2024-05-04T02:20:14.359226+0000","last_active":"2024-05-04T02:20:17.975686+0000","last_peered":"2024-05-04T02:20:17.975686+0000","last_clean":"2024-05-04T02:20:17.975686+0000","last_became_active":"2024-05-04T02:20:14.358494+0000","last_became_peered":"2024-05-04T02:20:14.358494+0000","last_unstale":"2024-05-04T02:20:17.975686+0000","last_undegraded":"2024-05-04T02:20:17.975686+0000","last_fullsized":"2024-05-04T02:20:17.975686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:43:19.283728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.975673+0000","last_change":"2024-05-04T02:20:15.294689+0000","last_active":"2024-05-04T02:20:17.975673+0000","last_peered":"2024-05-04T02:20:17.975673+0000","last_clean":"2024-05-04T02:20:17.975673+0000","last_became_active":"2024-05-04T02:20:15.294400+0000","last_became_peered":"2024-05-04T02:20:15.294400+0000","last_unstale":"2024-05-04T02:20:17.975673+0000","last_undegraded":"2024-05-04T02:20:17.975673+0000","last_fullsized":"2024-05-04T02:20:17.975673+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:22:33.019301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546431+0000","last_change":"2024-05-04T02:20:14.269539+0000","last_active":"2024-05-04T02:20:18.546431+0000","last_peered":"2024-05-04T02:20:18.546431+0000","last_clean":"2024-05-04T02:20:18.546431+0000","last_became_active":"2024-05-04T02:20:14.269238+0000","last_became_peered":"2024-05-04T02:20:14.269238+0000","last_unstale":"2024-05-04T02:20:18.546431+0000","last_undegraded":"2024-05-04T02:20:18.546431+0000","last_fullsized":"2024-05-04T02:20:18.546431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:19:48.082162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546599+0000","last_change":"2024-05-04T02:20:15.304355+0000","last_active":"2024-05-04T02:20:18.546599+0000","last_peered":"2024-05-04T02:20:18.546599+0000","last_clean":"2024-05-04T02:20:18.546599+0000","last_became_active":"2024-05-04T02:20:15.302736+0000","last_became_peered":"2024-05-04T02:20:15.302736+0000","last_unstale":"2024-05-04T02:20:18.546599+0000","last_undegraded":"2024-05-04T02:20:18.546599+0000","last_fullsized":"2024-05-04T02:20:18.546599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:35:15.732585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.964800+0000","last_change":"2024-05-04T02:20:14.272218+0000","last_active":"2024-05-04T02:20:17.964800+0000","last_peered":"2024-05-04T02:20:17.964800+0000","last_clean":"2024-05-04T02:20:17.964800+0000","last_became_active":"2024-05-04T02:20:14.271883+0000","last_became_peered":"2024-05-04T02:20:14.271883+0000","last_unstale":"2024-05-04T02:20:17.964800+0000","last_undegraded":"2024-05-04T02:20:17.964800+0000","last_fullsized":"2024-05-04T02:20:17.964800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:32:55.463882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.547349+0000","last_change":"2024-05-04T02:20:15.302202+0000","last_active":"2024-05-04T02:20:18.547349+0000","last_peered":"2024-05-04T02:20:18.547349+0000","last_clean":"2024-05-04T02:20:18.547349+0000","last_became_active":"2024-05-04T02:20:15.301880+0000","last_became_peered":"2024-05-04T02:20:15.301880+0000","last_unstale":"2024-05-04T02:20:18.547349+0000","last_undegraded":"2024-05-04T02:20:18.547349+0000","last_fullsized":"2024-05-04T02:20:18.547349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:32:43.559282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546821+0000","last_change":"2024-05-04T02:20:14.292107+0000","last_active":"2024-05-04T02:20:18.546821+0000","last_peered":"2024-05-04T02:20:18.546821+0000","last_clean":"2024-05-04T02:20:18.546821+0000","last_became_active":"2024-05-04T02:20:14.290132+0000","last_became_peered":"2024-05-04T02:20:14.290132+0000","last_unstale":"2024-05-04T02:20:18.546821+0000","last_undegraded":"2024-05-04T02:20:18.546821+0000","last_fullsized":"2024-05-04T02:20:18.546821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:40:35.516308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.547411+0000","last_change":"2024-05-04T02:20:15.302140+0000","last_active":"2024-05-04T02:20:18.547411+0000","last_peered":"2024-05-04T02:20:18.547411+0000","last_clean":"2024-05-04T02:20:18.547411+0000","last_became_active":"2024-05-04T02:20:15.301798+0000","last_became_peered":"2024-05-04T02:20:15.301798+0000","last_unstale":"2024-05-04T02:20:18.547411+0000","last_undegraded":"2024-05-04T02:20:18.547411+0000","last_fullsized":"2024-05-04T02:20:18.547411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:20:28.069809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.023816+0000","last_change":"2024-05-04T02:20:14.274965+0000","last_active":"2024-05-04T02:20:18.023816+0000","last_peered":"2024-05-04T02:20:18.023816+0000","last_clean":"2024-05-04T02:20:18.023816+0000","last_became_active":"2024-05-04T02:20:14.274609+0000","last_became_peered":"2024-05-04T02:20:14.274609+0000","last_unstale":"2024-05-04T02:20:18.023816+0000","last_undegraded":"2024-05-04T02:20:18.023816+0000","last_fullsized":"2024-05-04T02:20:18.023816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:43:19.283728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546618+0000","last_change":"2024-05-04T02:20:15.305486+0000","last_active":"2024-05-04T02:20:18.546618+0000","last_peered":"2024-05-04T02:20:18.546618+0000","last_clean":"2024-05-04T02:20:18.546618+0000","last_became_active":"2024-05-04T02:20:15.301880+0000","last_became_peered":"2024-05-04T02:20:15.301880+0000","last_unstale":"2024-05-04T02:20:18.546618+0000","last_undegraded":"2024-05-04T02:20:18.546618+0000","last_fullsized":"2024-05-04T02:20:18.546618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:13:25.600467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546688+0000","last_change":"2024-05-04T02:20:14.288834+0000","last_active":"2024-05-04T02:20:18.546688+0000","last_peered":"2024-05-04T02:20:18.546688+0000","last_clean":"2024-05-04T02:20:18.546688+0000","last_became_active":"2024-05-04T02:20:14.287992+0000","last_became_peered":"2024-05-04T02:20:14.287992+0000","last_unstale":"2024-05-04T02:20:18.546688+0000","last_undegraded":"2024-05-04T02:20:18.546688+0000","last_fullsized":"2024-05-04T02:20:18.546688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:39:08.143762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.547284+0000","last_change":"2024-05-04T02:20:15.303880+0000","last_active":"2024-05-04T02:20:18.547284+0000","last_peered":"2024-05-04T02:20:18.547284+0000","last_clean":"2024-05-04T02:20:18.547284+0000","last_became_active":"2024-05-04T02:20:15.303601+0000","last_became_peered":"2024-05-04T02:20:15.303601+0000","last_unstale":"2024-05-04T02:20:18.547284+0000","last_undegraded":"2024-05-04T02:20:18.547284+0000","last_fullsized":"2024-05-04T02:20:18.547284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:26:17.650165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":114,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546844+0000","last_change":"2024-05-04T02:20:02.920020+0000","last_active":"2024-05-04T02:20:18.546844+0000","last_peered":"2024-05-04T02:20:18.546844+0000","last_clean":"2024-05-04T02:20:18.546844+0000","last_became_active":"2024-05-04T02:20:02.918859+0000","last_became_peered":"2024-05-04T02:20:02.918859+0000","last_unstale":"2024-05-04T02:20:18.546844+0000","last_undegraded":"2024-05-04T02:20:18.546844+0000","last_fullsized":"2024-05-04T02:20:18.546844+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:00.162760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:00.162760+0000","last_clean_scrub_stamp":"2024-05-04T02:20:00.162760+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:25:04.934922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546389+0000","last_change":"2024-05-04T02:20:14.290136+0000","last_active":"2024-05-04T02:20:18.546389+0000","last_peered":"2024-05-04T02:20:18.546389+0000","last_clean":"2024-05-04T02:20:18.546389+0000","last_became_active":"2024-05-04T02:20:14.289597+0000","last_became_peered":"2024-05-04T02:20:14.289597+0000","last_unstale":"2024-05-04T02:20:18.546389+0000","last_undegraded":"2024-05-04T02:20:18.546389+0000","last_fullsized":"2024-05-04T02:20:18.546389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:43:19.283728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.963442+0000","last_change":"2024-05-04T02:20:15.306971+0000","last_active":"2024-05-04T02:20:17.963442+0000","last_peered":"2024-05-04T02:20:17.963442+0000","last_clean":"2024-05-04T02:20:17.963442+0000","last_became_active":"2024-05-04T02:20:15.306640+0000","last_became_peered":"2024-05-04T02:20:15.306640+0000","last_unstale":"2024-05-04T02:20:17.963442+0000","last_undegraded":"2024-05-04T02:20:17.963442+0000","last_fullsized":"2024-05-04T02:20:17.963442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:22:04.903746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546739+0000","last_change":"2024-05-04T02:20:14.291379+0000","last_active":"2024-05-04T02:20:18.546739+0000","last_peered":"2024-05-04T02:20:18.546739+0000","last_clean":"2024-05-04T02:20:18.546739+0000","last_became_active":"2024-05-04T02:20:14.291044+0000","last_became_peered":"2024-05-04T02:20:14.291044+0000","last_unstale":"2024-05-04T02:20:18.546739+0000","last_undegraded":"2024-05-04T02:20:18.546739+0000","last_fullsized":"2024-05-04T02:20:18.546739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:58:54.286093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546344+0000","last_change":"2024-05-04T02:20:15.305870+0000","last_active":"2024-05-04T02:20:18.546344+0000","last_peered":"2024-05-04T02:20:18.546344+0000","last_clean":"2024-05-04T02:20:18.546344+0000","last_became_active":"2024-05-04T02:20:15.305512+0000","last_became_peered":"2024-05-04T02:20:15.305512+0000","last_unstale":"2024-05-04T02:20:18.546344+0000","last_undegraded":"2024-05-04T02:20:18.546344+0000","last_fullsized":"2024-05-04T02:20:18.546344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:11:17.529449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546641+0000","last_change":"2024-05-04T02:20:14.287676+0000","last_active":"2024-05-04T02:20:18.546641+0000","last_peered":"2024-05-04T02:20:18.546641+0000","last_clean":"2024-05-04T02:20:18.546641+0000","last_became_active":"2024-05-04T02:20:14.287335+0000","last_became_peered":"2024-05-04T02:20:14.287335+0000","last_unstale":"2024-05-04T02:20:18.546641+0000","last_undegraded":"2024-05-04T02:20:18.546641+0000","last_fullsized":"2024-05-04T02:20:18.546641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:54:20.482900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.023390+0000","last_change":"2024-05-04T02:20:15.297316+0000","last_active":"2024-05-04T02:20:18.023390+0000","last_peered":"2024-05-04T02:20:18.023390+0000","last_clean":"2024-05-04T02:20:18.023390+0000","last_became_active":"2024-05-04T02:20:15.297010+0000","last_became_peered":"2024-05-04T02:20:15.297010+0000","last_unstale":"2024-05-04T02:20:18.023390+0000","last_undegraded":"2024-05-04T02:20:18.023390+0000","last_fullsized":"2024-05-04T02:20:18.023390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:22:33.019301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.547029+0000","last_change":"2024-05-04T02:20:14.292802+0000","last_active":"2024-05-04T02:20:18.547029+0000","last_peered":"2024-05-04T02:20:18.547029+0000","last_clean":"2024-05-04T02:20:18.547029+0000","last_became_active":"2024-05-04T02:20:14.292595+0000","last_became_peered":"2024-05-04T02:20:14.292595+0000","last_unstale":"2024-05-04T02:20:18.547029+0000","last_undegraded":"2024-05-04T02:20:18.547029+0000","last_fullsized":"2024-05-04T02:20:18.547029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:31:25.521717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.964423+0000","last_change":"2024-05-04T02:20:15.296358+0000","last_active":"2024-05-04T02:20:17.964423+0000","last_peered":"2024-05-04T02:20:17.964423+0000","last_clean":"2024-05-04T02:20:17.964423+0000","last_became_active":"2024-05-04T02:20:15.296075+0000","last_became_peered":"2024-05-04T02:20:15.296075+0000","last_unstale":"2024-05-04T02:20:17.964423+0000","last_undegraded":"2024-05-04T02:20:17.964423+0000","last_fullsized":"2024-05-04T02:20:17.964423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:30:50.014584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.023655+0000","last_change":"2024-05-04T02:20:14.253846+0000","last_active":"2024-05-04T02:20:18.023655+0000","last_peered":"2024-05-04T02:20:18.023655+0000","last_clean":"2024-05-04T02:20:18.023655+0000","last_became_active":"2024-05-04T02:20:14.253513+0000","last_became_peered":"2024-05-04T02:20:14.253513+0000","last_unstale":"2024-05-04T02:20:18.023655+0000","last_undegraded":"2024-05-04T02:20:18.023655+0000","last_fullsized":"2024-05-04T02:20:18.023655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:40:36.439339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546859+0000","last_change":"2024-05-04T02:20:15.300702+0000","last_active":"2024-05-04T02:20:18.546859+0000","last_peered":"2024-05-04T02:20:18.546859+0000","last_clean":"2024-05-04T02:20:18.546859+0000","last_became_active":"2024-05-04T02:20:15.300251+0000","last_became_peered":"2024-05-04T02:20:15.300251+0000","last_unstale":"2024-05-04T02:20:18.546859+0000","last_undegraded":"2024-05-04T02:20:18.546859+0000","last_fullsized":"2024-05-04T02:20:18.546859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:05:46.729556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.547456+0000","last_change":"2024-05-04T02:20:14.291304+0000","last_active":"2024-05-04T02:20:18.547456+0000","last_peered":"2024-05-04T02:20:18.547456+0000","last_clean":"2024-05-04T02:20:18.547456+0000","last_became_active":"2024-05-04T02:20:14.290952+0000","last_became_peered":"2024-05-04T02:20:14.290952+0000","last_unstale":"2024-05-04T02:20:18.547456+0000","last_undegraded":"2024-05-04T02:20:18.547456+0000","last_fullsized":"2024-05-04T02:20:18.547456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:15:55.478496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.023562+0000","last_change":"2024-05-04T02:20:15.296895+0000","last_active":"2024-05-04T02:20:18.023562+0000","last_peered":"2024-05-04T02:20:18.023562+0000","last_clean":"2024-05-04T02:20:18.023562+0000","last_became_active":"2024-05-04T02:20:15.296562+0000","last_became_peered":"2024-05-04T02:20:15.296562+0000","last_unstale":"2024-05-04T02:20:18.023562+0000","last_undegraded":"2024-05-04T02:20:18.023562+0000","last_fullsized":"2024-05-04T02:20:18.023562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:22:04.903746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.024002+0000","last_change":"2024-05-04T02:20:14.358920+0000","last_active":"2024-05-04T02:20:18.024002+0000","last_peered":"2024-05-04T02:20:18.024002+0000","last_clean":"2024-05-04T02:20:18.024002+0000","last_became_active":"2024-05-04T02:20:14.358621+0000","last_became_peered":"2024-05-04T02:20:14.358621+0000","last_unstale":"2024-05-04T02:20:18.024002+0000","last_undegraded":"2024-05-04T02:20:18.024002+0000","last_fullsized":"2024-05-04T02:20:18.024002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:57:10.542857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.963661+0000","last_change":"2024-05-04T02:20:15.299992+0000","last_active":"2024-05-04T02:20:17.963661+0000","last_peered":"2024-05-04T02:20:17.963661+0000","last_clean":"2024-05-04T02:20:17.963661+0000","last_became_active":"2024-05-04T02:20:15.299678+0000","last_became_peered":"2024-05-04T02:20:15.299678+0000","last_unstale":"2024-05-04T02:20:17.963661+0000","last_undegraded":"2024-05-04T02:20:17.963661+0000","last_fullsized":"2024-05-04T02:20:17.963661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:39:43.029499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.976082+0000","last_change":"2024-05-04T02:20:14.359479+0000","last_active":"2024-05-04T02:20:17.976082+0000","last_peered":"2024-05-04T02:20:17.976082+0000","last_clean":"2024-05-04T02:20:17.976082+0000","last_became_active":"2024-05-04T02:20:14.358524+0000","last_became_peered":"2024-05-04T02:20:14.358524+0000","last_unstale":"2024-05-04T02:20:17.976082+0000","last_undegraded":"2024-05-04T02:20:17.976082+0000","last_fullsized":"2024-05-04T02:20:17.976082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:40:36.439339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.547004+0000","last_change":"2024-05-04T02:20:15.293908+0000","last_active":"2024-05-04T02:20:18.547004+0000","last_peered":"2024-05-04T02:20:18.547004+0000","last_clean":"2024-05-04T02:20:18.547004+0000","last_became_active":"2024-05-04T02:20:15.293602+0000","last_became_peered":"2024-05-04T02:20:15.293602+0000","last_unstale":"2024-05-04T02:20:18.547004+0000","last_undegraded":"2024-05-04T02:20:18.547004+0000","last_fullsized":"2024-05-04T02:20:18.547004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:18:03.065030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546622+0000","last_change":"2024-05-04T02:20:14.291515+0000","last_active":"2024-05-04T02:20:18.546622+0000","last_peered":"2024-05-04T02:20:18.546622+0000","last_clean":"2024-05-04T02:20:18.546622+0000","last_became_active":"2024-05-04T02:20:14.291068+0000","last_became_peered":"2024-05-04T02:20:14.291068+0000","last_unstale":"2024-05-04T02:20:18.546622+0000","last_undegraded":"2024-05-04T02:20:18.546622+0000","last_fullsized":"2024-05-04T02:20:18.546622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:57:10.542857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.964360+0000","last_change":"2024-05-04T02:20:15.247885+0000","last_active":"2024-05-04T02:20:17.964360+0000","last_peered":"2024-05-04T02:20:17.964360+0000","last_clean":"2024-05-04T02:20:17.964360+0000","last_became_active":"2024-05-04T02:20:15.247583+0000","last_became_peered":"2024-05-04T02:20:15.247583+0000","last_unstale":"2024-05-04T02:20:17.964360+0000","last_undegraded":"2024-05-04T02:20:17.964360+0000","last_fullsized":"2024-05-04T02:20:17.964360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:39:16.967443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.023555+0000","last_change":"2024-05-04T02:20:14.289690+0000","last_active":"2024-05-04T02:20:18.023555+0000","last_peered":"2024-05-04T02:20:18.023555+0000","last_clean":"2024-05-04T02:20:18.023555+0000","last_became_active":"2024-05-04T02:20:14.289360+0000","last_became_peered":"2024-05-04T02:20:14.289360+0000","last_unstale":"2024-05-04T02:20:18.023555+0000","last_undegraded":"2024-05-04T02:20:18.023555+0000","last_fullsized":"2024-05-04T02:20:18.023555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:57:26.889464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.963256+0000","last_change":"2024-05-04T02:20:15.296623+0000","last_active":"2024-05-04T02:20:17.963256+0000","last_peered":"2024-05-04T02:20:17.963256+0000","last_clean":"2024-05-04T02:20:17.963256+0000","last_became_active":"2024-05-04T02:20:15.296330+0000","last_became_peered":"2024-05-04T02:20:15.296330+0000","last_unstale":"2024-05-04T02:20:17.963256+0000","last_undegraded":"2024-05-04T02:20:17.963256+0000","last_fullsized":"2024-05-04T02:20:17.963256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:39:18.114604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.023764+0000","last_change":"2024-05-04T02:20:14.289113+0000","last_active":"2024-05-04T02:20:18.023764+0000","last_peered":"2024-05-04T02:20:18.023764+0000","last_clean":"2024-05-04T02:20:18.023764+0000","last_became_active":"2024-05-04T02:20:14.288769+0000","last_became_peered":"2024-05-04T02:20:14.288769+0000","last_unstale":"2024-05-04T02:20:18.023764+0000","last_undegraded":"2024-05-04T02:20:18.023764+0000","last_fullsized":"2024-05-04T02:20:18.023764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:48:24.055870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.963379+0000","last_change":"2024-05-04T02:20:15.295428+0000","last_active":"2024-05-04T02:20:17.963379+0000","last_peered":"2024-05-04T02:20:17.963379+0000","last_clean":"2024-05-04T02:20:17.963379+0000","last_became_active":"2024-05-04T02:20:15.295128+0000","last_became_peered":"2024-05-04T02:20:15.295128+0000","last_unstale":"2024-05-04T02:20:17.963379+0000","last_undegraded":"2024-05-04T02:20:17.963379+0000","last_fullsized":"2024-05-04T02:20:17.963379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:10:21.048301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.547224+0000","last_change":"2024-05-04T02:20:14.294321+0000","last_active":"2024-05-04T02:20:18.547224+0000","last_peered":"2024-05-04T02:20:18.547224+0000","last_clean":"2024-05-04T02:20:18.547224+0000","last_became_active":"2024-05-04T02:20:14.293862+0000","last_became_peered":"2024-05-04T02:20:14.293862+0000","last_unstale":"2024-05-04T02:20:18.547224+0000","last_undegraded":"2024-05-04T02:20:18.547224+0000","last_fullsized":"2024-05-04T02:20:18.547224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:39:17.000649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.975812+0000","last_change":"2024-05-04T02:20:15.296883+0000","last_active":"2024-05-04T02:20:17.975812+0000","last_peered":"2024-05-04T02:20:17.975812+0000","last_clean":"2024-05-04T02:20:17.975812+0000","last_became_active":"2024-05-04T02:20:15.296544+0000","last_became_peered":"2024-05-04T02:20:15.296544+0000","last_unstale":"2024-05-04T02:20:17.975812+0000","last_undegraded":"2024-05-04T02:20:17.975812+0000","last_fullsized":"2024-05-04T02:20:17.975812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:52:22.299082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546509+0000","last_change":"2024-05-04T02:20:15.306263+0000","last_active":"2024-05-04T02:20:18.546509+0000","last_peered":"2024-05-04T02:20:18.546509+0000","last_clean":"2024-05-04T02:20:18.546509+0000","last_became_active":"2024-05-04T02:20:15.305941+0000","last_became_peered":"2024-05-04T02:20:15.305941+0000","last_unstale":"2024-05-04T02:20:18.546509+0000","last_undegraded":"2024-05-04T02:20:18.546509+0000","last_fullsized":"2024-05-04T02:20:18.546509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:33:31.416768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.547164+0000","last_change":"2024-05-04T02:20:14.294204+0000","last_active":"2024-05-04T02:20:18.547164+0000","last_peered":"2024-05-04T02:20:18.547164+0000","last_clean":"2024-05-04T02:20:18.547164+0000","last_became_active":"2024-05-04T02:20:14.293788+0000","last_became_peered":"2024-05-04T02:20:14.293788+0000","last_unstale":"2024-05-04T02:20:18.547164+0000","last_undegraded":"2024-05-04T02:20:18.547164+0000","last_fullsized":"2024-05-04T02:20:18.547164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:52:21.185127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546530+0000","last_change":"2024-05-04T02:20:15.306357+0000","last_active":"2024-05-04T02:20:18.546530+0000","last_peered":"2024-05-04T02:20:18.546530+0000","last_clean":"2024-05-04T02:20:18.546530+0000","last_became_active":"2024-05-04T02:20:15.306050+0000","last_became_peered":"2024-05-04T02:20:15.306050+0000","last_unstale":"2024-05-04T02:20:18.546530+0000","last_undegraded":"2024-05-04T02:20:18.546530+0000","last_fullsized":"2024-05-04T02:20:18.546530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:39:18.114604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.547329+0000","last_change":"2024-05-04T02:20:14.357677+0000","last_active":"2024-05-04T02:20:18.547329+0000","last_peered":"2024-05-04T02:20:18.547329+0000","last_clean":"2024-05-04T02:20:18.547329+0000","last_became_active":"2024-05-04T02:20:14.357368+0000","last_became_peered":"2024-05-04T02:20:14.357368+0000","last_unstale":"2024-05-04T02:20:18.547329+0000","last_undegraded":"2024-05-04T02:20:18.547329+0000","last_fullsized":"2024-05-04T02:20:18.547329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:10:19.934346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546966+0000","last_change":"2024-05-04T02:20:15.307496+0000","last_active":"2024-05-04T02:20:18.546966+0000","last_peered":"2024-05-04T02:20:18.546966+0000","last_clean":"2024-05-04T02:20:18.546966+0000","last_became_active":"2024-05-04T02:20:15.306956+0000","last_became_peered":"2024-05-04T02:20:15.306956+0000","last_unstale":"2024-05-04T02:20:18.546966+0000","last_undegraded":"2024-05-04T02:20:18.546966+0000","last_fullsized":"2024-05-04T02:20:18.546966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:19:48.110866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.963458+0000","last_change":"2024-05-04T02:20:14.291632+0000","last_active":"2024-05-04T02:20:17.963458+0000","last_peered":"2024-05-04T02:20:17.963458+0000","last_clean":"2024-05-04T02:20:17.963458+0000","last_became_active":"2024-05-04T02:20:14.291331+0000","last_became_peered":"2024-05-04T02:20:14.291331+0000","last_unstale":"2024-05-04T02:20:17.963458+0000","last_undegraded":"2024-05-04T02:20:17.963458+0000","last_fullsized":"2024-05-04T02:20:17.963458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:22:31.905346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.963350+0000","last_change":"2024-05-04T02:20:15.294309+0000","last_active":"2024-05-04T02:20:17.963350+0000","last_peered":"2024-05-04T02:20:17.963350+0000","last_clean":"2024-05-04T02:20:17.963350+0000","last_became_active":"2024-05-04T02:20:15.294026+0000","last_became_peered":"2024-05-04T02:20:15.294026+0000","last_unstale":"2024-05-04T02:20:17.963350+0000","last_undegraded":"2024-05-04T02:20:17.963350+0000","last_fullsized":"2024-05-04T02:20:17.963350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:39:24.225985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.547102+0000","last_change":"2024-05-04T02:20:14.291633+0000","last_active":"2024-05-04T02:20:18.547102+0000","last_peered":"2024-05-04T02:20:18.547102+0000","last_clean":"2024-05-04T02:20:18.547102+0000","last_became_active":"2024-05-04T02:20:14.291313+0000","last_became_peered":"2024-05-04T02:20:14.291313+0000","last_unstale":"2024-05-04T02:20:18.547102+0000","last_undegraded":"2024-05-04T02:20:18.547102+0000","last_fullsized":"2024-05-04T02:20:18.547102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:48:36.710163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65100,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":303104,"data_stored":675478,"data_compressed":32550,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":245760,"data_stored":86140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509448,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":237568,"data_stored":84618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":245760,"data_stored":86140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509448,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":233472,"data_stored":84528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31420,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340420,"statfs":{"total":96636764160,"available":96604590080,"internally_reserved":0,"allocated":241664,"data_stored":84688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542152,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":245760,"data_stored":84654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31476,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340364,"statfs":{"total":96636764160,"available":96604532736,"internally_reserved":0,"allocated":299008,"data_stored":669625,"data_compressed":32550,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32550,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32550,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-04T02:20:24.581 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-04T02:20:24.581 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-04T02:20:24.582 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-05-04T02:20:24.582 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-05-04T02:20:24.582 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-05-04T02:20:24.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.728+0000 7f37f0972640 1 Processor -- start 2024-05-04T02:20:24.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.728+0000 7f37f0972640 1 -- start start 2024-05-04T02:20:24.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.729+0000 7f37f0972640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f37ec156b40 0x7f37ec0c7240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:24.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.729+0000 7f37f0972640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f37ec0cd480 0x7f37ec1607a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:24.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.729+0000 7f37f0972640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f37ec0b60c0 0x7f37ec0b64d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:24.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.729+0000 7f37f0972640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f37ec160310 con 0x7f37ec0cd480 2024-05-04T02:20:24.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.729+0000 7f37f0972640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f37ec15fd00 con 0x7f37ec156b40 2024-05-04T02:20:24.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.729+0000 7f37f0972640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f37ec0c68a0 con 0x7f37ec0b60c0 2024-05-04T02:20:24.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.730+0000 7f37e9d9b640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f37ec0cd480 0x7f37ec1607a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:24.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.730+0000 7f37ead9d640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f37ec0b60c0 0x7f37ec0b64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:24.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.730+0000 7f37ea59c640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f37ec156b40 0x7f37ec0c7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:24.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.730+0000 7f37e9d9b640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f37ec0cd480 0x7f37ec1607a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41366/0 (socket says 172.21.15.1:41366) 2024-05-04T02:20:24.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.730+0000 7f37e9d9b640 1 -- 172.21.15.1:0/3606144479 learned_addr learned my addr 172.21.15.1:0/3606144479 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:24.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.733+0000 7f37e9d9b640 1 -- 172.21.15.1:0/3606144479 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f37ec0b60c0 msgr2=0x7f37ec0b64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:24.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.733+0000 7f37e9d9b640 1 --2- 172.21.15.1:0/3606144479 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f37ec0b60c0 0x7f37ec0b64d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:24.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.733+0000 7f37e9d9b640 1 -- 172.21.15.1:0/3606144479 >> v2:172.21.15.107:3300/0 conn(0x7f37ec156b40 msgr2=0x7f37ec0c7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:24.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.733+0000 7f37e9d9b640 1 --2- 172.21.15.1:0/3606144479 >> v2:172.21.15.107:3300/0 conn(0x7f37ec156b40 0x7f37ec0c7240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:24.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.733+0000 7f37e9d9b640 1 -- 172.21.15.1:0/3606144479 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37ec15ffa0 con 0x7f37ec0cd480 2024-05-04T02:20:24.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.733+0000 7f37ead9d640 1 --2- 172.21.15.1:0/3606144479 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f37ec0b60c0 0x7f37ec0b64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-04T02:20:24.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.735+0000 7f37e9d9b640 1 --2- 172.21.15.1:0/3606144479 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f37ec0cd480 0x7f37ec1607a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f37ec0cc900 tx=0x7f37dc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5331d9e88f1725f server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:24.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.742+0000 7f37e959a640 1 -- 172.21.15.1:0/3606144479 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37dc037070 con 0x7f37ec0cd480 2024-05-04T02:20:24.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.742+0000 7f37e959a640 1 -- 172.21.15.1:0/3606144479 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37dc032440 con 0x7f37ec0cd480 2024-05-04T02:20:24.744 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.742+0000 7f37e959a640 1 -- 172.21.15.1:0/3606144479 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37dc032810 con 0x7f37ec0cd480 2024-05-04T02:20:24.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.742+0000 7f37f0972640 1 -- 172.21.15.1:0/3606144479 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f37ec0cd480 msgr2=0x7f37ec1607a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:24.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.742+0000 7f37f0972640 1 --2- 172.21.15.1:0/3606144479 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f37ec0cd480 0x7f37ec1607a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f37ec0cc900 tx=0x7f37dc02a1e0 comp rx=0 tx=0).stop 2024-05-04T02:20:24.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.743+0000 7f37f0972640 1 -- 172.21.15.1:0/3606144479 shutdown_connections 2024-05-04T02:20:24.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.743+0000 7f37f0972640 1 --2- 172.21.15.1:0/3606144479 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f37ec0b60c0 0x7f37ec0b64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:24.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.743+0000 7f37f0972640 1 --2- 172.21.15.1:0/3606144479 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f37ec0cd480 0x7f37ec1607a0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:24.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.743+0000 7f37f0972640 1 --2- 172.21.15.1:0/3606144479 >> v2:172.21.15.107:3300/0 conn(0x7f37ec156b40 0x7f37ec0c7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:24.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.743+0000 7f37f0972640 1 -- 172.21.15.1:0/3606144479 >> 172.21.15.1:0/3606144479 conn(0x7f37ec0ce560 msgr2=0x7f37ec0ce970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:24.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.743+0000 7f37f0972640 1 -- 172.21.15.1:0/3606144479 shutdown_connections 2024-05-04T02:20:24.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.743+0000 7f37f0972640 1 -- 172.21.15.1:0/3606144479 wait complete. 2024-05-04T02:20:24.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.745+0000 7f37f0972640 1 Processor -- start 2024-05-04T02:20:24.747 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.745+0000 7f37f0972640 1 -- start start 2024-05-04T02:20:24.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.746+0000 7f37f0972640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f37ec0b60c0 0x7f37ec1f2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:24.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.746+0000 7f37f0972640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f37ec0cd480 0x7f37ec157200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:24.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.746+0000 7f37f0972640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f37ec156b40 0x7f37ec154320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:24.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.746+0000 7f37f0972640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f37ec0b4a20 con 0x7f37ec0cd480 2024-05-04T02:20:24.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.746+0000 7f37f0972640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f37ec0b46e0 con 0x7f37ec156b40 2024-05-04T02:20:24.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.746+0000 7f37f0972640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f37ec0b4ba0 con 0x7f37ec0b60c0 2024-05-04T02:20:24.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.747+0000 7f37e9d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f37ec0cd480 0x7f37ec157200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:24.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.747+0000 7f37ea59c640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f37ec0b60c0 0x7f37ec1f2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:24.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.747+0000 7f37ead9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f37ec156b40 0x7f37ec154320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:24.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.747+0000 7f37e9d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f37ec0cd480 0x7f37ec157200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41374/0 (socket says 172.21.15.1:41374) 2024-05-04T02:20:24.750 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.747+0000 7f37e9d9b640 1 -- 172.21.15.1:0/3537760230 learned_addr learned my addr 172.21.15.1:0/3537760230 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:24.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.751+0000 7f37ea59c640 1 -- 172.21.15.1:0/3537760230 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f37ec156b40 msgr2=0x7f37ec154320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:24.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.751+0000 7f37ea59c640 1 --2- 172.21.15.1:0/3537760230 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f37ec156b40 0x7f37ec154320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:24.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.751+0000 7f37ea59c640 1 -- 172.21.15.1:0/3537760230 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f37ec0cd480 msgr2=0x7f37ec157200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:24.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.751+0000 7f37ea59c640 1 --2- 172.21.15.1:0/3537760230 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f37ec0cd480 0x7f37ec157200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:24.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.751+0000 7f37ea59c640 1 -- 172.21.15.1:0/3537760230 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37ec1f3320 con 0x7f37ec0b60c0 2024-05-04T02:20:24.755 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.753+0000 7f37ea59c640 1 --2- 172.21.15.1:0/3537760230 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f37ec0b60c0 0x7f37ec1f2de0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f37d400e870 tx=0x7f37d400ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:24.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.758+0000 7f37e2ffd640 1 -- 172.21.15.1:0/3537760230 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d4017070 con 0x7f37ec0b60c0 2024-05-04T02:20:24.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.758+0000 7f37e2ffd640 1 -- 172.21.15.1:0/3537760230 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37d400c6d0 con 0x7f37ec0b60c0 2024-05-04T02:20:24.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.758+0000 7f37e2ffd640 1 -- 172.21.15.1:0/3537760230 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d400caa0 con 0x7f37ec0b60c0 2024-05-04T02:20:24.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.758+0000 7f37f0972640 1 -- 172.21.15.1:0/3537760230 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37ec1f6330 con 0x7f37ec0b60c0 2024-05-04T02:20:24.760 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.758+0000 7f37f0972640 1 -- 172.21.15.1:0/3537760230 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f37ec1f68f0 con 0x7f37ec0b60c0 2024-05-04T02:20:24.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:24.759+0000 7f37f0972640 1 -- 172.21.15.1:0/3537760230 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37ec069bc0 con 0x7f37ec0b60c0 2024-05-04T02:20:25.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:25.045+0000 7f37e2ffd640 1 -- 172.21.15.1:0/3537760230 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f37d401a070 con 0x7f37ec0b60c0 2024-05-04T02:20:25.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:25.045+0000 7f37e2ffd640 1 --2- 172.21.15.1:0/3537760230 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f37cc076300 0x7f37cc078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:25.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:25.045+0000 7f37e2ffd640 1 -- 172.21.15.1:0/3537760230 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f37d405cff0 con 0x7f37ec0b60c0 2024-05-04T02:20:25.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:25.045+0000 7f37e9d9b640 1 --2- 172.21.15.1:0/3537760230 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f37cc076300 0x7f37cc078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:25.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:25.046+0000 7f37e9d9b640 1 --2- 172.21.15.1:0/3537760230 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f37cc076300 0x7f37cc078810 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f37dc02a220 tx=0x7f37dc02e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:25.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:25.056+0000 7f37e2ffd640 1 -- 172.21.15.1:0/3537760230 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f37d4060d60 con 0x7f37ec0b60c0 2024-05-04T02:20:25.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:25.306+0000 7f37f0972640 1 -- 172.21.15.1:0/3537760230 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f37ec0cdd70 con 0x7f37ec0b60c0 2024-05-04T02:20:25.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:25.460+0000 7f37e2ffd640 1 -- 172.21.15.1:0/3537760230 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+189528 (secure 0 0 0) 0x7f37d4065060 con 0x7f37ec0b60c0 2024-05-04T02:20:25.465 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:20:25.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:25.463+0000 7f37f0972640 1 -- 172.21.15.1:0/3537760230 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f37cc076300 msgr2=0x7f37cc078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:25.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:25.463+0000 7f37f0972640 1 --2- 172.21.15.1:0/3537760230 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f37cc076300 0x7f37cc078810 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f37dc02a220 tx=0x7f37dc02e000 comp rx=0 tx=0).stop 2024-05-04T02:20:25.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:25.463+0000 7f37f0972640 1 -- 172.21.15.1:0/3537760230 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f37ec0b60c0 msgr2=0x7f37ec1f2de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:25.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:25.463+0000 7f37f0972640 1 --2- 172.21.15.1:0/3537760230 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f37ec0b60c0 0x7f37ec1f2de0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f37d400e870 tx=0x7f37d400ec70 comp rx=0 tx=0).stop 2024-05-04T02:20:25.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:25.464+0000 7f37f0972640 1 -- 172.21.15.1:0/3537760230 shutdown_connections 2024-05-04T02:20:25.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:25.464+0000 7f37f0972640 1 --2- 172.21.15.1:0/3537760230 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f37cc076300 0x7f37cc078810 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:25.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:25.464+0000 7f37f0972640 1 --2- 172.21.15.1:0/3537760230 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f37ec156b40 0x7f37ec154320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:25.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:25.464+0000 7f37f0972640 1 --2- 172.21.15.1:0/3537760230 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f37ec0cd480 0x7f37ec157200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:25.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:25.464+0000 7f37f0972640 1 --2- 172.21.15.1:0/3537760230 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f37ec0b60c0 0x7f37ec1f2de0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:25.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:25.464+0000 7f37f0972640 1 -- 172.21.15.1:0/3537760230 >> 172.21.15.1:0/3537760230 conn(0x7f37ec0ce560 msgr2=0x7f37ec155e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:25.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:25.464+0000 7f37f0972640 1 -- 172.21.15.1:0/3537760230 shutdown_connections 2024-05-04T02:20:25.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:25.464+0000 7f37f0972640 1 -- 172.21.15.1:0/3537760230 wait complete. 2024-05-04T02:20:25.478 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":5,"flags":0,"active_gid":4108,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":3809222574},{"type":"v1","addr":"172.21.15.107:6801","nonce":3809222574}]},"active_addr":"172.21.15.107:6801/3809222574","active_change":"2024-05-04T02:19:50.740938+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4105,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.107:0","nonce":2572819124}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.107:0","nonce":1623500648}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.107:0","nonce":3383258073}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.107:0","nonce":3259096576}]}]} 2024-05-04T02:20:25.482 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-05-04T02:20:25.482 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-05-04T02:20:25.482 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-04T02:20:25.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:25.592+0000 7fda2f7f2640 1 Processor -- start 2024-05-04T02:20:25.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:25.592+0000 7fda2f7f2640 1 -- start start 2024-05-04T02:20:25.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:25.593+0000 7fda2f7f2640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fda28165e00 0x7fda28168220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:25.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:25.593+0000 7fda2f7f2640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda280c69e0 con 0x7fda280cdc20 2024-05-04T02:20:25.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:25.593+0000 7fda2f7f2640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda28160740 con 0x7fda280c6f70 2024-05-04T02:20:25.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:25.593+0000 7fda2f7f2640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7fda28160a20 con 0x7fda28165e00 2024-05-04T02:20:25.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:25.594+0000 7fda2dd8f640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fda28165e00 0x7fda28168220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:25.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:25.594+0000 7fda2cd8d640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fda280c6f70 0x7fda280ccea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.1:54714/0 (socket says 172.21.15.1:54714) 2024-05-04T02:20:25.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:25.594+0000 7fda2cd8d640 1 -- 172.21.15.1:0/2318889955 learned_addr learned my addr 172.21.15.1:0/2318889955 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-05-04T02:20:25.599 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:25.597+0000 7fda1ffff640 1 -- 172.21.15.1:0/2318889955 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2780199973 0 0) 0x7fda28160740 con 0x7fda280c6f70 2024-05-04T02:20:25.599 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:25.597+0000 7fda1ffff640 1 -- 172.21.15.1:0/2318889955 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda14003520 con 0x7fda280c6f70 2024-05-04T02:20:25.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:25.598+0000 7fda2dd8f640 1 -- 172.21.15.1:0/2318889955 >> v1:172.21.15.107:6789/0 conn(0x7fda280c6f70 legacy=0x7fda280ccea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:25.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:25.598+0000 7fda2dd8f640 1 -- 172.21.15.1:0/2318889955 >> v1:172.21.15.1:6789/0 conn(0x7fda280cdc20 legacy=0x7fda2806c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:25.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:25.598+0000 7fda2dd8f640 1 -- 172.21.15.1:0/2318889955 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda280c77f0 con 0x7fda28165e00 2024-05-04T02:20:25.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:25.602+0000 7fda2dd8f640 1 --2- 172.21.15.1:0/2318889955 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fda28165e00 0x7fda28168220 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fda20009d90 tx=0x7fda2002a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28dd150771ab97e2 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:25.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:25.607+0000 7fda1ffff640 1 -- 172.21.15.1:0/2318889955 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda20037070 con 0x7fda28165e00 2024-05-04T02:20:25.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:25.607+0000 7fda1ffff640 1 -- 172.21.15.1:0/2318889955 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda20007740 con 0x7fda28165e00 2024-05-04T02:20:25.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:25.607+0000 7fda1ffff640 1 -- 172.21.15.1:0/2318889955 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda20007b10 con 0x7fda28165e00 2024-05-04T02:20:25.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:25.607+0000 7fda2f7f2640 1 -- 172.21.15.1:0/2318889955 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fda28165e00 msgr2=0x7fda28168220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:25.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:25.607+0000 7fda2f7f2640 1 --2- 172.21.15.1:0/2318889955 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fda28165e00 0x7fda28168220 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fda20009d90 tx=0x7fda2002a780 comp rx=0 tx=0).stop 2024-05-04T02:20:25.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:25.608+0000 7fda2f7f2640 1 -- 172.21.15.1:0/2318889955 shutdown_connections 2024-05-04T02:20:25.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:25.608+0000 7fda2f7f2640 1 --2- 172.21.15.1:0/2318889955 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fda28165e00 0x7fda28168220 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:25.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:25.608+0000 7fda2f7f2640 1 -- 172.21.15.1:0/2318889955 >> 172.21.15.1:0/2318889955 conn(0x7fda2808e210 msgr2=0x7fda280d1960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:25.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:25.608+0000 7fda2f7f2640 1 -- 172.21.15.1:0/2318889955 shutdown_connections 2024-05-04T02:20:25.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:25.608+0000 7fda2f7f2640 1 -- 172.21.15.1:0/2318889955 wait complete. 2024-05-04T02:20:25.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:25.609+0000 7fda2f7f2640 1 Processor -- start 2024-05-04T02:20:25.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:25.609+0000 7fda2f7f2640 1 -- start start 2024-05-04T02:20:25.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:25.611+0000 7fda2f7f2640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fda280c6f70 0x7fda2814fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:25.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:25.611+0000 7fda2f7f2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fda280cdc20 0x7fda2815f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:25.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:25.611+0000 7fda2f7f2640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda28165e00 0x7fda281f2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:25.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:25.611+0000 7fda2f7f2640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fda280c8090 con 0x7fda280cdc20 2024-05-04T02:20:25.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:25.611+0000 7fda2f7f2640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fda280c7db0 con 0x7fda28165e00 2024-05-04T02:20:25.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:25.611+0000 7fda2f7f2640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fda28160450 con 0x7fda280c6f70 2024-05-04T02:20:25.613 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:25.611+0000 7fda2cd8d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fda280cdc20 0x7fda2815f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:25.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:25.611+0000 7fda2dd8f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda28165e00 0x7fda281f2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:25.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:25.611+0000 7fda2cd8d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fda280cdc20 0x7fda2815f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41400/0 (socket says 172.21.15.1:41400) 2024-05-04T02:20:25.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:25.611+0000 7fda2cd8d640 1 -- 172.21.15.1:0/3206012592 learned_addr learned my addr 172.21.15.1:0/3206012592 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:25.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:25.611+0000 7fda2d58e640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fda280c6f70 0x7fda2814fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:25.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:25.615+0000 7fda2cd8d640 1 -- 172.21.15.1:0/3206012592 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fda280c6f70 msgr2=0x7fda2814fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:25.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:25.615+0000 7fda2cd8d640 1 --2- 172.21.15.1:0/3206012592 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fda280c6f70 0x7fda2814fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:25.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:25.615+0000 7fda2cd8d640 1 -- 172.21.15.1:0/3206012592 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda28165e00 msgr2=0x7fda281f2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:25.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:25.615+0000 7fda2cd8d640 1 --2- 172.21.15.1:0/3206012592 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda28165e00 0x7fda281f2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:25.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:25.615+0000 7fda2cd8d640 1 -- 172.21.15.1:0/3206012592 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda281f3120 con 0x7fda280cdc20 2024-05-04T02:20:25.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:25.618+0000 7fda2cd8d640 1 --2- 172.21.15.1:0/3206012592 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fda280cdc20 0x7fda2815f5d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fda1800c430 tx=0x7fda1800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:25.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:25.622+0000 7fda1dffb640 1 -- 172.21.15.1:0/3206012592 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda18017070 con 0x7fda280cdc20 2024-05-04T02:20:25.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:25.622+0000 7fda1dffb640 1 -- 172.21.15.1:0/3206012592 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda18005d00 con 0x7fda280cdc20 2024-05-04T02:20:25.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:25.622+0000 7fda2f7f2640 1 -- 172.21.15.1:0/3206012592 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda2815e3a0 con 0x7fda280cdc20 2024-05-04T02:20:25.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:25.622+0000 7fda1dffb640 1 -- 172.21.15.1:0/3206012592 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda18007310 con 0x7fda280cdc20 2024-05-04T02:20:25.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:25.622+0000 7fda2f7f2640 1 -- 172.21.15.1:0/3206012592 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda2815e640 con 0x7fda280cdc20 2024-05-04T02:20:25.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:25.623+0000 7fda2f7f2640 1 -- 172.21.15.1:0/3206012592 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda28069bc0 con 0x7fda280cdc20 2024-05-04T02:20:25.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:25.647+0000 7fda1dffb640 1 -- 172.21.15.1:0/3206012592 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fda1801a070 con 0x7fda280cdc20 2024-05-04T02:20:25.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:25.648+0000 7fda1dffb640 1 --2- 172.21.15.1:0/3206012592 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fda0c0762d0 0x7fda0c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:25.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:25.648+0000 7fda2d58e640 1 --2- 172.21.15.1:0/3206012592 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fda0c0762d0 0x7fda0c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:25.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:25.648+0000 7fda2d58e640 1 --2- 172.21.15.1:0/3206012592 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fda0c0762d0 0x7fda0c0787e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fda24000c00 tx=0x7fda24009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:25.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:25.939+0000 7fda1dffb640 1 -- 172.21.15.1:0/3206012592 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fda1805c360 con 0x7fda280cdc20 2024-05-04T02:20:25.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:25.939+0000 7fda1dffb640 1 -- 172.21.15.1:0/3206012592 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fda18021020 con 0x7fda280cdc20 2024-05-04T02:20:26.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.138+0000 7fda2f7f2640 1 -- 172.21.15.1:0/3206012592 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fda2806d250 con 0x7fda280cdc20 2024-05-04T02:20:26.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.210+0000 7fda1dffb640 1 -- 172.21.15.1:0/3206012592 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16545 (secure 0 0 0) 0x7fda180600d0 con 0x7fda280cdc20 2024-05-04T02:20:26.213 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:20:26.213 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":23,"fsid":"b45b4a9a-b84c-4a66-907b-43f0ca45e7c0","created":"2024-05-04T02:19:44.555410+0000","modified":"2024-05-04T02:20:17.793991+0000","last_up_change":"2024-05-04T02:20:00.162760+0000","last_in_change":"2024-05-04T02:19:50.811018+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-04T02:19:59.664283+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-04T02:20:12.783217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-04T02:20:13.872502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d8ad7964-7bd6-4ba9-ae4f-b55d7566b18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":2338132980},{"type":"v1","addr":"172.21.15.1:6801","nonce":2338132980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":2338132980},{"type":"v1","addr":"172.21.15.1:6803","nonce":2338132980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":2338132980},{"type":"v1","addr":"172.21.15.1:6807","nonce":2338132980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":2338132980},{"type":"v1","addr":"172.21.15.1:6805","nonce":2338132980}]},"public_addr":"172.21.15.1:6801/2338132980","cluster_addr":"172.21.15.1:6803/2338132980","heartbeat_back_addr":"172.21.15.1:6807/2338132980","heartbeat_front_addr":"172.21.15.1:6805/2338132980","state":["exists","up"]},{"osd":1,"uuid":"ce155f6d-7e0c-47c8-a0e0-fb53ff0c7726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":459131368},{"type":"v1","addr":"172.21.15.1:6817","nonce":459131368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":459131368},{"type":"v1","addr":"172.21.15.1:6819","nonce":459131368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":459131368},{"type":"v1","addr":"172.21.15.1:6823","nonce":459131368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":459131368},{"type":"v1","addr":"172.21.15.1:6821","nonce":459131368}]},"public_addr":"172.21.15.1:6817/459131368","cluster_addr":"172.21.15.1:6819/459131368","heartbeat_back_addr":"172.21.15.1:6823/459131368","heartbeat_front_addr":"172.21.15.1:6821/459131368","state":["exists","up"]},{"osd":2,"uuid":"7847c281-5da0-4d7d-b888-7f49d99a50b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":3463851105},{"type":"v1","addr":"172.21.15.1:6809","nonce":3463851105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":3463851105},{"type":"v1","addr":"172.21.15.1:6811","nonce":3463851105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":3463851105},{"type":"v1","addr":"172.21.15.1:6815","nonce":3463851105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":3463851105},{"type":"v1","addr":"172.21.15.1:6813","nonce":3463851105}]},"public_addr":"172.21.15.1:6809/3463851105","cluster_addr":"172.21.15.1:6811/3463851105","heartbeat_back_addr":"172.21.15.1:6815/3463851105","heartbeat_front_addr":"172.21.15.1:6813/3463851105","state":["exists","up"]},{"osd":3,"uuid":"26386eba-d106-4abe-8d6b-7dccdd106cb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":3859721636},{"type":"v1","addr":"172.21.15.1:6825","nonce":3859721636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":3859721636},{"type":"v1","addr":"172.21.15.1:6827","nonce":3859721636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":3859721636},{"type":"v1","addr":"172.21.15.1:6831","nonce":3859721636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":3859721636},{"type":"v1","addr":"172.21.15.1:6829","nonce":3859721636}]},"public_addr":"172.21.15.1:6825/3859721636","cluster_addr":"172.21.15.1:6827/3859721636","heartbeat_back_addr":"172.21.15.1:6831/3859721636","heartbeat_front_addr":"172.21.15.1:6829/3859721636","state":["exists","up"]},{"osd":4,"uuid":"2ba3d1b3-c5fa-4ff4-bf5d-772e77d79c59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":2335597098},{"type":"v1","addr":"172.21.15.107:6803","nonce":2335597098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":2335597098},{"type":"v1","addr":"172.21.15.107:6805","nonce":2335597098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2335597098},{"type":"v1","addr":"172.21.15.107:6810","nonce":2335597098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":2335597098},{"type":"v1","addr":"172.21.15.107:6807","nonce":2335597098}]},"public_addr":"172.21.15.107:6803/2335597098","cluster_addr":"172.21.15.107:6805/2335597098","heartbeat_back_addr":"172.21.15.107:6810/2335597098","heartbeat_front_addr":"172.21.15.107:6807/2335597098","state":["exists","up"]},{"osd":5,"uuid":"c42646eb-6e14-4b42-a7a3-54f99f1662bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":1274544305},{"type":"v1","addr":"172.21.15.107:6819","nonce":1274544305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":1274544305},{"type":"v1","addr":"172.21.15.107:6821","nonce":1274544305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":1274544305},{"type":"v1","addr":"172.21.15.107:6825","nonce":1274544305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":1274544305},{"type":"v1","addr":"172.21.15.107:6823","nonce":1274544305}]},"public_addr":"172.21.15.107:6819/1274544305","cluster_addr":"172.21.15.107:6821/1274544305","heartbeat_back_addr":"172.21.15.107:6825/1274544305","heartbeat_front_addr":"172.21.15.107:6823/1274544305","state":["exists","up"]},{"osd":6,"uuid":"a8a2dbb8-0107-4b8e-93c3-5fa7e6af15a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6809","nonce":941385299},{"type":"v1","addr":"172.21.15.107:6811","nonce":941385299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":941385299},{"type":"v1","addr":"172.21.15.107:6813","nonce":941385299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":941385299},{"type":"v1","addr":"172.21.15.107:6817","nonce":941385299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":941385299},{"type":"v1","addr":"172.21.15.107:6815","nonce":941385299}]},"public_addr":"172.21.15.107:6811/941385299","cluster_addr":"172.21.15.107:6813/941385299","heartbeat_back_addr":"172.21.15.107:6817/941385299","heartbeat_front_addr":"172.21.15.107:6815/941385299","state":["exists","up"]},{"osd":7,"uuid":"3b9bdc70-8831-4df9-8d50-362aa0f02aed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":1723298539},{"type":"v1","addr":"172.21.15.107:6827","nonce":1723298539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":1723298539},{"type":"v1","addr":"172.21.15.107:6829","nonce":1723298539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":1723298539},{"type":"v1","addr":"172.21.15.107:6833","nonce":1723298539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":1723298539},{"type":"v1","addr":"172.21.15.107:6831","nonce":1723298539}]},"public_addr":"172.21.15.107:6827/1723298539","cluster_addr":"172.21.15.107:6829/1723298539","heartbeat_back_addr":"172.21.15.107:6833/1723298539","heartbeat_front_addr":"172.21.15.107:6831/1723298539","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T02:19:56.277538+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T02:19:56.402984+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T02:19:56.374787+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T02:19:56.461914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T02:19:56.384856+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T02:19:56.469958+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T02:19:56.489376+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T02:19:56.393205+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-04T02:20:26.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.213+0000 7fda2f7f2640 1 -- 172.21.15.1:0/3206012592 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fda0c0762d0 msgr2=0x7fda0c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:26.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.213+0000 7fda2f7f2640 1 --2- 172.21.15.1:0/3206012592 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fda0c0762d0 0x7fda0c0787e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fda24000c00 tx=0x7fda24009040 comp rx=0 tx=0).stop 2024-05-04T02:20:26.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.213+0000 7fda2f7f2640 1 -- 172.21.15.1:0/3206012592 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fda280cdc20 msgr2=0x7fda2815f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:26.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.213+0000 7fda2f7f2640 1 --2- 172.21.15.1:0/3206012592 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fda280cdc20 0x7fda2815f5d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fda1800c430 tx=0x7fda1800c8f0 comp rx=0 tx=0).stop 2024-05-04T02:20:26.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.213+0000 7fda2f7f2640 1 -- 172.21.15.1:0/3206012592 shutdown_connections 2024-05-04T02:20:26.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.213+0000 7fda2f7f2640 1 --2- 172.21.15.1:0/3206012592 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fda0c0762d0 0x7fda0c0787e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:26.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.213+0000 7fda2f7f2640 1 --2- 172.21.15.1:0/3206012592 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fda28165e00 0x7fda281f2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:26.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.213+0000 7fda2f7f2640 1 --2- 172.21.15.1:0/3206012592 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fda280cdc20 0x7fda2815f5d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:26.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.213+0000 7fda2f7f2640 1 --2- 172.21.15.1:0/3206012592 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fda280c6f70 0x7fda2814fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:26.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.213+0000 7fda2f7f2640 1 -- 172.21.15.1:0/3206012592 >> 172.21.15.1:0/3206012592 conn(0x7fda2808e210 msgr2=0x7fda2806d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:26.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.213+0000 7fda2f7f2640 1 -- 172.21.15.1:0/3206012592 shutdown_connections 2024-05-04T02:20:26.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.213+0000 7fda2f7f2640 1 -- 172.21.15.1:0/3206012592 wait complete. 2024-05-04T02:20:26.227 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-05-04T02:20:26.227 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-04T02:20:26.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.339+0000 7fa79cc49640 1 Processor -- start 2024-05-04T02:20:26.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.339+0000 7fa79cc49640 1 -- start start 2024-05-04T02:20:26.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.340+0000 7fa79cc49640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fa798156b40 0x7fa7980c7240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:26.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.340+0000 7fa79cc49640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa7980cd480 0x7fa7981607a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:26.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.340+0000 7fa79cc49640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa7980b60c0 0x7fa7980b64d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:26.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.340+0000 7fa79cc49640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7fa798160310 con 0x7fa798156b40 2024-05-04T02:20:26.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.340+0000 7fa79cc49640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fa79815fd00 con 0x7fa7980cd480 2024-05-04T02:20:26.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.340+0000 7fa79cc49640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa7980c68a0 con 0x7fa7980b60c0 2024-05-04T02:20:26.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.341+0000 7fa796d9d640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa7980b60c0 0x7fa7980b64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:26.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.341+0000 7fa79659c640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fa798156b40 0x7fa7980c7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:26.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.341+0000 7fa78ffff640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa7980cd480 0x7fa7981607a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:26.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.341+0000 7fa796d9d640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa7980b60c0 0x7fa7980b64d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.1:49696/0 (socket says 172.21.15.1:49696) 2024-05-04T02:20:26.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.341+0000 7fa796d9d640 1 -- 172.21.15.1:0/3091070250 learned_addr learned my addr 172.21.15.1:0/3091070250 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:26.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.344+0000 7fa796d9d640 1 -- 172.21.15.1:0/3091070250 >> v2:172.21.15.107:3300/0 conn(0x7fa7980cd480 msgr2=0x7fa7981607a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:26.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.344+0000 7fa796d9d640 1 --2- 172.21.15.1:0/3091070250 >> v2:172.21.15.107:3300/0 conn(0x7fa7980cd480 0x7fa7981607a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:26.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.344+0000 7fa796d9d640 1 -- 172.21.15.1:0/3091070250 >> v2:172.21.15.1:3300/0 conn(0x7fa798156b40 msgr2=0x7fa7980c7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:26.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.344+0000 7fa796d9d640 1 --2- 172.21.15.1:0/3091070250 >> v2:172.21.15.1:3300/0 conn(0x7fa798156b40 0x7fa7980c7240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:26.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.344+0000 7fa796d9d640 1 -- 172.21.15.1:0/3091070250 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa79815ffa0 con 0x7fa7980b60c0 2024-05-04T02:20:26.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.346+0000 7fa796d9d640 1 --2- 172.21.15.1:0/3091070250 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa7980b60c0 0x7fa7980b64d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa79808e7b0 tx=0x7fa79002a6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f22d313421419f94 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:26.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.349+0000 7fa795d9b640 1 -- 172.21.15.1:0/3091070250 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa790036070 con 0x7fa7980b60c0 2024-05-04T02:20:26.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.350+0000 7fa795d9b640 1 -- 172.21.15.1:0/3091070250 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa790031600 con 0x7fa7980b60c0 2024-05-04T02:20:26.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.350+0000 7fa795d9b640 1 -- 172.21.15.1:0/3091070250 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7900319d0 con 0x7fa7980b60c0 2024-05-04T02:20:26.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.350+0000 7fa79cc49640 1 -- 172.21.15.1:0/3091070250 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa7980b60c0 msgr2=0x7fa7980b64d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:26.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.350+0000 7fa79cc49640 1 --2- 172.21.15.1:0/3091070250 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa7980b60c0 0x7fa7980b64d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa79808e7b0 tx=0x7fa79002a6a0 comp rx=0 tx=0).stop 2024-05-04T02:20:26.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.350+0000 7fa79cc49640 1 -- 172.21.15.1:0/3091070250 shutdown_connections 2024-05-04T02:20:26.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.350+0000 7fa79cc49640 1 --2- 172.21.15.1:0/3091070250 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa7980b60c0 0x7fa7980b64d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:26.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.350+0000 7fa79cc49640 1 --2- 172.21.15.1:0/3091070250 >> v2:172.21.15.107:3300/0 conn(0x7fa7980cd480 0x7fa7981607a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:26.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.350+0000 7fa79cc49640 1 --2- 172.21.15.1:0/3091070250 >> v2:172.21.15.1:3300/0 conn(0x7fa798156b40 0x7fa7980c7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:26.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.350+0000 7fa79cc49640 1 -- 172.21.15.1:0/3091070250 >> 172.21.15.1:0/3091070250 conn(0x7fa7980ce560 msgr2=0x7fa7980ce970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:26.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.350+0000 7fa79cc49640 1 -- 172.21.15.1:0/3091070250 shutdown_connections 2024-05-04T02:20:26.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.350+0000 7fa79cc49640 1 -- 172.21.15.1:0/3091070250 wait complete. 2024-05-04T02:20:26.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.352+0000 7fa79cc49640 1 Processor -- start 2024-05-04T02:20:26.354 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.352+0000 7fa79cc49640 1 -- start start 2024-05-04T02:20:26.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.353+0000 7fa79cc49640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa7980b60c0 0x7fa798157f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:26.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.353+0000 7fa79cc49640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7980cd480 0x7fa798158db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:26.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.353+0000 7fa79cc49640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa798156b40 0x7fa798157710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:26.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.353+0000 7fa79cc49640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa7980b4a20 con 0x7fa798156b40 2024-05-04T02:20:26.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.353+0000 7fa79cc49640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa7980b46e0 con 0x7fa7980cd480 2024-05-04T02:20:26.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.353+0000 7fa79cc49640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa7980b4ba0 con 0x7fa7980b60c0 2024-05-04T02:20:26.356 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.354+0000 7fa796d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa798156b40 0x7fa798157710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:26.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.354+0000 7fa79659c640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa7980b60c0 0x7fa798157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:26.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.354+0000 7fa796d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa798156b40 0x7fa798157710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41424/0 (socket says 172.21.15.1:41424) 2024-05-04T02:20:26.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.354+0000 7fa796d9d640 1 -- 172.21.15.1:0/3436526600 learned_addr learned my addr 172.21.15.1:0/3436526600 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:26.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.354+0000 7fa78ffff640 1 --2- 172.21.15.1:0/3436526600 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7980cd480 0x7fa798158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:26.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.358+0000 7fa79659c640 1 -- 172.21.15.1:0/3436526600 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7980cd480 msgr2=0x7fa798158db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:26.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.358+0000 7fa79659c640 1 --2- 172.21.15.1:0/3436526600 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7980cd480 0x7fa798158db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:26.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.358+0000 7fa79659c640 1 -- 172.21.15.1:0/3436526600 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa798156b40 msgr2=0x7fa798157710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:26.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.358+0000 7fa79659c640 1 --2- 172.21.15.1:0/3436526600 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa798156b40 0x7fa798157710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:26.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.358+0000 7fa79659c640 1 -- 172.21.15.1:0/3436526600 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa798158490 con 0x7fa7980b60c0 2024-05-04T02:20:26.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.361+0000 7fa79659c640 1 --2- 172.21.15.1:0/3436526600 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa7980b60c0 0x7fa798157f50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa78800e8d0 tx=0x7fa78800ed90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:26.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.365+0000 7fa78effd640 1 -- 172.21.15.1:0/3436526600 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa788017070 con 0x7fa7980b60c0 2024-05-04T02:20:26.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.365+0000 7fa78effd640 1 -- 172.21.15.1:0/3436526600 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa78800c940 con 0x7fa7980b60c0 2024-05-04T02:20:26.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.365+0000 7fa79cc49640 1 -- 172.21.15.1:0/3436526600 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa79815d840 con 0x7fa7980b60c0 2024-05-04T02:20:26.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.365+0000 7fa78effd640 1 -- 172.21.15.1:0/3436526600 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa788009e60 con 0x7fa7980b60c0 2024-05-04T02:20:26.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.365+0000 7fa79cc49640 1 -- 172.21.15.1:0/3436526600 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa79815ccc0 con 0x7fa7980b60c0 2024-05-04T02:20:26.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.366+0000 7fa79cc49640 1 -- 172.21.15.1:0/3436526600 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa798069bc0 con 0x7fa7980b60c0 2024-05-04T02:20:26.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.641+0000 7fa78effd640 1 -- 172.21.15.1:0/3436526600 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa78801a070 con 0x7fa7980b60c0 2024-05-04T02:20:26.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.642+0000 7fa78effd640 1 --2- 172.21.15.1:0/3436526600 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fa778076300 0x7fa778078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:26.644 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.642+0000 7fa78ffff640 1 --2- 172.21.15.1:0/3436526600 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fa778076300 0x7fa778078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:26.645 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.643+0000 7fa78ffff640 1 --2- 172.21.15.1:0/3436526600 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fa778076300 0x7fa778078810 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa7981f0290 tx=0x7fa780009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:26.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.648+0000 7fa78effd640 1 -- 172.21.15.1:0/3436526600 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fa78800cd10 con 0x7fa7980b60c0 2024-05-04T02:20:26.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.658+0000 7fa78effd640 1 -- 172.21.15.1:0/3436526600 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa79815d840 con 0x7fa7980b60c0 2024-05-04T02:20:26.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.850+0000 7fa79cc49640 1 -- 172.21.15.1:0/3436526600 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa7980cdd70 con 0x7fa7980b60c0 2024-05-04T02:20:26.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.888+0000 7fa78effd640 1 -- 172.21.15.1:0/3436526600 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16545 (secure 0 0 0) 0x7fa788060ea0 con 0x7fa7980b60c0 2024-05-04T02:20:26.890 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:20:26.891 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":23,"fsid":"b45b4a9a-b84c-4a66-907b-43f0ca45e7c0","created":"2024-05-04T02:19:44.555410+0000","modified":"2024-05-04T02:20:17.793991+0000","last_up_change":"2024-05-04T02:20:00.162760+0000","last_in_change":"2024-05-04T02:19:50.811018+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-04T02:19:59.664283+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-04T02:20:12.783217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-04T02:20:13.872502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d8ad7964-7bd6-4ba9-ae4f-b55d7566b18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":2338132980},{"type":"v1","addr":"172.21.15.1:6801","nonce":2338132980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":2338132980},{"type":"v1","addr":"172.21.15.1:6803","nonce":2338132980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":2338132980},{"type":"v1","addr":"172.21.15.1:6807","nonce":2338132980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":2338132980},{"type":"v1","addr":"172.21.15.1:6805","nonce":2338132980}]},"public_addr":"172.21.15.1:6801/2338132980","cluster_addr":"172.21.15.1:6803/2338132980","heartbeat_back_addr":"172.21.15.1:6807/2338132980","heartbeat_front_addr":"172.21.15.1:6805/2338132980","state":["exists","up"]},{"osd":1,"uuid":"ce155f6d-7e0c-47c8-a0e0-fb53ff0c7726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":459131368},{"type":"v1","addr":"172.21.15.1:6817","nonce":459131368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":459131368},{"type":"v1","addr":"172.21.15.1:6819","nonce":459131368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":459131368},{"type":"v1","addr":"172.21.15.1:6823","nonce":459131368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":459131368},{"type":"v1","addr":"172.21.15.1:6821","nonce":459131368}]},"public_addr":"172.21.15.1:6817/459131368","cluster_addr":"172.21.15.1:6819/459131368","heartbeat_back_addr":"172.21.15.1:6823/459131368","heartbeat_front_addr":"172.21.15.1:6821/459131368","state":["exists","up"]},{"osd":2,"uuid":"7847c281-5da0-4d7d-b888-7f49d99a50b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":3463851105},{"type":"v1","addr":"172.21.15.1:6809","nonce":3463851105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":3463851105},{"type":"v1","addr":"172.21.15.1:6811","nonce":3463851105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":3463851105},{"type":"v1","addr":"172.21.15.1:6815","nonce":3463851105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":3463851105},{"type":"v1","addr":"172.21.15.1:6813","nonce":3463851105}]},"public_addr":"172.21.15.1:6809/3463851105","cluster_addr":"172.21.15.1:6811/3463851105","heartbeat_back_addr":"172.21.15.1:6815/3463851105","heartbeat_front_addr":"172.21.15.1:6813/3463851105","state":["exists","up"]},{"osd":3,"uuid":"26386eba-d106-4abe-8d6b-7dccdd106cb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":3859721636},{"type":"v1","addr":"172.21.15.1:6825","nonce":3859721636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":3859721636},{"type":"v1","addr":"172.21.15.1:6827","nonce":3859721636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":3859721636},{"type":"v1","addr":"172.21.15.1:6831","nonce":3859721636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":3859721636},{"type":"v1","addr":"172.21.15.1:6829","nonce":3859721636}]},"public_addr":"172.21.15.1:6825/3859721636","cluster_addr":"172.21.15.1:6827/3859721636","heartbeat_back_addr":"172.21.15.1:6831/3859721636","heartbeat_front_addr":"172.21.15.1:6829/3859721636","state":["exists","up"]},{"osd":4,"uuid":"2ba3d1b3-c5fa-4ff4-bf5d-772e77d79c59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":2335597098},{"type":"v1","addr":"172.21.15.107:6803","nonce":2335597098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":2335597098},{"type":"v1","addr":"172.21.15.107:6805","nonce":2335597098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2335597098},{"type":"v1","addr":"172.21.15.107:6810","nonce":2335597098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":2335597098},{"type":"v1","addr":"172.21.15.107:6807","nonce":2335597098}]},"public_addr":"172.21.15.107:6803/2335597098","cluster_addr":"172.21.15.107:6805/2335597098","heartbeat_back_addr":"172.21.15.107:6810/2335597098","heartbeat_front_addr":"172.21.15.107:6807/2335597098","state":["exists","up"]},{"osd":5,"uuid":"c42646eb-6e14-4b42-a7a3-54f99f1662bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":1274544305},{"type":"v1","addr":"172.21.15.107:6819","nonce":1274544305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":1274544305},{"type":"v1","addr":"172.21.15.107:6821","nonce":1274544305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":1274544305},{"type":"v1","addr":"172.21.15.107:6825","nonce":1274544305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":1274544305},{"type":"v1","addr":"172.21.15.107:6823","nonce":1274544305}]},"public_addr":"172.21.15.107:6819/1274544305","cluster_addr":"172.21.15.107:6821/1274544305","heartbeat_back_addr":"172.21.15.107:6825/1274544305","heartbeat_front_addr":"172.21.15.107:6823/1274544305","state":["exists","up"]},{"osd":6,"uuid":"a8a2dbb8-0107-4b8e-93c3-5fa7e6af15a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6809","nonce":941385299},{"type":"v1","addr":"172.21.15.107:6811","nonce":941385299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":941385299},{"type":"v1","addr":"172.21.15.107:6813","nonce":941385299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":941385299},{"type":"v1","addr":"172.21.15.107:6817","nonce":941385299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":941385299},{"type":"v1","addr":"172.21.15.107:6815","nonce":941385299}]},"public_addr":"172.21.15.107:6811/941385299","cluster_addr":"172.21.15.107:6813/941385299","heartbeat_back_addr":"172.21.15.107:6817/941385299","heartbeat_front_addr":"172.21.15.107:6815/941385299","state":["exists","up"]},{"osd":7,"uuid":"3b9bdc70-8831-4df9-8d50-362aa0f02aed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":1723298539},{"type":"v1","addr":"172.21.15.107:6827","nonce":1723298539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":1723298539},{"type":"v1","addr":"172.21.15.107:6829","nonce":1723298539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":1723298539},{"type":"v1","addr":"172.21.15.107:6833","nonce":1723298539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":1723298539},{"type":"v1","addr":"172.21.15.107:6831","nonce":1723298539}]},"public_addr":"172.21.15.107:6827/1723298539","cluster_addr":"172.21.15.107:6829/1723298539","heartbeat_back_addr":"172.21.15.107:6833/1723298539","heartbeat_front_addr":"172.21.15.107:6831/1723298539","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T02:19:56.277538+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T02:19:56.402984+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T02:19:56.374787+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T02:19:56.461914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T02:19:56.384856+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T02:19:56.469958+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T02:19:56.489376+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T02:19:56.393205+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-04T02:20:26.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.890+0000 7fa79cc49640 1 -- 172.21.15.1:0/3436526600 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fa778076300 msgr2=0x7fa778078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:26.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.890+0000 7fa79cc49640 1 --2- 172.21.15.1:0/3436526600 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fa778076300 0x7fa778078810 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa7981f0290 tx=0x7fa780009190 comp rx=0 tx=0).stop 2024-05-04T02:20:26.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.890+0000 7fa79cc49640 1 -- 172.21.15.1:0/3436526600 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa7980b60c0 msgr2=0x7fa798157f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:26.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.890+0000 7fa79cc49640 1 --2- 172.21.15.1:0/3436526600 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa7980b60c0 0x7fa798157f50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa78800e8d0 tx=0x7fa78800ed90 comp rx=0 tx=0).stop 2024-05-04T02:20:26.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.890+0000 7fa79cc49640 1 -- 172.21.15.1:0/3436526600 shutdown_connections 2024-05-04T02:20:26.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.890+0000 7fa79cc49640 1 --2- 172.21.15.1:0/3436526600 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fa778076300 0x7fa778078810 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:26.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.890+0000 7fa79cc49640 1 --2- 172.21.15.1:0/3436526600 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa798156b40 0x7fa798157710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:26.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.890+0000 7fa79cc49640 1 --2- 172.21.15.1:0/3436526600 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa7980cd480 0x7fa798158db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:26.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.890+0000 7fa79cc49640 1 --2- 172.21.15.1:0/3436526600 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa7980b60c0 0x7fa798157f50 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:26.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.890+0000 7fa79cc49640 1 -- 172.21.15.1:0/3436526600 >> 172.21.15.1:0/3436526600 conn(0x7fa7980ce560 msgr2=0x7fa79806d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:26.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.890+0000 7fa79cc49640 1 -- 172.21.15.1:0/3436526600 shutdown_connections 2024-05-04T02:20:26.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:26.890+0000 7fa79cc49640 1 -- 172.21.15.1:0/3436526600 wait complete. 2024-05-04T02:20:26.904 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-05-04T02:20:26.905 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-05-04T02:20:26.905 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-05-04T02:20:26.906 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-05-04T02:20:26.906 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-05-04T02:20:26.906 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-05-04T02:20:26.907 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-05-04T02:20:26.907 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-05-04T02:20:27.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.130+0000 7efc714da640 1 Processor -- start 2024-05-04T02:20:27.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.131+0000 7efc714da640 1 -- start start 2024-05-04T02:20:27.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.131+0000 7f22ba558640 1 Processor -- start 2024-05-04T02:20:27.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.131+0000 7f22ba558640 1 -- start start 2024-05-04T02:20:27.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.132+0000 7fb7ee3b3640 1 Processor -- start 2024-05-04T02:20:27.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.131+0000 7fa45483d640 1 Processor -- start 2024-05-04T02:20:27.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.131+0000 7fa45483d640 1 -- start start 2024-05-04T02:20:27.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.133+0000 7fdd66f10640 1 Processor -- start 2024-05-04T02:20:27.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.133+0000 7fdd66f10640 1 -- start start 2024-05-04T02:20:27.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.133+0000 7efc714da640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7efc6c0c6f40 0x7efc6c0c7350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.133+0000 7efc714da640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc6c159290 con 0x7efc6c15b8c0 2024-05-04T02:20:27.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.133+0000 7efc714da640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc6c1583e0 con 0x7efc6c158e80 2024-05-04T02:20:27.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.133+0000 7efc714da640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7efc6c1589f0 con 0x7efc6c0c6f40 2024-05-04T02:20:27.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.132+0000 7f74f13c7640 1 Processor -- start 2024-05-04T02:20:27.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.133+0000 7fa45483d640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa448050ec0 0x7fa448006ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.133+0000 7fa45483d640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa448045e60 0x7fa4480d56e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.133+0000 7fa45483d640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa448047530 con 0x7fa4480334d0 2024-05-04T02:20:27.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.133+0000 7fa45483d640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fa4480d5c20 con 0x7fa448045e60 2024-05-04T02:20:27.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.133+0000 7fa45483d640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa448034fd0 con 0x7fa448050ec0 2024-05-04T02:20:27.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.133+0000 7f74f13c7640 1 -- start start 2024-05-04T02:20:27.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.134+0000 7efc6b7fe640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7efc6c158e80 0x7efc6c0c7d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.1:54728/0 (socket says 172.21.15.1:54728) 2024-05-04T02:20:27.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.134+0000 7f22ba558640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f22ac045ce0 0x7f22ac045350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.134+0000 7efc6b7fe640 1 -- 172.21.15.1:0/709042522 learned_addr learned my addr 172.21.15.1:0/709042522 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-05-04T02:20:27.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.132+0000 7fb7ee3b3640 1 -- start start 2024-05-04T02:20:27.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.134+0000 7f22ba558640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f22ac04c900 0x7f22ac046ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.134+0000 7ff4a0822640 1 Processor -- start 2024-05-04T02:20:27.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.134+0000 7fa44f7fe640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa448050ec0 0x7fa448006ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:27.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.134+0000 7f22ba558640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22ac0461b0 con 0x7f22ac0062c0 2024-05-04T02:20:27.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.134+0000 7f22ba558640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f22ac0e4350 con 0x7f22ac04c900 2024-05-04T02:20:27.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.134+0000 7f22ba558640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f22ac0e4630 con 0x7f22ac045ce0 2024-05-04T02:20:27.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.134+0000 7ff4a0822640 1 -- start start 2024-05-04T02:20:27.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.135+0000 7fb7ee3b3640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb7e80c5520 0x7fb7e81607e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.135+0000 7fa44f7fe640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa448050ec0 0x7fa448006ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.1:49710/0 (socket says 172.21.15.1:49710) 2024-05-04T02:20:27.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.135+0000 7fa44f7fe640 1 -- 172.21.15.1:0/785617853 learned_addr learned my addr 172.21.15.1:0/785617853 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:27.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.135+0000 7f74f13c7640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f74e40370b0 0x7f74e4038c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.135+0000 7fb7ee3b3640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb7e80c7690 0x7fb7e80c9450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.135+0000 7fa44ffff640 1 --2- 172.21.15.1:0/785617853 >> v2:172.21.15.107:3300/0 conn(0x7fa448045e60 0x7fa4480d56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:27.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.135+0000 7f74f13c7640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f74e40391d0 0x7f74e40e9d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.135+0000 7f74f13c7640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74e40df6b0 con 0x7f74e4038240 2024-05-04T02:20:27.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.135+0000 7f74f13c7640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f74e40481e0 con 0x7f74e40370b0 2024-05-04T02:20:27.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.135+0000 7fb7ee3b3640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7e80c8360 con 0x7fb7e815a5a0 2024-05-04T02:20:27.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.135+0000 7fb7ee3b3640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7fb7e80c8640 con 0x7fb7e80c5520 2024-05-04T02:20:27.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.135+0000 7fb7ee3b3640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fb7e80c4a40 con 0x7fb7e80c7690 2024-05-04T02:20:27.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.135+0000 7f74f13c7640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f74e4038800 con 0x7f74e40391d0 2024-05-04T02:20:27.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.135+0000 7fdd66f10640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fdd6015a5a0 0x7fdd6015a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.135+0000 7fdd66f10640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd6015aef0 con 0x7fdd600c7690 2024-05-04T02:20:27.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.135+0000 7f22b9556640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f22ac045ce0 0x7f22ac045350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:27.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.135+0000 7fdd66f10640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd600c8360 con 0x7fdd600c5520 2024-05-04T02:20:27.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.135+0000 7fdd66f10640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fdd600c9b60 con 0x7fdd6015a5a0 2024-05-04T02:20:27.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.136+0000 7ff4a0822640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff494050920 0x7ff4940d9360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.145 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.136+0000 7ff4a0822640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff4940dfd80 0x7ff494007220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.136+0000 7f22b9556640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f22ac045ce0 0x7f22ac045350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.1:49724/0 (socket says 172.21.15.1:49724) 2024-05-04T02:20:27.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.136+0000 7ff4a0822640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff494050f70 con 0x7ff49404fc00 2024-05-04T02:20:27.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.136+0000 7f22b9556640 1 -- 172.21.15.1:0/2096758028 learned_addr learned my addr 172.21.15.1:0/2096758028 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:27.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.136+0000 7ff4a0822640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7ff494050d30 con 0x7ff4940dfd80 2024-05-04T02:20:27.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.136+0000 7ff4a0822640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7ff494006d90 con 0x7ff494050920 2024-05-04T02:20:27.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.136+0000 7f142a51f640 1 Processor -- start 2024-05-04T02:20:27.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.136+0000 7f142a51f640 1 -- start start 2024-05-04T02:20:27.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.137+0000 7f22b8d55640 1 --2- 172.21.15.1:0/2096758028 >> v2:172.21.15.107:3300/0 conn(0x7f22ac04c900 0x7f22ac046ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:27.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.138+0000 7f142a51f640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f141c04da80 0x7f141c0d6370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.138+0000 7f142a51f640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f141c047ce0 0x7f141c0480f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.138+0000 7f142a51f640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f141c046530 con 0x7f141c0df5b0 2024-05-04T02:20:27.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.138+0000 7f142a51f640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f141c0467f0 con 0x7f141c047ce0 2024-05-04T02:20:27.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.138+0000 7f142a51f640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f141c04cee0 con 0x7f141c04da80 2024-05-04T02:20:27.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.139+0000 7fa44f7fe640 1 -- 172.21.15.1:0/785617853 >> v2:172.21.15.107:3300/0 conn(0x7fa448045e60 msgr2=0x7fa4480d56e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:27.149 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.139+0000 7fa44f7fe640 1 --2- 172.21.15.1:0/785617853 >> v2:172.21.15.107:3300/0 conn(0x7fa448045e60 0x7fa4480d56e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.139+0000 7fa44f7fe640 1 -- 172.21.15.1:0/785617853 >> v1:172.21.15.1:6789/0 conn(0x7fa4480334d0 legacy=0x7fa448046d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:27.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.139+0000 7fa44f7fe640 1 -- 172.21.15.1:0/785617853 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa448035830 con 0x7fa448050ec0 2024-05-04T02:20:27.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.142+0000 7f22b8d55640 1 -- 172.21.15.1:0/2096758028 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f22ac045ce0 msgr2=0x7f22ac045350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:27.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.142+0000 7f22b8d55640 1 --2- 172.21.15.1:0/2096758028 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f22ac045ce0 0x7f22ac045350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.142+0000 7f22b8d55640 1 -- 172.21.15.1:0/2096758028 >> v1:172.21.15.107:6789/0 conn(0x7f22ac0062c0 legacy=0x7f22ac0e6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.143+0000 7f22b8d55640 1 -- 172.21.15.1:0/2096758028 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22ac0463c0 con 0x7f22ac04c900 2024-05-04T02:20:27.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.145+0000 7fa44f7fe640 1 --2- 172.21.15.1:0/785617853 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa448050ec0 0x7fa448006ad0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa45006aa30 tx=0x7fa4500a7660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3bf55f25e49eb3c9 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:27.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.147+0000 7fb7ed3b1640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb7e80c5520 0x7fb7e81607e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:27.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.147+0000 7f74f0bc6640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f74e40391d0 0x7f74e40e9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:27.151 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.147+0000 7fb7ed3b1640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fb7e80c5520 0x7fb7e81607e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41454/0 (socket says 172.21.15.1:41454) 2024-05-04T02:20:27.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.147+0000 7fb7ed3b1640 1 -- 172.21.15.1:0/639778914 learned_addr learned my addr 172.21.15.1:0/639778914 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:27.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.147+0000 7ff49affd640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff4940dfd80 0x7ff494007220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:27.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.149+0000 7ff49affd640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff4940dfd80 0x7ff494007220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41468/0 (socket says 172.21.15.1:41468) 2024-05-04T02:20:27.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.149+0000 7ff49affd640 1 -- 172.21.15.1:0/1277264626 learned_addr learned my addr 172.21.15.1:0/1277264626 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:27.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.149+0000 7efc6affd640 1 -- 172.21.15.1:0/709042522 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 644500589 0 0) 0x7efc6c1583e0 con 0x7efc6c158e80 2024-05-04T02:20:27.152 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.149+0000 7efc6affd640 1 -- 172.21.15.1:0/709042522 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc54003520 con 0x7efc6c158e80 2024-05-04T02:20:27.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.150+0000 7f74f0bc6640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f74e40391d0 0x7f74e40e9d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.1:49728/0 (socket says 172.21.15.1:49728) 2024-05-04T02:20:27.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.150+0000 7f74f0bc6640 1 -- 172.21.15.1:0/948713542 learned_addr learned my addr 172.21.15.1:0/948713542 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:27.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.151+0000 7fb7ed3b1640 1 -- 172.21.15.1:0/639778914 >> v2:172.21.15.107:3300/0 conn(0x7fb7e80c7690 msgr2=0x7fb7e80c9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:27.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.151+0000 7fb7ed3b1640 1 --2- 172.21.15.1:0/639778914 >> v2:172.21.15.107:3300/0 conn(0x7fb7e80c7690 0x7fb7e80c9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.153 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.151+0000 7fb7ed3b1640 1 -- 172.21.15.1:0/639778914 >> v1:172.21.15.1:6789/0 conn(0x7fb7e815a5a0 legacy=0x7fb7e815a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:27.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.151+0000 7fb7ed3b1640 1 -- 172.21.15.1:0/639778914 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7e80c4d20 con 0x7fb7e80c5520 2024-05-04T02:20:27.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.151+0000 7f1423fff640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f141c04da80 0x7f141c0d6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:27.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.152+0000 7f1423fff640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f141c04da80 0x7f141c0d6370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.1:49740/0 (socket says 172.21.15.1:49740) 2024-05-04T02:20:27.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.152+0000 7f1423fff640 1 -- 172.21.15.1:0/3905816123 learned_addr learned my addr 172.21.15.1:0/3905816123 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:27.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.152+0000 7efc70cd9640 1 --2- 172.21.15.1:0/709042522 >> v2:172.21.15.1:3300/0 conn(0x7efc6c0c6f40 0x7efc6c0c7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:27.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.154+0000 7fb7ed3b1640 1 --2- 172.21.15.1:0/639778914 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb7e80c5520 0x7fb7e81607e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb7e80c4780 tx=0x7fb7e402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5b1ea63d0625898 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:27.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.154+0000 7f74f0bc6640 1 -- 172.21.15.1:0/948713542 >> v2:172.21.15.107:3300/0 conn(0x7f74e40370b0 msgr2=0x7f74e4038c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:27.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.154+0000 7f74f0bc6640 1 --2- 172.21.15.1:0/948713542 >> v2:172.21.15.107:3300/0 conn(0x7f74e40370b0 0x7f74e4038c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.154+0000 7f74f0bc6640 1 -- 172.21.15.1:0/948713542 >> v1:172.21.15.1:6789/0 conn(0x7f74e4038240 legacy=0x7f74e4037690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:27.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.154+0000 7f74f0bc6640 1 -- 172.21.15.1:0/948713542 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74e40df990 con 0x7f74e40391d0 2024-05-04T02:20:27.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.155+0000 7ff49affd640 1 -- 172.21.15.1:0/1277264626 >> v2:172.21.15.107:3300/0 conn(0x7ff494050920 msgr2=0x7ff4940d9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:27.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.155+0000 7ff49affd640 1 --2- 172.21.15.1:0/1277264626 >> v2:172.21.15.107:3300/0 conn(0x7ff494050920 0x7ff4940d9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.155+0000 7ff49affd640 1 -- 172.21.15.1:0/1277264626 >> v1:172.21.15.1:6789/0 conn(0x7ff49404fc00 legacy=0x7ff4940e28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:27.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.155+0000 7ff49affd640 1 -- 172.21.15.1:0/1277264626 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff494006180 con 0x7ff4940dfd80 2024-05-04T02:20:27.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.157+0000 7fdd6670f640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fdd6015a5a0 0x7fdd6015a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:27.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.158+0000 7efc6affd640 1 -- 172.21.15.1:0/709042522 <== mon.1 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2143185872 0 0) 0x7efc54003520 con 0x7efc6c158e80 2024-05-04T02:20:27.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.158+0000 7efc6affd640 1 -- 172.21.15.1:0/709042522 >> v2:172.21.15.1:3300/0 conn(0x7efc6c0c6f40 msgr2=0x7efc6c0c7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:27.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.158+0000 7efc6affd640 1 --2- 172.21.15.1:0/709042522 >> v2:172.21.15.1:3300/0 conn(0x7efc6c0c6f40 0x7efc6c0c7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.158+0000 7efc6affd640 1 -- 172.21.15.1:0/709042522 >> v1:172.21.15.1:6789/0 conn(0x7efc6c15b8c0 legacy=0x7efc6c1520c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:27.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.158+0000 7f1423fff640 1 -- 172.21.15.1:0/3905816123 >> v2:172.21.15.107:3300/0 conn(0x7f141c047ce0 msgr2=0x7f141c0480f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:27.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.158+0000 7f1423fff640 1 --2- 172.21.15.1:0/3905816123 >> v2:172.21.15.107:3300/0 conn(0x7f141c047ce0 0x7f141c0480f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.158+0000 7f1423fff640 1 -- 172.21.15.1:0/3905816123 >> v1:172.21.15.1:6789/0 conn(0x7f141c0df5b0 legacy=0x7f141c0df9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:27.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.158+0000 7f1423fff640 1 -- 172.21.15.1:0/3905816123 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f141c04d1c0 con 0x7f141c04da80 2024-05-04T02:20:27.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.158+0000 7efc6affd640 1 -- 172.21.15.1:0/709042522 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc6c073ec0 con 0x7efc6c158e80 2024-05-04T02:20:27.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.158+0000 7fdd6670f640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fdd6015a5a0 0x7fdd6015a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.1:47094/0 (socket says 172.21.15.1:47094) 2024-05-04T02:20:27.161 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.158+0000 7fdd6670f640 1 -- 172.21.15.1:0/2147647838 learned_addr learned my addr 172.21.15.1:0/2147647838 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:27.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.158+0000 7efc6affd640 1 -- 172.21.15.1:0/709042522 <== mon.1 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1418761865 0 0) 0x7efc5c0016f0 con 0x7efc6c158e80 2024-05-04T02:20:27.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.158+0000 7efc6affd640 1 -- 172.21.15.1:0/709042522 >> v1:172.21.15.107:6789/0 conn(0x7efc6c158e80 legacy=0x7efc6c0c7d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.158+0000 7efc6affd640 1 --2- 172.21.15.1:0/709042522 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efc54003ae0 0x7efc54003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.158+0000 7efc6affd640 1 --2- 172.21.15.1:0/709042522 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc54004800 0x7efc54004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.158+0000 7efc6affd640 1 --2- 172.21.15.1:0/709042522 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc54005350 0x7efc5400dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.158+0000 7efc6affd640 1 -- 172.21.15.1:0/709042522 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7efc6c1589f0 con 0x7efc54005350 2024-05-04T02:20:27.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.158+0000 7efc6affd640 1 -- 172.21.15.1:0/709042522 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7efc5400e4e0 con 0x7efc54004800 2024-05-04T02:20:27.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.158+0000 7efc6affd640 1 -- 172.21.15.1:0/709042522 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7efc5400e6e0 con 0x7efc54003ae0 2024-05-04T02:20:27.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.159+0000 7f74f0bc6640 1 --2- 172.21.15.1:0/948713542 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f74e40391d0 0x7f74e40e9d40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f74e40381d0 tx=0x7f74e002a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd3f57c7de3e2b3f server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:27.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.159+0000 7ff49affd640 1 --2- 172.21.15.1:0/1277264626 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff4940dfd80 0x7ff494007220 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff494054700 tx=0x7ff48802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba62e4137b4eb483 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:27.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.162+0000 7fdd6670f640 1 -- 172.21.15.1:0/2147647838 >> v1:172.21.15.107:6789/0 conn(0x7fdd600c5520 legacy=0x7fdd601607e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:27.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.162+0000 7fdd6670f640 1 -- 172.21.15.1:0/2147647838 >> v1:172.21.15.1:6789/0 conn(0x7fdd600c7690 legacy=0x7fdd600c9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:27.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.162+0000 7fdd6670f640 1 -- 172.21.15.1:0/2147647838 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd600c4a40 con 0x7fdd6015a5a0 2024-05-04T02:20:27.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.163+0000 7f22b8d55640 1 --2- 172.21.15.1:0/2096758028 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22ac04c900 0x7f22ac046ea0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f22b00097a0 tx=0x7f22b002a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b534aa26d44deb56 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:27.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.163+0000 7f1423fff640 1 --2- 172.21.15.1:0/3905816123 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f141c04da80 0x7f141c0d6370 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f141c009970 tx=0x7f141802c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce3eef06d2851112 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:27.166 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.164+0000 7efc6b7fe640 1 --2- 172.21.15.1:0/709042522 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc54004800 0x7efc54004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:27.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.165+0000 7fa44e7fc640 1 -- 172.21.15.1:0/785617853 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4500b3070 con 0x7fa448050ec0 2024-05-04T02:20:27.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.165+0000 7fa44e7fc640 1 -- 172.21.15.1:0/785617853 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4500ac7d0 con 0x7fa448050ec0 2024-05-04T02:20:27.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.165+0000 7fa44e7fc640 1 -- 172.21.15.1:0/785617853 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4500acc40 con 0x7fa448050ec0 2024-05-04T02:20:27.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.166+0000 7fa45483d640 1 -- 172.21.15.1:0/785617853 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa448050ec0 msgr2=0x7fa448006ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.166+0000 7fa45483d640 1 --2- 172.21.15.1:0/785617853 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa448050ec0 0x7fa448006ad0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa45006aa30 tx=0x7fa4500a7660 comp rx=0 tx=0).stop 2024-05-04T02:20:27.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.166+0000 7fa45483d640 1 -- 172.21.15.1:0/785617853 shutdown_connections 2024-05-04T02:20:27.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.166+0000 7fa45483d640 1 --2- 172.21.15.1:0/785617853 >> v2:172.21.15.107:3300/0 conn(0x7fa448045e60 0x7fa4480d56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.166+0000 7fa45483d640 1 --2- 172.21.15.1:0/785617853 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa448050ec0 0x7fa448006ad0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.166+0000 7fa45483d640 1 -- 172.21.15.1:0/785617853 >> 172.21.15.1:0/785617853 conn(0x7fa4480503a0 msgr2=0x7fa4480507b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:27.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.166+0000 7fa45483d640 1 -- 172.21.15.1:0/785617853 shutdown_connections 2024-05-04T02:20:27.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.166+0000 7fa45483d640 1 -- 172.21.15.1:0/785617853 wait complete. 2024-05-04T02:20:27.169 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.168+0000 7fdd6670f640 1 --2- 172.21.15.1:0/2147647838 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdd6015a5a0 0x7fdd6015a9b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c009870 tx=0x7fdd5c02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1b2dd16e4d9711d server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:27.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.168+0000 7fa45483d640 1 Processor -- start 2024-05-04T02:20:27.170 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.168+0000 7fa45483d640 1 -- start start 2024-05-04T02:20:27.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.168+0000 7f74eaffd640 1 -- 172.21.15.1:0/948713542 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e0037070 con 0x7f74e40391d0 2024-05-04T02:20:27.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.168+0000 7f74eaffd640 1 -- 172.21.15.1:0/948713542 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74e0032440 con 0x7f74e40391d0 2024-05-04T02:20:27.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.168+0000 7f74eaffd640 1 -- 172.21.15.1:0/948713542 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e0032810 con 0x7f74e40391d0 2024-05-04T02:20:27.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.169+0000 7f74f13c7640 1 -- 172.21.15.1:0/948713542 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f74e40391d0 msgr2=0x7f74e40e9d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.169+0000 7f74f13c7640 1 --2- 172.21.15.1:0/948713542 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f74e40391d0 0x7f74e40e9d40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f74e40381d0 tx=0x7f74e002a1a0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.169+0000 7f1422ffd640 1 -- 172.21.15.1:0/3905816123 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1418032790 con 0x7f141c04da80 2024-05-04T02:20:27.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.169+0000 7f74f13c7640 1 -- 172.21.15.1:0/948713542 shutdown_connections 2024-05-04T02:20:27.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.169+0000 7f74f13c7640 1 --2- 172.21.15.1:0/948713542 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f74e40391d0 0x7f74e40e9d40 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.169+0000 7f74f13c7640 1 --2- 172.21.15.1:0/948713542 >> v2:172.21.15.107:3300/0 conn(0x7f74e40370b0 0x7f74e4038c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.169+0000 7f74f13c7640 1 -- 172.21.15.1:0/948713542 >> 172.21.15.1:0/948713542 conn(0x7f74e4054840 msgr2=0x7f74e4054c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:27.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.169+0000 7f1422ffd640 1 -- 172.21.15.1:0/3905816123 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1418038070 con 0x7f141c04da80 2024-05-04T02:20:27.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.169+0000 7f1422ffd640 1 -- 172.21.15.1:0/3905816123 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1418032b50 con 0x7f141c04da80 2024-05-04T02:20:27.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.169+0000 7f74f13c7640 1 -- 172.21.15.1:0/948713542 shutdown_connections 2024-05-04T02:20:27.173 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.170+0000 7f74f13c7640 1 -- 172.21.15.1:0/948713542 wait complete. 2024-05-04T02:20:27.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.169+0000 7efc6bfff640 1 --2- 172.21.15.1:0/709042522 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efc54003ae0 0x7efc54003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:27.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.170+0000 7fa45483d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4480334d0 0x7fa4480c4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.170+0000 7fa45483d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa448045e60 0x7fa4480da480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.170+0000 7fa45483d640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa448050ec0 0x7fa4480c6b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.170+0000 7fa45483d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa448035550 con 0x7fa448045e60 2024-05-04T02:20:27.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.170+0000 7fa45483d640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa448035270 con 0x7fa4480334d0 2024-05-04T02:20:27.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.170+0000 7fa45483d640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa4480065b0 con 0x7fa448050ec0 2024-05-04T02:20:27.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.170+0000 7fb7dffff640 1 -- 172.21.15.1:0/639778914 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e4037070 con 0x7fb7e80c5520 2024-05-04T02:20:27.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.170+0000 7fb7dffff640 1 -- 172.21.15.1:0/639778914 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7e4032440 con 0x7fb7e80c5520 2024-05-04T02:20:27.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.170+0000 7fb7dffff640 1 -- 172.21.15.1:0/639778914 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e4032810 con 0x7fb7e80c5520 2024-05-04T02:20:27.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.170+0000 7f142a51f640 1 -- 172.21.15.1:0/3905816123 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f141c04da80 msgr2=0x7f141c0d6370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.170+0000 7f142a51f640 1 --2- 172.21.15.1:0/3905816123 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f141c04da80 0x7f141c0d6370 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f141c009970 tx=0x7f141802c890 comp rx=0 tx=0).stop 2024-05-04T02:20:27.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.170+0000 7f142a51f640 1 -- 172.21.15.1:0/3905816123 shutdown_connections 2024-05-04T02:20:27.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.170+0000 7f142a51f640 1 --2- 172.21.15.1:0/3905816123 >> v2:172.21.15.107:3300/0 conn(0x7f141c047ce0 0x7f141c0480f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.176 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.170+0000 7f142a51f640 1 --2- 172.21.15.1:0/3905816123 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f141c04da80 0x7f141c0d6370 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.170+0000 7f142a51f640 1 -- 172.21.15.1:0/3905816123 >> 172.21.15.1:0/3905816123 conn(0x7f141c0514f0 msgr2=0x7f141c051900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:27.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.171+0000 7f142a51f640 1 -- 172.21.15.1:0/3905816123 shutdown_connections 2024-05-04T02:20:27.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.171+0000 7f142a51f640 1 -- 172.21.15.1:0/3905816123 wait complete. 2024-05-04T02:20:27.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.171+0000 7fb7ee3b3640 1 -- 172.21.15.1:0/639778914 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb7e80c5520 msgr2=0x7fb7e81607e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.171+0000 7fb7ee3b3640 1 --2- 172.21.15.1:0/639778914 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb7e80c5520 0x7fb7e81607e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb7e80c4780 tx=0x7fb7e402a1e0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.177 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.171+0000 7fb7ee3b3640 1 -- 172.21.15.1:0/639778914 shutdown_connections 2024-05-04T02:20:27.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.171+0000 7fb7ee3b3640 1 --2- 172.21.15.1:0/639778914 >> v2:172.21.15.107:3300/0 conn(0x7fb7e80c7690 0x7fb7e80c9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.171+0000 7fb7ee3b3640 1 --2- 172.21.15.1:0/639778914 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb7e80c5520 0x7fb7e81607e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.171+0000 7fb7ee3b3640 1 -- 172.21.15.1:0/639778914 >> 172.21.15.1:0/639778914 conn(0x7fb7e80cd410 msgr2=0x7fb7e80cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:27.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.171+0000 7fb7ee3b3640 1 -- 172.21.15.1:0/639778914 shutdown_connections 2024-05-04T02:20:27.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.171+0000 7fb7ee3b3640 1 -- 172.21.15.1:0/639778914 wait complete. 2024-05-04T02:20:27.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.172+0000 7f74f13c7640 1 Processor -- start 2024-05-04T02:20:27.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.172+0000 7f74f13c7640 1 -- start start 2024-05-04T02:20:27.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.172+0000 7f142a51f640 1 Processor -- start 2024-05-04T02:20:27.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.173+0000 7f142a51f640 1 -- start start 2024-05-04T02:20:27.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.173+0000 7f74f13c7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74e40370b0 0x7f74e40d5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.173+0000 7f74f13c7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74e4038240 0x7f74e40d7a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.173+0000 7f74f13c7640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f74e40391d0 0x7f74e40de540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.173+0000 7fb7ee3b3640 1 Processor -- start 2024-05-04T02:20:27.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.173+0000 7f74f13c7640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f74e40dff50 con 0x7f74e40370b0 2024-05-04T02:20:27.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.174+0000 7f74f13c7640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f74e40374c0 con 0x7f74e4038240 2024-05-04T02:20:27.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.174+0000 7f74f13c7640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f74e40e0230 con 0x7f74e40391d0 2024-05-04T02:20:27.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.174+0000 7fb7ee3b3640 1 -- start start 2024-05-04T02:20:27.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.174+0000 7ff49a7fc640 1 -- 172.21.15.1:0/1277264626 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff488037070 con 0x7ff4940dfd80 2024-05-04T02:20:27.181 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.174+0000 7ff49a7fc640 1 -- 172.21.15.1:0/1277264626 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff488032440 con 0x7ff4940dfd80 2024-05-04T02:20:27.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.174+0000 7ff49a7fc640 1 -- 172.21.15.1:0/1277264626 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff488032810 con 0x7ff4940dfd80 2024-05-04T02:20:27.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.174+0000 7f142a51f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f141c047ce0 0x7f141c1756b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.174+0000 7f142a51f640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f141c04da80 0x7f141c0328c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.174+0000 7f142a51f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f141c0df5b0 0x7f141c0cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.174+0000 7f142a51f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f141c04d4a0 con 0x7f141c0df5b0 2024-05-04T02:20:27.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.174+0000 7f142a51f640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f141c047770 con 0x7f141c047ce0 2024-05-04T02:20:27.183 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.174+0000 7f142a51f640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f141c04d620 con 0x7f141c04da80 2024-05-04T02:20:27.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.175+0000 7ff4a0822640 1 -- 172.21.15.1:0/1277264626 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff4940dfd80 msgr2=0x7ff494007220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.175+0000 7ff4a0822640 1 --2- 172.21.15.1:0/1277264626 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff4940dfd80 0x7ff494007220 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff494054700 tx=0x7ff48802a270 comp rx=0 tx=0).stop 2024-05-04T02:20:27.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.175+0000 7ff4a0822640 1 -- 172.21.15.1:0/1277264626 shutdown_connections 2024-05-04T02:20:27.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.175+0000 7ff4a0822640 1 --2- 172.21.15.1:0/1277264626 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff4940dfd80 0x7ff494007220 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.175+0000 7ff4a0822640 1 --2- 172.21.15.1:0/1277264626 >> v2:172.21.15.107:3300/0 conn(0x7ff494050920 0x7ff4940d9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.175+0000 7ff4a0822640 1 -- 172.21.15.1:0/1277264626 >> 172.21.15.1:0/1277264626 conn(0x7ff494051220 msgr2=0x7ff494051630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:27.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.175+0000 7ff4a0822640 1 -- 172.21.15.1:0/1277264626 shutdown_connections 2024-05-04T02:20:27.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.175+0000 7ff4a0822640 1 -- 172.21.15.1:0/1277264626 wait complete. 2024-05-04T02:20:27.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.175+0000 7fb7ee3b3640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb7e80c5520 0x7fb7e81f6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.175+0000 7fb7ee3b3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb7e80c7690 0x7fb7e815ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.175+0000 7fb7ee3b3640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb7e815a5a0 0x7fb7e8163560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.175+0000 7fb7ee3b3640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb7e80cdf30 con 0x7fb7e80c7690 2024-05-04T02:20:27.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.175+0000 7fb7ee3b3640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fb7e806edb0 con 0x7fb7e815a5a0 2024-05-04T02:20:27.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.175+0000 7fb7ee3b3640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fb7e8163cb0 con 0x7fb7e80c5520 2024-05-04T02:20:27.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.175+0000 7fdd64f0c640 1 -- 172.21.15.1:0/2147647838 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd5c037070 con 0x7fdd6015a5a0 2024-05-04T02:20:27.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.176+0000 7fdd64f0c640 1 -- 172.21.15.1:0/2147647838 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd5c032440 con 0x7fdd6015a5a0 2024-05-04T02:20:27.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.176+0000 7fdd64f0c640 1 -- 172.21.15.1:0/2147647838 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd5c032810 con 0x7fdd6015a5a0 2024-05-04T02:20:27.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.176+0000 7efc6bfff640 1 -- 172.21.15.1:0/709042522 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc54004800 msgr2=0x7efc54004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:27.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.176+0000 7efc6bfff640 1 --2- 172.21.15.1:0/709042522 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc54004800 0x7efc54004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.186 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.176+0000 7efc6bfff640 1 -- 172.21.15.1:0/709042522 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc54005350 msgr2=0x7efc5400dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:27.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.176+0000 7efc6bfff640 1 --2- 172.21.15.1:0/709042522 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc54005350 0x7efc5400dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.176+0000 7efc70cd9640 1 -- 172.21.15.1:0/709042522 reap_dead start 2024-05-04T02:20:27.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.176+0000 7efc6bfff640 1 -- 172.21.15.1:0/709042522 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc6c073ec0 con 0x7efc54003ae0 2024-05-04T02:20:27.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.176+0000 7fdd66f10640 1 -- 172.21.15.1:0/2147647838 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdd6015a5a0 msgr2=0x7fdd6015a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.176+0000 7fdd66f10640 1 --2- 172.21.15.1:0/2147647838 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdd6015a5a0 0x7fdd6015a9b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c009870 tx=0x7fdd5c02a1c0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.177+0000 7fdd66f10640 1 -- 172.21.15.1:0/2147647838 shutdown_connections 2024-05-04T02:20:27.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.177+0000 7fdd66f10640 1 --2- 172.21.15.1:0/2147647838 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdd6015a5a0 0x7fdd6015a9b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.177+0000 7fdd66f10640 1 -- 172.21.15.1:0/2147647838 >> 172.21.15.1:0/2147647838 conn(0x7fdd600cd410 msgr2=0x7fdd600cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:27.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.177+0000 7fdd66f10640 1 -- 172.21.15.1:0/2147647838 shutdown_connections 2024-05-04T02:20:27.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.177+0000 7fdd66f10640 1 -- 172.21.15.1:0/2147647838 wait complete. 2024-05-04T02:20:27.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.177+0000 7ff4a0822640 1 Processor -- start 2024-05-04T02:20:27.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.177+0000 7ff4a0822640 1 -- start start 2024-05-04T02:20:27.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.179+0000 7ff4a0822640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff49404fc00 0x7ff4940cd460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.179+0000 7ff4a0822640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff494050920 0x7ff494179620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.180+0000 7ff4a0822640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff4940dfd80 0x7ff4940d43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.180+0000 7fdd66f10640 1 Processor -- start 2024-05-04T02:20:27.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.180+0000 7ff4a0822640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff494006a20 con 0x7ff494050920 2024-05-04T02:20:27.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.180+0000 7fdd66f10640 1 -- start start 2024-05-04T02:20:27.190 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.180+0000 7ff4a0822640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff494006740 con 0x7ff4940dfd80 2024-05-04T02:20:27.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.180+0000 7ff4a0822640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff4940373e0 con 0x7ff49404fc00 2024-05-04T02:20:27.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.180+0000 7f74ebfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74e40370b0 0x7f74e40d5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:27.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.181+0000 7fa44effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa448045e60 0x7fa4480da480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:27.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.181+0000 7efc6bfff640 1 --2- 172.21.15.1:0/709042522 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efc54003ae0 0x7efc54003f50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7efc60001640 tx=0x7efc54005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aed423b6179b3521 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:27.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.181+0000 7f74f0bc6640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f74e40391d0 0x7f74e40de540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:27.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.181+0000 7fdd66f10640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdd600c5520 0x7fdd601f7350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.181+0000 7fdd66f10640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdd600c7690 0x7fdd6014c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.181+0000 7fdd66f10640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdd6015a5a0 0x7fdd60151ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.181+0000 7f74ebfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74e40370b0 0x7f74e40d5840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41504/0 (socket says 172.21.15.1:41504) 2024-05-04T02:20:27.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.181+0000 7f74ebfff640 1 -- 172.21.15.1:0/3808032452 learned_addr learned my addr 172.21.15.1:0/3808032452 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:27.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.181+0000 7fdd66f10640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fdd600c5000 con 0x7fdd6015a5a0 2024-05-04T02:20:27.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.181+0000 7fdd66f10640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fdd600c8640 con 0x7fdd600c7690 2024-05-04T02:20:27.193 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.181+0000 7fdd66f10640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fdd6006edb0 con 0x7fdd600c5520 2024-05-04T02:20:27.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.182+0000 7fa44effd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa448045e60 0x7fa4480da480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41488/0 (socket says 172.21.15.1:41488) 2024-05-04T02:20:27.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.182+0000 7fa44effd640 1 -- 172.21.15.1:0/295896094 learned_addr learned my addr 172.21.15.1:0/295896094 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:27.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.183+0000 7fa44ffff640 1 --2- 172.21.15.1:0/295896094 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa448050ec0 0x7fa4480c6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:27.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.183+0000 7fa44f7fe640 1 --2- 172.21.15.1:0/295896094 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4480334d0 0x7fa4480c4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:27.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.184+0000 7f74eb7fe640 1 --2- 172.21.15.1:0/3808032452 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74e4038240 0x7f74e40d7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:27.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.184+0000 7f1428abc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f141c0df5b0 0x7f141c0cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:27.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.188+0000 7f74ebfff640 1 -- 172.21.15.1:0/3808032452 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f74e40391d0 msgr2=0x7f74e40de540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.188+0000 7f74ebfff640 1 --2- 172.21.15.1:0/3808032452 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f74e40391d0 0x7f74e40de540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.188+0000 7f74ebfff640 1 -- 172.21.15.1:0/3808032452 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74e4038240 msgr2=0x7f74e40d7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.188+0000 7f74ebfff640 1 --2- 172.21.15.1:0/3808032452 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f74e4038240 0x7f74e40d7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.188+0000 7f74ebfff640 1 -- 172.21.15.1:0/3808032452 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74e40def10 con 0x7f74e40370b0 2024-05-04T02:20:27.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.188+0000 7efc6affd640 1 -- 172.21.15.1:0/709042522 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc60001240 con 0x7efc54003ae0 2024-05-04T02:20:27.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.188+0000 7efc6affd640 1 -- 172.21.15.1:0/709042522 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc6002e070 con 0x7efc54003ae0 2024-05-04T02:20:27.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.188+0000 7efc6affd640 1 -- 172.21.15.1:0/709042522 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc6002a7d0 con 0x7efc54003ae0 2024-05-04T02:20:27.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.189+0000 7efc714da640 1 -- 172.21.15.1:0/709042522 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efc54003ae0 msgr2=0x7efc54003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.189+0000 7efc714da640 1 --2- 172.21.15.1:0/709042522 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efc54003ae0 0x7efc54003f50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7efc60001640 tx=0x7efc54005830 comp rx=0 tx=0).stop 2024-05-04T02:20:27.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.189+0000 7efc714da640 1 -- 172.21.15.1:0/709042522 shutdown_connections 2024-05-04T02:20:27.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.189+0000 7efc714da640 1 --2- 172.21.15.1:0/709042522 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efc54003ae0 0x7efc54003f50 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.189+0000 7efc714da640 1 -- 172.21.15.1:0/709042522 >> 172.21.15.1:0/709042522 conn(0x7efc6c0c9e10 msgr2=0x7efc6c0ca220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:27.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.189+0000 7efc714da640 1 -- 172.21.15.1:0/709042522 shutdown_connections 2024-05-04T02:20:27.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.189+0000 7efc714da640 1 -- 172.21.15.1:0/709042522 wait complete. 2024-05-04T02:20:27.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.190+0000 7f1428abc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f141c0df5b0 0x7f141c0cf1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41508/0 (socket says 172.21.15.1:41508) 2024-05-04T02:20:27.197 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.190+0000 7f1428abc640 1 -- 172.21.15.1:0/1690401554 learned_addr learned my addr 172.21.15.1:0/1690401554 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:27.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.191+0000 7efc714da640 1 Processor -- start 2024-05-04T02:20:27.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.191+0000 7efc714da640 1 -- start start 2024-05-04T02:20:27.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.192+0000 7efc714da640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efc54003ae0 0x7efc6c14dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.192+0000 7efc714da640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc6c1f56e0 0x7efc6c14e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.192+0000 7efc714da640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc6c1e4b40 0x7efc6c155230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.192+0000 7efc714da640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7efc6c074480 con 0x7efc6c1f56e0 2024-05-04T02:20:27.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.192+0000 7efc714da640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7efc6c158680 con 0x7efc6c1e4b40 2024-05-04T02:20:27.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.192+0000 7efc714da640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7efc6c073b60 con 0x7efc54003ae0 2024-05-04T02:20:27.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.193+0000 7fa44ffff640 1 -- 172.21.15.1:0/295896094 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4480334d0 msgr2=0x7fa4480c4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.193+0000 7fa44ffff640 1 --2- 172.21.15.1:0/295896094 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa4480334d0 0x7fa4480c4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.193+0000 7fa44ffff640 1 -- 172.21.15.1:0/295896094 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa448045e60 msgr2=0x7fa4480da480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.193+0000 7fa44ffff640 1 --2- 172.21.15.1:0/295896094 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa448045e60 0x7fa4480da480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.193+0000 7fa44ffff640 1 -- 172.21.15.1:0/295896094 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4480da9c0 con 0x7fa448050ec0 2024-05-04T02:20:27.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.193+0000 7fa44effd640 1 --2- 172.21.15.1:0/295896094 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa448045e60 0x7fa4480da480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-04T02:20:27.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.196+0000 7f74ebfff640 1 --2- 172.21.15.1:0/3808032452 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74e40370b0 0x7f74e40d5840 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f74ec051620 tx=0x7f74ec06a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:27.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.199+0000 7f22abfff640 1 -- 172.21.15.1:0/2096758028 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b0037070 con 0x7f22ac04c900 2024-05-04T02:20:27.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.199+0000 7f22abfff640 1 -- 172.21.15.1:0/2096758028 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22b0032440 con 0x7f22ac04c900 2024-05-04T02:20:27.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.199+0000 7f22abfff640 1 -- 172.21.15.1:0/2096758028 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b0032850 con 0x7f22ac04c900 2024-05-04T02:20:27.201 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.199+0000 7fb7ecbb0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb7e80c7690 0x7fb7e815ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:27.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.200+0000 7f22ba558640 1 -- 172.21.15.1:0/2096758028 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22ac04c900 msgr2=0x7f22ac046ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.200+0000 7f22ba558640 1 --2- 172.21.15.1:0/2096758028 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22ac04c900 0x7f22ac046ea0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f22b00097a0 tx=0x7f22b002a1a0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.200+0000 7f22ba558640 1 -- 172.21.15.1:0/2096758028 shutdown_connections 2024-05-04T02:20:27.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.200+0000 7f22ba558640 1 --2- 172.21.15.1:0/2096758028 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22ac04c900 0x7f22ac046ea0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.200+0000 7f22ba558640 1 --2- 172.21.15.1:0/2096758028 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f22ac045ce0 0x7f22ac045350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.200+0000 7f22ba558640 1 -- 172.21.15.1:0/2096758028 >> 172.21.15.1:0/2096758028 conn(0x7f22ac0503b0 msgr2=0x7f22ac0507c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:27.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.200+0000 7ff49bfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff4940dfd80 0x7ff4940d43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:27.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.200+0000 7f22ba558640 1 -- 172.21.15.1:0/2096758028 shutdown_connections 2024-05-04T02:20:27.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.200+0000 7f22ba558640 1 -- 172.21.15.1:0/2096758028 wait complete. 2024-05-04T02:20:27.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.200+0000 7f1423fff640 1 --2- 172.21.15.1:0/1690401554 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f141c047ce0 0x7f141c1756b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:27.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.200+0000 7fb7edbb2640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb7e815a5a0 0x7fb7e8163560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:27.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.201+0000 7fb7ecbb0640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb7e80c7690 0x7fb7e815ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41514/0 (socket says 172.21.15.1:41514) 2024-05-04T02:20:27.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.201+0000 7fb7ecbb0640 1 -- 172.21.15.1:0/4107978426 learned_addr learned my addr 172.21.15.1:0/4107978426 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:27.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.202+0000 7fb7ed3b1640 1 --2- 172.21.15.1:0/4107978426 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb7e80c5520 0x7fb7e81f6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:27.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.202+0000 7f22ba558640 1 Processor -- start 2024-05-04T02:20:27.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.202+0000 7f22ba558640 1 -- start start 2024-05-04T02:20:27.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.203+0000 7fa44ffff640 1 --2- 172.21.15.1:0/295896094 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa448050ec0 0x7fa4480c6b80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa43c00afd0 tx=0x7fa43c00c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:27.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.203+0000 7ff49bfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff4940dfd80 0x7ff4940d43a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.1:47168/0 (socket says 172.21.15.1:47168) 2024-05-04T02:20:27.205 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.203+0000 7ff49bfff640 1 -- 172.21.15.1:0/2030209725 learned_addr learned my addr 172.21.15.1:0/2030209725 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:27.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.203+0000 7f22ba558640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f22ac0062c0 0x7f22ac0dfde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.203+0000 7f22ba558640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22ac045ce0 0x7f22ac048ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.203+0000 7f22ba558640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22ac04c900 0x7f22ac049430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.206 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.203+0000 7f22ba558640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f22ac0342d0 con 0x7f22ac045ce0 2024-05-04T02:20:27.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.203+0000 7f22ba558640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f22ac046980 con 0x7f22ac04c900 2024-05-04T02:20:27.207 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.204+0000 7f22ba558640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f22ac0da8f0 con 0x7f22ac0062c0 2024-05-04T02:20:27.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.206+0000 7fb7ecbb0640 1 -- 172.21.15.1:0/4107978426 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb7e80c5520 msgr2=0x7fb7e81f6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.206+0000 7f1423fff640 1 -- 172.21.15.1:0/1690401554 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f141c04da80 msgr2=0x7f141c0328c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.206+0000 7f1423fff640 1 --2- 172.21.15.1:0/1690401554 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f141c04da80 0x7f141c0328c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.206+0000 7f1423fff640 1 -- 172.21.15.1:0/1690401554 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f141c0df5b0 msgr2=0x7f141c0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.206+0000 7f1423fff640 1 --2- 172.21.15.1:0/1690401554 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f141c0df5b0 0x7f141c0cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.208 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.206+0000 7f1423fff640 1 -- 172.21.15.1:0/1690401554 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f141c032e00 con 0x7f141c047ce0 2024-05-04T02:20:27.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.206+0000 7fb7ecbb0640 1 --2- 172.21.15.1:0/4107978426 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb7e80c5520 0x7fb7e81f6fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.206+0000 7fb7ecbb0640 1 -- 172.21.15.1:0/4107978426 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb7e815a5a0 msgr2=0x7fb7e8163560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.206+0000 7fb7ecbb0640 1 --2- 172.21.15.1:0/4107978426 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb7e815a5a0 0x7fb7e8163560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.206+0000 7fb7ecbb0640 1 -- 172.21.15.1:0/4107978426 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7e8162dd0 con 0x7fb7e80c7690 2024-05-04T02:20:27.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.209+0000 7fdd6570d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdd600c7690 0x7fdd6014c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:27.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.210+0000 7ff49b7fe640 1 --2- 172.21.15.1:0/2030209725 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff49404fc00 0x7ff4940cd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:27.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.212+0000 7fdd6570d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdd600c7690 0x7fdd6014c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.1:47172/0 (socket says 172.21.15.1:47172) 2024-05-04T02:20:27.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.212+0000 7fdd6570d640 1 -- 172.21.15.1:0/701455268 learned_addr learned my addr 172.21.15.1:0/701455268 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:27.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.214+0000 7f74e8ff9640 1 -- 172.21.15.1:0/3808032452 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74ec095420 con 0x7f74e40370b0 2024-05-04T02:20:27.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.214+0000 7f74e8ff9640 1 -- 172.21.15.1:0/3808032452 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74ec090030 con 0x7f74e40370b0 2024-05-04T02:20:27.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.214+0000 7f74e8ff9640 1 -- 172.21.15.1:0/3808032452 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74ec095640 con 0x7f74e40370b0 2024-05-04T02:20:27.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.214+0000 7f74f13c7640 1 -- 172.21.15.1:0/3808032452 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74e41759c0 con 0x7f74e40370b0 2024-05-04T02:20:27.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.214+0000 7f74f13c7640 1 -- 172.21.15.1:0/3808032452 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74e4175f80 con 0x7f74e40370b0 2024-05-04T02:20:27.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.215+0000 7f74f13c7640 1 -- 172.21.15.1:0/3808032452 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f74e40054a0 con 0x7f74e40370b0 2024-05-04T02:20:27.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.215+0000 7ff49affd640 1 --2- 172.21.15.1:0/2030209725 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff494050920 0x7ff494179620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:27.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.216+0000 7efc6b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc6c1f56e0 0x7efc6c14e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:27.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.216+0000 7fb7ecbb0640 1 --2- 172.21.15.1:0/4107978426 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb7e80c7690 0x7fb7e815ac50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb7e000b9c0 tx=0x7fb7e000be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:27.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.216+0000 7ff49bfff640 1 -- 172.21.15.1:0/2030209725 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff49404fc00 msgr2=0x7ff4940cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.216+0000 7ff49bfff640 1 --2- 172.21.15.1:0/2030209725 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff49404fc00 0x7ff4940cd460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.216+0000 7ff49bfff640 1 -- 172.21.15.1:0/2030209725 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff494050920 msgr2=0x7ff494179620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.216+0000 7ff49bfff640 1 --2- 172.21.15.1:0/2030209725 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff494050920 0x7ff494179620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.216+0000 7ff49bfff640 1 -- 172.21.15.1:0/2030209725 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4940cd9a0 con 0x7ff4940dfd80 2024-05-04T02:20:27.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.219+0000 7efc70cd9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc6c1e4b40 0x7efc6c155230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:27.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.220+0000 7fdd6670f640 1 --2- 172.21.15.1:0/701455268 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdd6015a5a0 0x7fdd60151ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:27.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.220+0000 7efc6b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc6c1f56e0 0x7efc6c14e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41534/0 (socket says 172.21.15.1:41534) 2024-05-04T02:20:27.222 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.220+0000 7efc6b7fe640 1 -- 172.21.15.1:0/1518946167 learned_addr learned my addr 172.21.15.1:0/1518946167 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:27.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.223+0000 7fdd65f0e640 1 --2- 172.21.15.1:0/701455268 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdd600c5520 0x7fdd601f7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:27.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.224+0000 7fdd6570d640 1 -- 172.21.15.1:0/701455268 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdd600c5520 msgr2=0x7fdd601f7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.224+0000 7fdd6570d640 1 --2- 172.21.15.1:0/701455268 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fdd600c5520 0x7fdd601f7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.224+0000 7fdd6570d640 1 -- 172.21.15.1:0/701455268 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdd6015a5a0 msgr2=0x7fdd60151ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.224+0000 7fdd6570d640 1 --2- 172.21.15.1:0/701455268 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fdd6015a5a0 0x7fdd60151ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.224+0000 7fdd6570d640 1 -- 172.21.15.1:0/701455268 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd601f7890 con 0x7fdd600c7690 2024-05-04T02:20:27.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.225+0000 7f22b9556640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f22ac0062c0 0x7f22ac0dfde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:27.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.228+0000 7efc6b7fe640 1 -- 172.21.15.1:0/1518946167 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efc54003ae0 msgr2=0x7efc6c14dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.228+0000 7efc6b7fe640 1 --2- 172.21.15.1:0/1518946167 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7efc54003ae0 0x7efc6c14dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.228+0000 7efc6b7fe640 1 -- 172.21.15.1:0/1518946167 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc6c1e4b40 msgr2=0x7efc6c155230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.228+0000 7efc6b7fe640 1 --2- 172.21.15.1:0/1518946167 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efc6c1e4b40 0x7efc6c155230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.228+0000 7efc6b7fe640 1 -- 172.21.15.1:0/1518946167 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc6c1e53f0 con 0x7efc6c1f56e0 2024-05-04T02:20:27.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.228+0000 7f22b8d55640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22ac045ce0 0x7f22ac048ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:27.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.228+0000 7f22b9556640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f22ac0062c0 0x7f22ac0dfde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.1:49822/0 (socket says 172.21.15.1:49822) 2024-05-04T02:20:27.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.228+0000 7f22b9556640 1 -- 172.21.15.1:0/1623302821 learned_addr learned my addr 172.21.15.1:0/1623302821 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:27.231 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.229+0000 7f1423fff640 1 --2- 172.21.15.1:0/1690401554 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f141c047ce0 0x7f141c1756b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1418034000 tx=0x7f1418004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:27.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.230+0000 7ff49bfff640 1 --2- 172.21.15.1:0/2030209725 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff4940dfd80 0x7ff4940d43a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff49c077db0 tx=0x7ff49c06a480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:27.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.232+0000 7fa43bfff640 1 -- 172.21.15.1:0/295896094 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa43c015070 con 0x7fa448050ec0 2024-05-04T02:20:27.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.233+0000 7fa43bfff640 1 -- 172.21.15.1:0/295896094 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa43c004240 con 0x7fa448050ec0 2024-05-04T02:20:27.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.233+0000 7fa45483d640 1 -- 172.21.15.1:0/295896094 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4480d93e0 con 0x7fa448050ec0 2024-05-04T02:20:27.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.233+0000 7fa43bfff640 1 -- 172.21.15.1:0/295896094 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa43c003610 con 0x7fa448050ec0 2024-05-04T02:20:27.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.233+0000 7fa45483d640 1 -- 172.21.15.1:0/295896094 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4480d96c0 con 0x7fa448050ec0 2024-05-04T02:20:27.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.233+0000 7fdd6570d640 1 --2- 172.21.15.1:0/701455268 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdd600c7690 0x7fdd6014c7d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdd5800b9e0 tx=0x7fdd5800bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:27.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.234+0000 7fa45483d640 1 -- 172.21.15.1:0/295896094 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa448005490 con 0x7fa448050ec0 2024-05-04T02:20:27.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.234+0000 7f22b9d57640 1 --2- 172.21.15.1:0/1623302821 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22ac04c900 0x7f22ac049430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:27.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.236+0000 7f22b9556640 1 -- 172.21.15.1:0/1623302821 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22ac04c900 msgr2=0x7f22ac049430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.236+0000 7f22b9556640 1 --2- 172.21.15.1:0/1623302821 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f22ac04c900 0x7f22ac049430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.236+0000 7f22b9556640 1 -- 172.21.15.1:0/1623302821 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22ac045ce0 msgr2=0x7f22ac048ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.236+0000 7f22b9556640 1 --2- 172.21.15.1:0/1623302821 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f22ac045ce0 0x7f22ac048ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.236+0000 7f22b9556640 1 -- 172.21.15.1:0/1623302821 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22ac0e0320 con 0x7f22ac0062c0 2024-05-04T02:20:27.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.237+0000 7fb7ddffb640 1 -- 172.21.15.1:0/4107978426 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e0019070 con 0x7fb7e80c7690 2024-05-04T02:20:27.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.237+0000 7fb7ddffb640 1 -- 172.21.15.1:0/4107978426 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7e000cba0 con 0x7fb7e80c7690 2024-05-04T02:20:27.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.237+0000 7fb7ddffb640 1 -- 172.21.15.1:0/4107978426 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e0014440 con 0x7fb7e80c7690 2024-05-04T02:20:27.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.237+0000 7fb7ee3b3640 1 -- 172.21.15.1:0/4107978426 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7e8163aa0 con 0x7fb7e80c7690 2024-05-04T02:20:27.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.238+0000 7fb7ee3b3640 1 -- 172.21.15.1:0/4107978426 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7e81646e0 con 0x7fb7e80c7690 2024-05-04T02:20:27.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.238+0000 7efc6b7fe640 1 --2- 172.21.15.1:0/1518946167 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc6c1f56e0 0x7efc6c14e190 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efc5c007340 tx=0x7efc5c007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:27.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.238+0000 7fb7ee3b3640 1 -- 172.21.15.1:0/4107978426 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb7e80699a0 con 0x7fb7e80c7690 2024-05-04T02:20:27.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.243+0000 7efc68ff9640 1 -- 172.21.15.1:0/1518946167 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc5c00fa00 con 0x7efc6c1f56e0 2024-05-04T02:20:27.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.243+0000 7efc68ff9640 1 -- 172.21.15.1:0/1518946167 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc5c018070 con 0x7efc6c1f56e0 2024-05-04T02:20:27.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.243+0000 7efc714da640 1 -- 172.21.15.1:0/1518946167 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc6c154370 con 0x7efc6c1f56e0 2024-05-04T02:20:27.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.243+0000 7efc68ff9640 1 -- 172.21.15.1:0/1518946167 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc5c00fdc0 con 0x7efc6c1f56e0 2024-05-04T02:20:27.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.243+0000 7efc714da640 1 -- 172.21.15.1:0/1518946167 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc6c153890 con 0x7efc6c1f56e0 2024-05-04T02:20:27.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.244+0000 7efc714da640 1 -- 172.21.15.1:0/1518946167 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7efc4c001030 con 0x7efc6c1f56e0 2024-05-04T02:20:27.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.245+0000 7fdd567fc640 1 -- 172.21.15.1:0/701455268 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd58019070 con 0x7fdd600c7690 2024-05-04T02:20:27.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.245+0000 7fdd567fc640 1 -- 172.21.15.1:0/701455268 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd5800cba0 con 0x7fdd600c7690 2024-05-04T02:20:27.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.245+0000 7fdd66f10640 1 -- 172.21.15.1:0/701455268 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd60152aa0 con 0x7fdd600c7690 2024-05-04T02:20:27.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.246+0000 7fdd567fc640 1 -- 172.21.15.1:0/701455268 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd58014440 con 0x7fdd600c7690 2024-05-04T02:20:27.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.246+0000 7fdd66f10640 1 -- 172.21.15.1:0/701455268 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd60152d60 con 0x7fdd600c7690 2024-05-04T02:20:27.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.246+0000 7fdd66f10640 1 -- 172.21.15.1:0/701455268 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdd600699a0 con 0x7fdd600c7690 2024-05-04T02:20:27.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.248+0000 7ff487fff640 1 -- 172.21.15.1:0/2030209725 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff49c06ee30 con 0x7ff4940dfd80 2024-05-04T02:20:27.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.248+0000 7ff487fff640 1 -- 172.21.15.1:0/2030209725 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff49c090030 con 0x7ff4940dfd80 2024-05-04T02:20:27.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.248+0000 7ff4a0822640 1 -- 172.21.15.1:0/2030209725 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff494179b60 con 0x7ff4940dfd80 2024-05-04T02:20:27.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.248+0000 7ff487fff640 1 -- 172.21.15.1:0/2030209725 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff49c095420 con 0x7ff4940dfd80 2024-05-04T02:20:27.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.248+0000 7ff4a0822640 1 -- 172.21.15.1:0/2030209725 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4940dae00 con 0x7ff4940dfd80 2024-05-04T02:20:27.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.248+0000 7f1420ff9640 1 -- 172.21.15.1:0/1690401554 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1418043070 con 0x7f141c047ce0 2024-05-04T02:20:27.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.248+0000 7f1420ff9640 1 -- 172.21.15.1:0/1690401554 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f141803c850 con 0x7f141c047ce0 2024-05-04T02:20:27.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.248+0000 7f1420ff9640 1 -- 172.21.15.1:0/1690401554 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1418032e60 con 0x7f141c047ce0 2024-05-04T02:20:27.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.248+0000 7f142a51f640 1 -- 172.21.15.1:0/1690401554 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f141c0cf720 con 0x7f141c047ce0 2024-05-04T02:20:27.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.249+0000 7f142a51f640 1 -- 172.21.15.1:0/1690401554 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f141c1760b0 con 0x7f141c047ce0 2024-05-04T02:20:27.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.249+0000 7ff4a0822640 1 -- 172.21.15.1:0/2030209725 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff4940054a0 con 0x7ff4940dfd80 2024-05-04T02:20:27.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.249+0000 7f142a51f640 1 -- 172.21.15.1:0/1690401554 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f141c005920 con 0x7f141c047ce0 2024-05-04T02:20:27.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.251+0000 7f22b9556640 1 --2- 172.21.15.1:0/1623302821 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f22ac0062c0 0x7f22ac0dfde0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f22a400e7d0 tx=0x7f22a400ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:27.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.270+0000 7fa43bfff640 1 -- 172.21.15.1:0/295896094 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa43c0037b0 con 0x7fa448050ec0 2024-05-04T02:20:27.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.270+0000 7fa43bfff640 1 --2- 172.21.15.1:0/295896094 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fa434076350 0x7fa434078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.271+0000 7fa44f7fe640 1 --2- 172.21.15.1:0/295896094 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fa434076350 0x7fa434078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:27.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.271+0000 7fa44f7fe640 1 --2- 172.21.15.1:0/295896094 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fa434076350 0x7fa434078860 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa4480351a0 tx=0x7fa450070030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:27.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.274+0000 7fa43bfff640 1 -- 172.21.15.1:0/295896094 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fa43c05cc30 con 0x7fa448050ec0 2024-05-04T02:20:27.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.275+0000 7fa43bfff640 1 --2- 172.21.15.1:0/295896094 >> [v2:172.21.15.107:6826/1723298539,v1:172.21.15.107:6827/1723298539] conn(0x7fa43407e5a0 0x7fa4340809f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.275+0000 7fa43bfff640 1 -- 172.21.15.1:0/295896094 --> [v2:172.21.15.107:6826/1723298539,v1:172.21.15.107:6827/1723298539] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa43c012e50 con 0x7fa43407e5a0 2024-05-04T02:20:27.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.275+0000 7fa44effd640 1 --2- 172.21.15.1:0/295896094 >> [v2:172.21.15.107:6826/1723298539,v1:172.21.15.107:6827/1723298539] conn(0x7fa43407e5a0 0x7fa4340809f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:27.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.275+0000 7fa44effd640 1 --2- 172.21.15.1:0/295896094 >> [v2:172.21.15.107:6826/1723298539,v1:172.21.15.107:6827/1723298539] conn(0x7fa43407e5a0 0x7fa4340809f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:27.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.275+0000 7fa43bfff640 1 -- 172.21.15.1:0/295896094 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fa43c05cff0 con 0x7fa448050ec0 2024-05-04T02:20:27.278 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.276+0000 7fa43bfff640 1 -- 172.21.15.1:0/295896094 <== osd.7 v2:172.21.15.107:6826/1723298539 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa43c012e50 con 0x7fa43407e5a0 2024-05-04T02:20:27.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.281+0000 7f22a9ffb640 1 -- 172.21.15.1:0/1623302821 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22a4017070 con 0x7f22ac0062c0 2024-05-04T02:20:27.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.281+0000 7f22a9ffb640 1 -- 172.21.15.1:0/1623302821 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22a400c940 con 0x7f22ac0062c0 2024-05-04T02:20:27.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.281+0000 7f22ba558640 1 -- 172.21.15.1:0/1623302821 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22ac0defd0 con 0x7f22ac0062c0 2024-05-04T02:20:27.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.281+0000 7f22a9ffb640 1 -- 172.21.15.1:0/1623302821 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22a400cd30 con 0x7f22ac0062c0 2024-05-04T02:20:27.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.281+0000 7f22ba558640 1 -- 172.21.15.1:0/1623302821 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f22ac0df590 con 0x7f22ac0062c0 2024-05-04T02:20:27.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.282+0000 7f22ba558640 1 -- 172.21.15.1:0/1623302821 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f22ac0ded80 con 0x7f22ac0062c0 2024-05-04T02:20:27.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.287+0000 7ff487fff640 1 -- 172.21.15.1:0/2030209725 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff49c0943d0 con 0x7ff4940dfd80 2024-05-04T02:20:27.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.287+0000 7ff487fff640 1 --2- 172.21.15.1:0/2030209725 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7ff480076350 0x7ff480078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.287+0000 7ff49b7fe640 1 --2- 172.21.15.1:0/2030209725 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7ff480076350 0x7ff480078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:27.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.288+0000 7ff49b7fe640 1 --2- 172.21.15.1:0/2030209725 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7ff480076350 0x7ff480078860 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff4900098e0 tx=0x7ff490009060 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:27.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.292+0000 7fa45483d640 1 -- 172.21.15.1:0/295896094 --> [v2:172.21.15.107:6826/1723298539,v1:172.21.15.107:6827/1723298539] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa4480d49f0 con 0x7fa43407e5a0 2024-05-04T02:20:27.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.292+0000 7fa43bfff640 1 -- 172.21.15.1:0/295896094 <== osd.7 v2:172.21.15.107:6826/1723298539 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa4480d49f0 con 0x7fa43407e5a0 2024-05-04T02:20:27.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.293+0000 7fa45483d640 1 -- 172.21.15.1:0/295896094 >> [v2:172.21.15.107:6826/1723298539,v1:172.21.15.107:6827/1723298539] conn(0x7fa43407e5a0 msgr2=0x7fa4340809f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.293+0000 7fa45483d640 1 --2- 172.21.15.1:0/295896094 >> [v2:172.21.15.107:6826/1723298539,v1:172.21.15.107:6827/1723298539] conn(0x7fa43407e5a0 0x7fa4340809f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.293+0000 7fa45483d640 1 -- 172.21.15.1:0/295896094 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fa434076350 msgr2=0x7fa434078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.293+0000 7fa45483d640 1 --2- 172.21.15.1:0/295896094 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fa434076350 0x7fa434078860 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa4480351a0 tx=0x7fa450070030 comp rx=0 tx=0).stop 2024-05-04T02:20:27.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.293+0000 7fa45483d640 1 -- 172.21.15.1:0/295896094 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa448050ec0 msgr2=0x7fa4480c6b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.293+0000 7fa45483d640 1 --2- 172.21.15.1:0/295896094 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa448050ec0 0x7fa4480c6b80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa43c00afd0 tx=0x7fa43c00c950 comp rx=0 tx=0).stop 2024-05-04T02:20:27.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.293+0000 7fa44ffff640 1 -- 172.21.15.1:0/295896094 reap_dead start 2024-05-04T02:20:27.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.293+0000 7fa45483d640 1 -- 172.21.15.1:0/295896094 shutdown_connections 2024-05-04T02:20:27.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.293+0000 7fa45483d640 1 -- 172.21.15.1:0/295896094 >> 172.21.15.1:0/295896094 conn(0x7fa4480503a0 msgr2=0x7fa4480d1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:27.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.293+0000 7fa45483d640 1 -- 172.21.15.1:0/295896094 shutdown_connections 2024-05-04T02:20:27.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.293+0000 7fa45483d640 1 -- 172.21.15.1:0/295896094 wait complete. 2024-05-04T02:20:27.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.294+0000 7ff487fff640 1 -- 172.21.15.1:0/2030209725 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7ff49c0d9740 con 0x7ff4940dfd80 2024-05-04T02:20:27.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.295+0000 7ff487fff640 1 --2- 172.21.15.1:0/2030209725 >> [v2:172.21.15.1:6808/3463851105,v1:172.21.15.1:6809/3463851105] conn(0x7ff48007e5a0 0x7ff4800809f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.295+0000 7ff487fff640 1 -- 172.21.15.1:0/2030209725 --> [v2:172.21.15.1:6808/3463851105,v1:172.21.15.1:6809/3463851105] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff4800810c0 con 0x7ff48007e5a0 2024-05-04T02:20:27.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.295+0000 7fb7ddffb640 1 -- 172.21.15.1:0/4107978426 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb7e001c070 con 0x7fb7e80c7690 2024-05-04T02:20:27.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.295+0000 7ff49affd640 1 --2- 172.21.15.1:0/2030209725 >> [v2:172.21.15.1:6808/3463851105,v1:172.21.15.1:6809/3463851105] conn(0x7ff48007e5a0 0x7ff4800809f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:27.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.295+0000 7fb7ddffb640 1 --2- 172.21.15.1:0/4107978426 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fb7cc076300 0x7fb7cc078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.295+0000 7ff49affd640 1 --2- 172.21.15.1:0/2030209725 >> [v2:172.21.15.1:6808/3463851105,v1:172.21.15.1:6809/3463851105] conn(0x7ff48007e5a0 0x7ff4800809f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:27.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.295+0000 7fb7ed3b1640 1 --2- 172.21.15.1:0/4107978426 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fb7cc076300 0x7fb7cc078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:27.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.296+0000 7fb7ed3b1640 1 --2- 172.21.15.1:0/4107978426 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fb7cc076300 0x7fb7cc078810 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb7e4034000 tx=0x7fb7e402e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:27.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.296+0000 7ff487fff640 1 -- 172.21.15.1:0/2030209725 <== osd.2 v2:172.21.15.1:6808/3463851105 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff4800810c0 con 0x7ff48007e5a0 2024-05-04T02:20:27.307 INFO:teuthology.orchestra.run.smithi001.stdout:64424509450 2024-05-04T02:20:27.307 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-04T02:20:27.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.309+0000 7ff487fff640 1 -- 172.21.15.1:0/2030209725 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7ff49c0d9b00 con 0x7ff4940dfd80 2024-05-04T02:20:27.312 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.310+0000 7fdd567fc640 1 -- 172.21.15.1:0/701455268 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fdd5801c070 con 0x7fdd600c7690 2024-05-04T02:20:27.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.310+0000 7fdd567fc640 1 --2- 172.21.15.1:0/701455268 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fdd44076320 0x7fdd44078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.311+0000 7fdd65f0e640 1 --2- 172.21.15.1:0/701455268 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fdd44076320 0x7fdd44078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:27.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.311+0000 7ff4a0822640 1 -- 172.21.15.1:0/2030209725 --> [v2:172.21.15.1:6808/3463851105,v1:172.21.15.1:6809/3463851105] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff49404acc0 con 0x7ff48007e5a0 2024-05-04T02:20:27.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.311+0000 7fdd65f0e640 1 --2- 172.21.15.1:0/701455268 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fdd44076320 0x7fdd44078830 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdd50006fd0 tx=0x7fdd50009060 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:27.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.311+0000 7f22a9ffb640 1 -- 172.21.15.1:0/1623302821 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f22a401a070 con 0x7f22ac0062c0 2024-05-04T02:20:27.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.311+0000 7ff487fff640 1 -- 172.21.15.1:0/2030209725 <== osd.2 v2:172.21.15.1:6808/3463851105 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff49404acc0 con 0x7ff48007e5a0 2024-05-04T02:20:27.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.312+0000 7f22a9ffb640 1 --2- 172.21.15.1:0/1623302821 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f2298076320 0x7f2298078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.312+0000 7ff4a0822640 1 -- 172.21.15.1:0/2030209725 >> [v2:172.21.15.1:6808/3463851105,v1:172.21.15.1:6809/3463851105] conn(0x7ff48007e5a0 msgr2=0x7ff4800809f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.312+0000 7ff4a0822640 1 --2- 172.21.15.1:0/2030209725 >> [v2:172.21.15.1:6808/3463851105,v1:172.21.15.1:6809/3463851105] conn(0x7ff48007e5a0 0x7ff4800809f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.312+0000 7ff4a0822640 1 -- 172.21.15.1:0/2030209725 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7ff480076350 msgr2=0x7ff480078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.312+0000 7ff4a0822640 1 --2- 172.21.15.1:0/2030209725 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7ff480076350 0x7ff480078860 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff4900098e0 tx=0x7ff490009060 comp rx=0 tx=0).stop 2024-05-04T02:20:27.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.312+0000 7ff4a0822640 1 -- 172.21.15.1:0/2030209725 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff4940dfd80 msgr2=0x7ff4940d43a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.312+0000 7ff4a0822640 1 --2- 172.21.15.1:0/2030209725 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff4940dfd80 0x7ff4940d43a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff49c077db0 tx=0x7ff49c06a480 comp rx=0 tx=0).stop 2024-05-04T02:20:27.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.312+0000 7ff49bfff640 1 -- 172.21.15.1:0/2030209725 reap_dead start 2024-05-04T02:20:27.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.312+0000 7f22b8d55640 1 --2- 172.21.15.1:0/1623302821 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f2298076320 0x7f2298078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:27.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.312+0000 7ff4a0822640 1 -- 172.21.15.1:0/2030209725 shutdown_connections 2024-05-04T02:20:27.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.312+0000 7ff4a0822640 1 -- 172.21.15.1:0/2030209725 >> 172.21.15.1:0/2030209725 conn(0x7ff494051220 msgr2=0x7ff494039670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:27.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.312+0000 7ff4a0822640 1 -- 172.21.15.1:0/2030209725 shutdown_connections 2024-05-04T02:20:27.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.312+0000 7ff4a0822640 1 -- 172.21.15.1:0/2030209725 wait complete. 2024-05-04T02:20:27.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.312+0000 7f22b8d55640 1 --2- 172.21.15.1:0/1623302821 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f2298076320 0x7f2298078830 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f22b0034000 tx=0x7f22b002e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:27.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.315+0000 7f22a9ffb640 1 -- 172.21.15.1:0/1623302821 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f22a405d2a0 con 0x7f22ac0062c0 2024-05-04T02:20:27.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.315+0000 7f22a9ffb640 1 --2- 172.21.15.1:0/1623302821 >> [v2:172.21.15.1:6800/2338132980,v1:172.21.15.1:6801/2338132980] conn(0x7f229807e570 0x7f22980809c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.315+0000 7f22a9ffb640 1 -- 172.21.15.1:0/1623302821 --> [v2:172.21.15.1:6800/2338132980,v1:172.21.15.1:6801/2338132980] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f22a4016ec0 con 0x7f229807e570 2024-05-04T02:20:27.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.315+0000 7f22b9d57640 1 --2- 172.21.15.1:0/1623302821 >> [v2:172.21.15.1:6800/2338132980,v1:172.21.15.1:6801/2338132980] conn(0x7f229807e570 0x7f22980809c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:27.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.315+0000 7f22b9d57640 1 --2- 172.21.15.1:0/1623302821 >> [v2:172.21.15.1:6800/2338132980,v1:172.21.15.1:6801/2338132980] conn(0x7f229807e570 0x7f22980809c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:27.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.315+0000 7fdd567fc640 1 -- 172.21.15.1:0/701455268 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fdd5805d3e0 con 0x7fdd600c7690 2024-05-04T02:20:27.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.316+0000 7fdd567fc640 1 --2- 172.21.15.1:0/701455268 >> [v2:172.21.15.1:6816/459131368,v1:172.21.15.1:6817/459131368] conn(0x7fdd4407e570 0x7fdd440809c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.316+0000 7fdd567fc640 1 -- 172.21.15.1:0/701455268 --> [v2:172.21.15.1:6816/459131368,v1:172.21.15.1:6817/459131368] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdd58018ec0 con 0x7fdd4407e570 2024-05-04T02:20:27.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.316+0000 7fdd567fc640 1 -- 172.21.15.1:0/701455268 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fdd5805d7a0 con 0x7fdd600c7690 2024-05-04T02:20:27.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.316+0000 7fdd6670f640 1 --2- 172.21.15.1:0/701455268 >> [v2:172.21.15.1:6816/459131368,v1:172.21.15.1:6817/459131368] conn(0x7fdd4407e570 0x7fdd440809c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:27.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.316+0000 7fdd6670f640 1 --2- 172.21.15.1:0/701455268 >> [v2:172.21.15.1:6816/459131368,v1:172.21.15.1:6817/459131368] conn(0x7fdd4407e570 0x7fdd440809c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:27.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.317+0000 7f22a9ffb640 1 -- 172.21.15.1:0/1623302821 <== osd.0 v2:172.21.15.1:6800/2338132980 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f22a4016ec0 con 0x7f229807e570 2024-05-04T02:20:27.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.317+0000 7f74e8ff9640 1 -- 172.21.15.1:0/3808032452 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f74ec09e3e0 con 0x7f74e40370b0 2024-05-04T02:20:27.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.317+0000 7f74e8ff9640 1 --2- 172.21.15.1:0/3808032452 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f74d0076350 0x7f74d0078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.318+0000 7fdd567fc640 1 -- 172.21.15.1:0/701455268 <== osd.1 v2:172.21.15.1:6816/459131368 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdd58018ec0 con 0x7fdd4407e570 2024-05-04T02:20:27.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.318+0000 7f74eb7fe640 1 --2- 172.21.15.1:0/3808032452 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f74d0076350 0x7f74d0078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:27.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.318+0000 7f74eb7fe640 1 --2- 172.21.15.1:0/3808032452 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f74d0076350 0x7f74d0078860 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f74d8009960 tx=0x7f74d8009060 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:27.330 INFO:teuthology.orchestra.run.smithi001.stdout:64424509450 2024-05-04T02:20:27.330 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-04T02:20:27.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.329+0000 7fb7ddffb640 1 -- 172.21.15.1:0/4107978426 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fb7e0096000 con 0x7fb7e80c7690 2024-05-04T02:20:27.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.329+0000 7fb7ddffb640 1 --2- 172.21.15.1:0/4107978426 >> [v2:172.21.15.107:6818/1274544305,v1:172.21.15.107:6819/1274544305] conn(0x7fb7cc07e4f0 0x7fb7cc080940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.329+0000 7fb7ddffb640 1 -- 172.21.15.1:0/4107978426 --> [v2:172.21.15.107:6818/1274544305,v1:172.21.15.107:6819/1274544305] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb7e0015e50 con 0x7fb7cc07e4f0 2024-05-04T02:20:27.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.329+0000 7fb7ddffb640 1 -- 172.21.15.1:0/4107978426 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fb7e005d320 con 0x7fb7e80c7690 2024-05-04T02:20:27.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.330+0000 7fb7edbb2640 1 --2- 172.21.15.1:0/4107978426 >> [v2:172.21.15.107:6818/1274544305,v1:172.21.15.107:6819/1274544305] conn(0x7fb7cc07e4f0 0x7fb7cc080940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:27.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.330+0000 7fb7edbb2640 1 --2- 172.21.15.1:0/4107978426 >> [v2:172.21.15.107:6818/1274544305,v1:172.21.15.107:6819/1274544305] conn(0x7fb7cc07e4f0 0x7fb7cc080940 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:27.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.330+0000 7f74e8ff9640 1 -- 172.21.15.1:0/3808032452 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f74ec0d9790 con 0x7f74e40370b0 2024-05-04T02:20:27.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.331+0000 7f74e8ff9640 1 --2- 172.21.15.1:0/3808032452 >> [v2:172.21.15.107:6809/941385299,v1:172.21.15.107:6811/941385299] conn(0x7f74d007e5a0 0x7f74d00809f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.331+0000 7f74e8ff9640 1 -- 172.21.15.1:0/3808032452 --> [v2:172.21.15.107:6809/941385299,v1:172.21.15.107:6811/941385299] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f74ec09de50 con 0x7f74d007e5a0 2024-05-04T02:20:27.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.331+0000 7f74e8ff9640 1 -- 172.21.15.1:0/3808032452 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f74ec0d9b50 con 0x7f74e40370b0 2024-05-04T02:20:27.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.331+0000 7f74f0bc6640 1 --2- 172.21.15.1:0/3808032452 >> [v2:172.21.15.107:6809/941385299,v1:172.21.15.107:6811/941385299] conn(0x7f74d007e5a0 0x7f74d00809f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:27.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.331+0000 7fb7ddffb640 1 -- 172.21.15.1:0/4107978426 <== osd.5 v2:172.21.15.107:6818/1274544305 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb7e0015e50 con 0x7fb7cc07e4f0 2024-05-04T02:20:27.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.331+0000 7f74f0bc6640 1 --2- 172.21.15.1:0/3808032452 >> [v2:172.21.15.107:6809/941385299,v1:172.21.15.107:6811/941385299] conn(0x7f74d007e5a0 0x7f74d00809f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:27.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.332+0000 7f74e8ff9640 1 -- 172.21.15.1:0/3808032452 <== osd.6 v2:172.21.15.107:6809/941385299 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f74ec09de50 con 0x7f74d007e5a0 2024-05-04T02:20:27.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.336+0000 7fdd66f10640 1 -- 172.21.15.1:0/701455268 --> [v2:172.21.15.1:6816/459131368,v1:172.21.15.1:6817/459131368] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdd600cac60 con 0x7fdd4407e570 2024-05-04T02:20:27.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.337+0000 7fdd567fc640 1 -- 172.21.15.1:0/701455268 <== osd.1 v2:172.21.15.1:6816/459131368 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fdd600cac60 con 0x7fdd4407e570 2024-05-04T02:20:27.339 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.337+0000 7fdd66f10640 1 -- 172.21.15.1:0/701455268 >> [v2:172.21.15.1:6816/459131368,v1:172.21.15.1:6817/459131368] conn(0x7fdd4407e570 msgr2=0x7fdd440809c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.337+0000 7fdd66f10640 1 --2- 172.21.15.1:0/701455268 >> [v2:172.21.15.1:6816/459131368,v1:172.21.15.1:6817/459131368] conn(0x7fdd4407e570 0x7fdd440809c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.338+0000 7fdd66f10640 1 -- 172.21.15.1:0/701455268 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fdd44076320 msgr2=0x7fdd44078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.338+0000 7fdd66f10640 1 --2- 172.21.15.1:0/701455268 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fdd44076320 0x7fdd44078830 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdd50006fd0 tx=0x7fdd50009060 comp rx=0 tx=0).stop 2024-05-04T02:20:27.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.338+0000 7fdd66f10640 1 -- 172.21.15.1:0/701455268 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdd600c7690 msgr2=0x7fdd6014c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.338+0000 7fdd66f10640 1 --2- 172.21.15.1:0/701455268 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fdd600c7690 0x7fdd6014c7d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdd5800b9e0 tx=0x7fdd5800bea0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.341 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.338+0000 7fdd6670f640 1 -- 172.21.15.1:0/701455268 reap_dead start 2024-05-04T02:20:27.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.338+0000 7fdd66f10640 1 -- 172.21.15.1:0/701455268 shutdown_connections 2024-05-04T02:20:27.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.338+0000 7fdd66f10640 1 -- 172.21.15.1:0/701455268 >> 172.21.15.1:0/701455268 conn(0x7fdd600cd410 msgr2=0x7fdd60154bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:27.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.339+0000 7fdd66f10640 1 -- 172.21.15.1:0/701455268 shutdown_connections 2024-05-04T02:20:27.342 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.339+0000 7fdd66f10640 1 -- 172.21.15.1:0/701455268 wait complete. 2024-05-04T02:20:27.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.343+0000 7f1420ff9640 1 -- 172.21.15.1:0/1690401554 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1418046070 con 0x7f141c047ce0 2024-05-04T02:20:27.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.344+0000 7f1420ff9640 1 --2- 172.21.15.1:0/1690401554 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f14080762d0 0x7f14080787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.344+0000 7f14237fe640 1 --2- 172.21.15.1:0/1690401554 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f14080762d0 0x7f14080787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:27.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.344+0000 7f14237fe640 1 --2- 172.21.15.1:0/1690401554 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f14080762d0 0x7f14080787e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f141c051970 tx=0x7f1410006be0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:27.347 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.345+0000 7f22ba558640 1 -- 172.21.15.1:0/1623302821 --> [v2:172.21.15.1:6800/2338132980,v1:172.21.15.1:6801/2338132980] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f22ac0e0d10 con 0x7f229807e570 2024-05-04T02:20:27.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.346+0000 7f22a9ffb640 1 -- 172.21.15.1:0/1623302821 <== osd.0 v2:172.21.15.1:6800/2338132980 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f22ac0e0d10 con 0x7f229807e570 2024-05-04T02:20:27.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.346+0000 7f22ba558640 1 -- 172.21.15.1:0/1623302821 >> [v2:172.21.15.1:6800/2338132980,v1:172.21.15.1:6801/2338132980] conn(0x7f229807e570 msgr2=0x7f22980809c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.346+0000 7f22ba558640 1 --2- 172.21.15.1:0/1623302821 >> [v2:172.21.15.1:6800/2338132980,v1:172.21.15.1:6801/2338132980] conn(0x7f229807e570 0x7f22980809c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.347+0000 7f22ba558640 1 -- 172.21.15.1:0/1623302821 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f2298076320 msgr2=0x7f2298078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.347+0000 7f22ba558640 1 --2- 172.21.15.1:0/1623302821 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f2298076320 0x7f2298078830 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f22b0034000 tx=0x7f22b002e000 comp rx=0 tx=0).stop 2024-05-04T02:20:27.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.347+0000 7f22ba558640 1 -- 172.21.15.1:0/1623302821 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f22ac0062c0 msgr2=0x7f22ac0dfde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.347+0000 7f22ba558640 1 --2- 172.21.15.1:0/1623302821 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f22ac0062c0 0x7f22ac0dfde0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f22a400e7d0 tx=0x7f22a400ec90 comp rx=0 tx=0).stop 2024-05-04T02:20:27.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.347+0000 7f22b9d57640 1 -- 172.21.15.1:0/1623302821 reap_dead start 2024-05-04T02:20:27.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.348+0000 7f22ba558640 1 -- 172.21.15.1:0/1623302821 shutdown_connections 2024-05-04T02:20:27.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.348+0000 7f22ba558640 1 -- 172.21.15.1:0/1623302821 >> 172.21.15.1:0/1623302821 conn(0x7f22ac0503b0 msgr2=0x7f22ac0e33f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:27.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.348+0000 7f22ba558640 1 -- 172.21.15.1:0/1623302821 shutdown_connections 2024-05-04T02:20:27.351 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.348+0000 7f22ba558640 1 -- 172.21.15.1:0/1623302821 wait complete. 2024-05-04T02:20:27.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.349+0000 7f1420ff9640 1 -- 172.21.15.1:0/1690401554 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f14180b6e90 con 0x7f141c047ce0 2024-05-04T02:20:27.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.350+0000 7f1420ff9640 1 --2- 172.21.15.1:0/1690401554 >> [v2:172.21.15.107:6802/2335597098,v1:172.21.15.107:6803/2335597098] conn(0x7f140807e520 0x7f1408080970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.350+0000 7f1420ff9640 1 -- 172.21.15.1:0/1690401554 --> [v2:172.21.15.107:6802/2335597098,v1:172.21.15.107:6803/2335597098] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1418040e50 con 0x7f140807e520 2024-05-04T02:20:27.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.350+0000 7f1428abc640 1 --2- 172.21.15.1:0/1690401554 >> [v2:172.21.15.107:6802/2335597098,v1:172.21.15.107:6803/2335597098] conn(0x7f140807e520 0x7f1408080970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:27.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.351+0000 7f1428abc640 1 --2- 172.21.15.1:0/1690401554 >> [v2:172.21.15.107:6802/2335597098,v1:172.21.15.107:6803/2335597098] conn(0x7f140807e520 0x7f1408080970 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:27.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.351+0000 7f1420ff9640 1 -- 172.21.15.1:0/1690401554 <== osd.4 v2:172.21.15.107:6802/2335597098 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1418040e50 con 0x7f140807e520 2024-05-04T02:20:27.358 INFO:teuthology.orchestra.run.smithi001.stdout:64424509449 2024-05-04T02:20:27.358 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-04T02:20:27.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.358+0000 7efc68ff9640 1 -- 172.21.15.1:0/1518946167 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7efc5c01d460 con 0x7efc6c1f56e0 2024-05-04T02:20:27.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.359+0000 7efc68ff9640 1 --2- 172.21.15.1:0/1518946167 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7efc580762d0 0x7efc580787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.361+0000 7f74f13c7640 1 -- 172.21.15.1:0/3808032452 --> [v2:172.21.15.107:6809/941385299,v1:172.21.15.107:6811/941385299] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f74e4050a20 con 0x7f74d007e5a0 2024-05-04T02:20:27.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.362+0000 7f74e8ff9640 1 -- 172.21.15.1:0/3808032452 <== osd.6 v2:172.21.15.107:6809/941385299 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f74e4050a20 con 0x7f74d007e5a0 2024-05-04T02:20:27.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.362+0000 7fb7ee3b3640 1 -- 172.21.15.1:0/4107978426 --> [v2:172.21.15.107:6818/1274544305,v1:172.21.15.107:6819/1274544305] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb7e81641b0 con 0x7fb7cc07e4f0 2024-05-04T02:20:27.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.362+0000 7fb7ddffb640 1 -- 172.21.15.1:0/4107978426 <== osd.5 v2:172.21.15.107:6818/1274544305 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb7e81641b0 con 0x7fb7cc07e4f0 2024-05-04T02:20:27.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.362+0000 7efc6bfff640 1 --2- 172.21.15.1:0/1518946167 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7efc580762d0 0x7efc580787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:27.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.362+0000 7f74d67fc640 1 -- 172.21.15.1:0/3808032452 >> [v2:172.21.15.107:6809/941385299,v1:172.21.15.107:6811/941385299] conn(0x7f74d007e5a0 msgr2=0x7f74d00809f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.362+0000 7f74d67fc640 1 --2- 172.21.15.1:0/3808032452 >> [v2:172.21.15.107:6809/941385299,v1:172.21.15.107:6811/941385299] conn(0x7f74d007e5a0 0x7f74d00809f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.363+0000 7fb7ee3b3640 1 -- 172.21.15.1:0/4107978426 >> [v2:172.21.15.107:6818/1274544305,v1:172.21.15.107:6819/1274544305] conn(0x7fb7cc07e4f0 msgr2=0x7fb7cc080940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.363+0000 7fb7ee3b3640 1 --2- 172.21.15.1:0/4107978426 >> [v2:172.21.15.107:6818/1274544305,v1:172.21.15.107:6819/1274544305] conn(0x7fb7cc07e4f0 0x7fb7cc080940 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.362+0000 7f74d67fc640 1 -- 172.21.15.1:0/3808032452 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f74d0076350 msgr2=0x7f74d0078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.363+0000 7f74d67fc640 1 --2- 172.21.15.1:0/3808032452 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f74d0076350 0x7f74d0078860 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f74d8009960 tx=0x7f74d8009060 comp rx=0 tx=0).stop 2024-05-04T02:20:27.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.363+0000 7f74d67fc640 1 -- 172.21.15.1:0/3808032452 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74e40370b0 msgr2=0x7f74e40d5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.363+0000 7f74d67fc640 1 --2- 172.21.15.1:0/3808032452 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f74e40370b0 0x7f74e40d5840 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f74ec051620 tx=0x7f74ec06a480 comp rx=0 tx=0).stop 2024-05-04T02:20:27.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.363+0000 7f74f0bc6640 1 -- 172.21.15.1:0/3808032452 reap_dead start 2024-05-04T02:20:27.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.363+0000 7efc6bfff640 1 --2- 172.21.15.1:0/1518946167 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7efc580762d0 0x7efc580787e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7efc60032000 tx=0x7efc6002c000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:27.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.363+0000 7fb7ee3b3640 1 -- 172.21.15.1:0/4107978426 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fb7cc076300 msgr2=0x7fb7cc078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.363+0000 7fb7ee3b3640 1 --2- 172.21.15.1:0/4107978426 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fb7cc076300 0x7fb7cc078810 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb7e4034000 tx=0x7fb7e402e000 comp rx=0 tx=0).stop 2024-05-04T02:20:27.367 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.363+0000 7fb7ee3b3640 1 -- 172.21.15.1:0/4107978426 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb7e80c7690 msgr2=0x7fb7e815ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.363+0000 7fb7ee3b3640 1 --2- 172.21.15.1:0/4107978426 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb7e80c7690 0x7fb7e815ac50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb7e000b9c0 tx=0x7fb7e000be80 comp rx=0 tx=0).stop 2024-05-04T02:20:27.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.363+0000 7f74d67fc640 1 -- 172.21.15.1:0/3808032452 shutdown_connections 2024-05-04T02:20:27.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.363+0000 7f74d67fc640 1 -- 172.21.15.1:0/3808032452 >> 172.21.15.1:0/3808032452 conn(0x7f74e4054840 msgr2=0x7f74e4037670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:27.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.363+0000 7f74d67fc640 1 -- 172.21.15.1:0/3808032452 shutdown_connections 2024-05-04T02:20:27.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.363+0000 7f74d67fc640 1 -- 172.21.15.1:0/3808032452 wait complete. 2024-05-04T02:20:27.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.363+0000 7fb7edbb2640 1 -- 172.21.15.1:0/4107978426 reap_dead start 2024-05-04T02:20:27.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.363+0000 7fb7ee3b3640 1 -- 172.21.15.1:0/4107978426 shutdown_connections 2024-05-04T02:20:27.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.363+0000 7fb7ee3b3640 1 -- 172.21.15.1:0/4107978426 >> 172.21.15.1:0/4107978426 conn(0x7fb7e80cd410 msgr2=0x7fb7e8158110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:27.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.364+0000 7fb7ee3b3640 1 -- 172.21.15.1:0/4107978426 shutdown_connections 2024-05-04T02:20:27.369 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.364+0000 7fb7ee3b3640 1 -- 172.21.15.1:0/4107978426 wait complete. 2024-05-04T02:20:27.371 INFO:teuthology.orchestra.run.smithi001.stdout:55834574857 2024-05-04T02:20:27.371 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-04T02:20:27.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.375+0000 7efc68ff9640 1 -- 172.21.15.1:0/1518946167 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7efc5c096830 con 0x7efc6c1f56e0 2024-05-04T02:20:27.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.375+0000 7efc68ff9640 1 --2- 172.21.15.1:0/1518946167 >> [v2:172.21.15.1:6824/3859721636,v1:172.21.15.1:6825/3859721636] conn(0x7efc5807e520 0x7efc58080970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.375+0000 7efc68ff9640 1 -- 172.21.15.1:0/1518946167 --> [v2:172.21.15.1:6824/3859721636,v1:172.21.15.1:6825/3859721636] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efc58081040 con 0x7efc5807e520 2024-05-04T02:20:27.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.376+0000 7efc68ff9640 1 -- 172.21.15.1:0/1518946167 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7efc5c05db60 con 0x7efc6c1f56e0 2024-05-04T02:20:27.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.376+0000 7efc70cd9640 1 --2- 172.21.15.1:0/1518946167 >> [v2:172.21.15.1:6824/3859721636,v1:172.21.15.1:6825/3859721636] conn(0x7efc5807e520 0x7efc58080970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:27.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.377+0000 7efc70cd9640 1 --2- 172.21.15.1:0/1518946167 >> [v2:172.21.15.1:6824/3859721636,v1:172.21.15.1:6825/3859721636] conn(0x7efc5807e520 0x7efc58080970 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:27.381 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.378+0000 7efc68ff9640 1 -- 172.21.15.1:0/1518946167 <== osd.3 v2:172.21.15.1:6824/3859721636 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7efc58081040 con 0x7efc5807e520 2024-05-04T02:20:27.387 INFO:teuthology.orchestra.run.smithi001.stdout:64424509450 2024-05-04T02:20:27.387 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-04T02:20:27.388 INFO:teuthology.orchestra.run.smithi001.stdout:64424509450 2024-05-04T02:20:27.388 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-04T02:20:27.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.386+0000 7f142a51f640 1 -- 172.21.15.1:0/1690401554 --> [v2:172.21.15.107:6802/2335597098,v1:172.21.15.107:6803/2335597098] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f141c04bb50 con 0x7f140807e520 2024-05-04T02:20:27.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.386+0000 7f1420ff9640 1 -- 172.21.15.1:0/1690401554 <== osd.4 v2:172.21.15.107:6802/2335597098 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f141c04bb50 con 0x7f140807e520 2024-05-04T02:20:27.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.387+0000 7f142a51f640 1 -- 172.21.15.1:0/1690401554 >> [v2:172.21.15.107:6802/2335597098,v1:172.21.15.107:6803/2335597098] conn(0x7f140807e520 msgr2=0x7f1408080970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.387+0000 7f142a51f640 1 --2- 172.21.15.1:0/1690401554 >> [v2:172.21.15.107:6802/2335597098,v1:172.21.15.107:6803/2335597098] conn(0x7f140807e520 0x7f1408080970 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.387+0000 7f142a51f640 1 -- 172.21.15.1:0/1690401554 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f14080762d0 msgr2=0x7f14080787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.387+0000 7f142a51f640 1 --2- 172.21.15.1:0/1690401554 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f14080762d0 0x7f14080787e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f141c051970 tx=0x7f1410006be0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.387+0000 7f142a51f640 1 -- 172.21.15.1:0/1690401554 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f141c047ce0 msgr2=0x7f141c1756b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.387+0000 7f142a51f640 1 --2- 172.21.15.1:0/1690401554 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f141c047ce0 0x7f141c1756b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1418034000 tx=0x7f1418004730 comp rx=0 tx=0).stop 2024-05-04T02:20:27.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.387+0000 7f1428abc640 1 -- 172.21.15.1:0/1690401554 reap_dead start 2024-05-04T02:20:27.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.387+0000 7f142a51f640 1 -- 172.21.15.1:0/1690401554 shutdown_connections 2024-05-04T02:20:27.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.387+0000 7f142a51f640 1 -- 172.21.15.1:0/1690401554 >> 172.21.15.1:0/1690401554 conn(0x7f141c0514f0 msgr2=0x7f141c035b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:27.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.388+0000 7f142a51f640 1 -- 172.21.15.1:0/1690401554 shutdown_connections 2024-05-04T02:20:27.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.388+0000 7f142a51f640 1 -- 172.21.15.1:0/1690401554 wait complete. 2024-05-04T02:20:27.413 INFO:teuthology.orchestra.run.smithi001.stdout:60129542154 2024-05-04T02:20:27.413 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-04T02:20:27.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.411+0000 7efc714da640 1 -- 172.21.15.1:0/1518946167 --> [v2:172.21.15.1:6824/3859721636,v1:172.21.15.1:6825/3859721636] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7efc4c002dd0 con 0x7efc5807e520 2024-05-04T02:20:27.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.411+0000 7efc68ff9640 1 -- 172.21.15.1:0/1518946167 <== osd.3 v2:172.21.15.1:6824/3859721636 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7efc4c002dd0 con 0x7efc5807e520 2024-05-04T02:20:27.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.412+0000 7efc714da640 1 -- 172.21.15.1:0/1518946167 >> [v2:172.21.15.1:6824/3859721636,v1:172.21.15.1:6825/3859721636] conn(0x7efc5807e520 msgr2=0x7efc58080970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.412+0000 7efc714da640 1 --2- 172.21.15.1:0/1518946167 >> [v2:172.21.15.1:6824/3859721636,v1:172.21.15.1:6825/3859721636] conn(0x7efc5807e520 0x7efc58080970 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.412+0000 7efc714da640 1 -- 172.21.15.1:0/1518946167 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7efc580762d0 msgr2=0x7efc580787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.412+0000 7efc714da640 1 --2- 172.21.15.1:0/1518946167 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7efc580762d0 0x7efc580787e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7efc60032000 tx=0x7efc6002c000 comp rx=0 tx=0).stop 2024-05-04T02:20:27.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.412+0000 7efc714da640 1 -- 172.21.15.1:0/1518946167 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc6c1f56e0 msgr2=0x7efc6c14e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.412+0000 7efc714da640 1 --2- 172.21.15.1:0/1518946167 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7efc6c1f56e0 0x7efc6c14e190 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efc5c007340 tx=0x7efc5c007800 comp rx=0 tx=0).stop 2024-05-04T02:20:27.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.412+0000 7efc70cd9640 1 -- 172.21.15.1:0/1518946167 reap_dead start 2024-05-04T02:20:27.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.413+0000 7efc714da640 1 -- 172.21.15.1:0/1518946167 shutdown_connections 2024-05-04T02:20:27.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.413+0000 7efc714da640 1 -- 172.21.15.1:0/1518946167 >> 172.21.15.1:0/1518946167 conn(0x7efc6c0c9e10 msgr2=0x7efc6c157ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:27.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.413+0000 7efc714da640 1 -- 172.21.15.1:0/1518946167 shutdown_connections 2024-05-04T02:20:27.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.413+0000 7efc714da640 1 -- 172.21.15.1:0/1518946167 wait complete. 2024-05-04T02:20:27.443 INFO:teuthology.orchestra.run.smithi001.stdout:64424509450 2024-05-04T02:20:27.443 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-04T02:20:27.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.492+0000 7f13836b6640 1 Processor -- start 2024-05-04T02:20:27.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.492+0000 7f13836b6640 1 -- start start 2024-05-04T02:20:27.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.495+0000 7f13836b6640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f137c0c39b0 0x7f137c0c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.495+0000 7f13836b6640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f137c0c3dc0 0x7f137c0c8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.495+0000 7f13836b6640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f137c15ce00 con 0x7f137c155e40 2024-05-04T02:20:27.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.495+0000 7f13836b6640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f137c06d700 con 0x7f137c0c3dc0 2024-05-04T02:20:27.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.495+0000 7f13836b6640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f137c0c4620 con 0x7f137c0c39b0 2024-05-04T02:20:27.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.514+0000 7f1381c53640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f137c0c3dc0 0x7f137c0c8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:27.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.515+0000 7f1381c53640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f137c0c3dc0 0x7f137c0c8f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41548/0 (socket says 172.21.15.1:41548) 2024-05-04T02:20:27.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.515+0000 7f1381c53640 1 -- 172.21.15.1:0/2448865486 learned_addr learned my addr 172.21.15.1:0/2448865486 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:27.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.515+0000 7f1380c51640 1 --2- 172.21.15.1:0/2448865486 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f137c0c39b0 0x7f137c0c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:27.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.522+0000 7f1380c51640 1 -- 172.21.15.1:0/2448865486 >> v2:172.21.15.1:3300/0 conn(0x7f137c0c3dc0 msgr2=0x7f137c0c8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:27.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.522+0000 7f1380c51640 1 --2- 172.21.15.1:0/2448865486 >> v2:172.21.15.1:3300/0 conn(0x7f137c0c3dc0 0x7f137c0c8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.522+0000 7f1380c51640 1 -- 172.21.15.1:0/2448865486 >> v1:172.21.15.1:6789/0 conn(0x7f137c155e40 legacy=0x7f137c0c30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:27.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.522+0000 7f1380c51640 1 -- 172.21.15.1:0/2448865486 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f137c0c4340 con 0x7f137c0c39b0 2024-05-04T02:20:27.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.527+0000 7f1380c51640 1 --2- 172.21.15.1:0/2448865486 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f137c0c39b0 0x7f137c0c89f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f136c0097a0 tx=0x7f136c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1279821604b130f6 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:27.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.523+0000 7f89917f3640 1 Processor -- start 2024-05-04T02:20:27.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.524+0000 7f89917f3640 1 -- start start 2024-05-04T02:20:27.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.526+0000 7f89917f3640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f898c1634b0 0x7f898c0739b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.526+0000 7f89917f3640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f898c073ef0 0x7f898c0c4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.526+0000 7f89917f3640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f898c0c8710 con 0x7f898c06dbe0 2024-05-04T02:20:27.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.526+0000 7f89917f3640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f898c0c9e40 con 0x7f898c073ef0 2024-05-04T02:20:27.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.526+0000 7f89917f3640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f898c0c92c0 con 0x7f898c1634b0 2024-05-04T02:20:27.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.527+0000 7f898affd640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f898c06dbe0 0x7f898c0c7f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.1:54758/0 (socket says 172.21.15.1:54758) 2024-05-04T02:20:27.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.527+0000 7f898affd640 1 -- 172.21.15.1:0/3313571030 learned_addr learned my addr 172.21.15.1:0/3313571030 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-05-04T02:20:27.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.529+0000 7f898a7fc640 1 --2- 172.21.15.1:0/3313571030 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f898c1634b0 0x7f898c0739b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:27.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.533+0000 7f1373fff640 1 -- 172.21.15.1:0/2448865486 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f136c037070 con 0x7f137c0c39b0 2024-05-04T02:20:27.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.533+0000 7f1373fff640 1 -- 172.21.15.1:0/2448865486 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f136c032440 con 0x7f137c0c39b0 2024-05-04T02:20:27.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.534+0000 7f13836b6640 1 -- 172.21.15.1:0/2448865486 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f137c0c39b0 msgr2=0x7f137c0c89f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.534+0000 7f13836b6640 1 --2- 172.21.15.1:0/2448865486 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f137c0c39b0 0x7f137c0c89f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f136c0097a0 tx=0x7f136c02a180 comp rx=0 tx=0).stop 2024-05-04T02:20:27.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.534+0000 7f13836b6640 1 -- 172.21.15.1:0/2448865486 shutdown_connections 2024-05-04T02:20:27.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.534+0000 7f13836b6640 1 --2- 172.21.15.1:0/2448865486 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f137c0c39b0 0x7f137c0c89f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.534+0000 7f13836b6640 1 --2- 172.21.15.1:0/2448865486 >> v2:172.21.15.1:3300/0 conn(0x7f137c0c3dc0 0x7f137c0c8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.534+0000 7f13836b6640 1 -- 172.21.15.1:0/2448865486 >> 172.21.15.1:0/2448865486 conn(0x7f137c0caaf0 msgr2=0x7f137c0caf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:27.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.535+0000 7f13836b6640 1 -- 172.21.15.1:0/2448865486 shutdown_connections 2024-05-04T02:20:27.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.535+0000 7f13836b6640 1 -- 172.21.15.1:0/2448865486 wait complete. 2024-05-04T02:20:27.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.538+0000 7f13836b6640 1 Processor -- start 2024-05-04T02:20:27.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.538+0000 7f13836b6640 1 -- start start 2024-05-04T02:20:27.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.540+0000 7f13836b6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f137c0c39b0 0x7f137c141020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.540+0000 7f13836b6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f137c0c3dc0 0x7f137c0c6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.540+0000 7f13836b6640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f137c155e40 0x7f137c12cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.540+0000 7f13836b6640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f137c15c600 con 0x7f137c0c3dc0 2024-05-04T02:20:27.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.540+0000 7f13836b6640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f137c15c320 con 0x7f137c0c39b0 2024-05-04T02:20:27.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.540+0000 7f13836b6640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f137c15c8e0 con 0x7f137c155e40 2024-05-04T02:20:27.544 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.541+0000 7f1381452640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f137c0c39b0 0x7f137c141020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:27.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.544+0000 7f1381452640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f137c0c39b0 0x7f137c141020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.1:47192/0 (socket says 172.21.15.1:47192) 2024-05-04T02:20:27.546 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.544+0000 7f1381452640 1 -- 172.21.15.1:0/632456844 learned_addr learned my addr 172.21.15.1:0/632456844 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:27.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.545+0000 7f1381c53640 1 --2- 172.21.15.1:0/632456844 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f137c155e40 0x7f137c12cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:27.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.544+0000 7f898a7fc640 1 -- 172.21.15.1:0/3313571030 >> v2:172.21.15.1:3300/0 conn(0x7f898c073ef0 msgr2=0x7f898c0c4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:27.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.544+0000 7f898a7fc640 1 --2- 172.21.15.1:0/3313571030 >> v2:172.21.15.1:3300/0 conn(0x7f898c073ef0 0x7f898c0c4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.544+0000 7f898a7fc640 1 -- 172.21.15.1:0/3313571030 >> v1:172.21.15.107:6789/0 conn(0x7f898c06dbe0 legacy=0x7f898c0c7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.544+0000 7f898a7fc640 1 -- 172.21.15.1:0/3313571030 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f898c0c95a0 con 0x7f898c1634b0 2024-05-04T02:20:27.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.545+0000 7f1380c51640 1 --2- 172.21.15.1:0/632456844 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f137c0c3dc0 0x7f137c0c6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:27.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.547+0000 7f898a7fc640 1 --2- 172.21.15.1:0/3313571030 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f898c1634b0 0x7f898c0739b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f898000a930 tx=0x7f898002c690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=abdcd27a2d8c02be server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:27.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.551+0000 7f1381c53640 1 -- 172.21.15.1:0/632456844 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f137c0c39b0 msgr2=0x7f137c141020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.551+0000 7f1381c53640 1 --2- 172.21.15.1:0/632456844 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f137c0c39b0 0x7f137c141020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.551+0000 7f1381c53640 1 -- 172.21.15.1:0/632456844 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f137c0c3dc0 msgr2=0x7f137c0c6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.551+0000 7f1381c53640 1 --2- 172.21.15.1:0/632456844 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f137c0c3dc0 0x7f137c0c6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.551+0000 7f1381c53640 1 -- 172.21.15.1:0/632456844 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f137c159b50 con 0x7f137c155e40 2024-05-04T02:20:27.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.555+0000 7f1381c53640 1 --2- 172.21.15.1:0/632456844 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f137c155e40 0x7f137c12cf30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f137800d5d0 tx=0x7f137800da90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:27.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.561+0000 7fb6801ea640 1 Processor -- start 2024-05-04T02:20:27.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.561+0000 7f8989ffb640 1 -- 172.21.15.1:0/3313571030 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f898000b040 con 0x7f898c1634b0 2024-05-04T02:20:27.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.561+0000 7f8989ffb640 1 -- 172.21.15.1:0/3313571030 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8980031710 con 0x7f898c1634b0 2024-05-04T02:20:27.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.561+0000 7f8989ffb640 1 -- 172.21.15.1:0/3313571030 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8980031b20 con 0x7f898c1634b0 2024-05-04T02:20:27.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.561+0000 7fb6801ea640 1 -- start start 2024-05-04T02:20:27.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.562+0000 7f89917f3640 1 -- 172.21.15.1:0/3313571030 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f898c1634b0 msgr2=0x7f898c0739b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.562+0000 7f89917f3640 1 --2- 172.21.15.1:0/3313571030 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f898c1634b0 0x7f898c0739b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f898000a930 tx=0x7f898002c690 comp rx=0 tx=0).stop 2024-05-04T02:20:27.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.563+0000 7f89917f3640 1 -- 172.21.15.1:0/3313571030 shutdown_connections 2024-05-04T02:20:27.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.563+0000 7f89917f3640 1 --2- 172.21.15.1:0/3313571030 >> v2:172.21.15.1:3300/0 conn(0x7f898c073ef0 0x7f898c0c4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.563+0000 7f89917f3640 1 --2- 172.21.15.1:0/3313571030 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f898c1634b0 0x7f898c0739b0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.563+0000 7f89917f3640 1 -- 172.21.15.1:0/3313571030 >> 172.21.15.1:0/3313571030 conn(0x7f898c0ca060 msgr2=0x7f898c0ca470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:27.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.563+0000 7fb6801ea640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb6780ca980 0x7fb6780b1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.563+0000 7f1371ffb640 1 -- 172.21.15.1:0/632456844 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1378018030 con 0x7f137c155e40 2024-05-04T02:20:27.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.563+0000 7f1371ffb640 1 -- 172.21.15.1:0/632456844 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1378004020 con 0x7f137c155e40 2024-05-04T02:20:27.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.563+0000 7fb6801ea640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6780c39e0 con 0x7fb6780cb200 2024-05-04T02:20:27.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.563+0000 7fb6801ea640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6780c3cc0 con 0x7fb6781614f0 2024-05-04T02:20:27.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.563+0000 7fb6801ea640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fb6780c3790 con 0x7fb6780ca980 2024-05-04T02:20:27.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.564+0000 7fb67d785640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb6780ca980 0x7fb6780b1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:27.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.563+0000 7f89917f3640 1 -- 172.21.15.1:0/3313571030 shutdown_connections 2024-05-04T02:20:27.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.563+0000 7f89917f3640 1 -- 172.21.15.1:0/3313571030 wait complete. 2024-05-04T02:20:27.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.564+0000 7f1371ffb640 1 -- 172.21.15.1:0/632456844 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1378004210 con 0x7f137c155e40 2024-05-04T02:20:27.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.565+0000 7f13836b6640 1 -- 172.21.15.1:0/632456844 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f137c12d470 con 0x7f137c155e40 2024-05-04T02:20:27.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.565+0000 7f13836b6640 1 -- 172.21.15.1:0/632456844 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f137c15a0a0 con 0x7f137c155e40 2024-05-04T02:20:27.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.566+0000 7fb67d785640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb6780ca980 0x7fb6780b1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.1:47208/0 (socket says 172.21.15.1:47208) 2024-05-04T02:20:27.568 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.566+0000 7fb67d785640 1 -- 172.21.15.1:0/2588211711 learned_addr learned my addr 172.21.15.1:0/2588211711 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:27.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.566+0000 7f89917f3640 1 Processor -- start 2024-05-04T02:20:27.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.566+0000 7f89917f3640 1 -- start start 2024-05-04T02:20:27.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.567+0000 7f13836b6640 1 -- 172.21.15.1:0/632456844 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f137c076740 con 0x7f137c155e40 2024-05-04T02:20:27.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.568+0000 7f89917f3640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f898c06dbe0 0x7f898c20bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.568+0000 7f89917f3640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f898c073ef0 0x7f898c165550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.568+0000 7f89917f3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f898c1634b0 0x7f898c15edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.569+0000 7f89917f3640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f898c1638c0 con 0x7f898c1634b0 2024-05-04T02:20:27.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.569+0000 7f89917f3640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f898c0c9b60 con 0x7f898c06dbe0 2024-05-04T02:20:27.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.569+0000 7f89917f3640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f898c0c7870 con 0x7f898c073ef0 2024-05-04T02:20:27.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.569+0000 7fb67d785640 1 -- 172.21.15.1:0/2588211711 >> v1:172.21.15.107:6789/0 conn(0x7fb6781614f0 legacy=0x7fb6781649c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.569+0000 7fb67d785640 1 -- 172.21.15.1:0/2588211711 >> v1:172.21.15.1:6789/0 conn(0x7fb6780cb200 legacy=0x7fb678149290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:27.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.569+0000 7fb67d785640 1 -- 172.21.15.1:0/2588211711 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6781641c0 con 0x7fb6780ca980 2024-05-04T02:20:27.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.571+0000 7f898affd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f898c06dbe0 0x7f898c20bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:27.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.573+0000 7fb67d785640 1 --2- 172.21.15.1:0/2588211711 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb6780ca980 0x7fb6780b1c40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb6780c3910 tx=0x7fb66802a390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=416508b79aabb538 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:27.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.574+0000 7f898affd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f898c06dbe0 0x7f898c20bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.1:47214/0 (socket says 172.21.15.1:47214) 2024-05-04T02:20:27.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.574+0000 7f898affd640 1 -- 172.21.15.1:0/1491288967 learned_addr learned my addr 172.21.15.1:0/1491288967 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:27.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.578+0000 7f898b7fe640 1 --2- 172.21.15.1:0/1491288967 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f898c1634b0 0x7f898c15edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:27.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.579+0000 7fb67cf84640 1 -- 172.21.15.1:0/2588211711 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb668037070 con 0x7fb6780ca980 2024-05-04T02:20:27.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.579+0000 7fb67cf84640 1 -- 172.21.15.1:0/2588211711 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb668032640 con 0x7fb6780ca980 2024-05-04T02:20:27.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.580+0000 7fb67cf84640 1 -- 172.21.15.1:0/2588211711 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb668032a50 con 0x7fb6780ca980 2024-05-04T02:20:27.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.580+0000 7fb6801ea640 1 -- 172.21.15.1:0/2588211711 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb6780ca980 msgr2=0x7fb6780b1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.580+0000 7fb6801ea640 1 --2- 172.21.15.1:0/2588211711 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb6780ca980 0x7fb6780b1c40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb6780c3910 tx=0x7fb66802a390 comp rx=0 tx=0).stop 2024-05-04T02:20:27.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.580+0000 7fb6801ea640 1 -- 172.21.15.1:0/2588211711 shutdown_connections 2024-05-04T02:20:27.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.580+0000 7fb6801ea640 1 --2- 172.21.15.1:0/2588211711 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb6780ca980 0x7fb6780b1c40 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.580+0000 7fb6801ea640 1 -- 172.21.15.1:0/2588211711 >> 172.21.15.1:0/2588211711 conn(0x7fb6780731f0 msgr2=0x7fb6780706c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:27.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.580+0000 7fb6801ea640 1 -- 172.21.15.1:0/2588211711 shutdown_connections 2024-05-04T02:20:27.583 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.580+0000 7fb6801ea640 1 -- 172.21.15.1:0/2588211711 wait complete. 2024-05-04T02:20:27.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.582+0000 7fb6801ea640 1 Processor -- start 2024-05-04T02:20:27.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.582+0000 7f898affd640 1 -- 172.21.15.1:0/1491288967 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f898c073ef0 msgr2=0x7f898c165550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.582+0000 7f898affd640 1 --2- 172.21.15.1:0/1491288967 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f898c073ef0 0x7f898c165550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.582+0000 7f898affd640 1 -- 172.21.15.1:0/1491288967 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f898c1634b0 msgr2=0x7f898c15edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.582+0000 7f898affd640 1 --2- 172.21.15.1:0/1491288967 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f898c1634b0 0x7f898c15edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.585 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.582+0000 7f898affd640 1 -- 172.21.15.1:0/1491288967 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f898c207b80 con 0x7f898c06dbe0 2024-05-04T02:20:27.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.582+0000 7fb6801ea640 1 -- start start 2024-05-04T02:20:27.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.584+0000 7fb6801ea640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6780ca980 0x7fb6780cd530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.585+0000 7fb6801ea640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb6780cb200 0x7fb6781ec1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.585+0000 7fb6801ea640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6781614f0 0x7fb678152850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.585+0000 7fb6801ea640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fb6780cad90 con 0x7fb6780ca980 2024-05-04T02:20:27.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.585+0000 7fb6801ea640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fb678161900 con 0x7fb6780cb200 2024-05-04T02:20:27.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.585+0000 7fb6801ea640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fb6780b3a10 con 0x7fb6781614f0 2024-05-04T02:20:27.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.586+0000 7f898affd640 1 --2- 172.21.15.1:0/1491288967 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f898c06dbe0 0x7f898c20bb30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f897c00b6b0 tx=0x7f897c00bb70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:27.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.587+0000 7f247b6a8640 1 Processor -- start 2024-05-04T02:20:27.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.587+0000 7f247b6a8640 1 -- start start 2024-05-04T02:20:27.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.589+0000 7f247b6a8640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f24740cde50 0x7f247415cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.589+0000 7f247b6a8640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f24740c7da0 0x7f247406c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.589+0000 7f247b6a8640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24740cd6c0 con 0x7f24740cc590 2024-05-04T02:20:27.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.589+0000 7f247b6a8640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f24740c7070 con 0x7f24740c7da0 2024-05-04T02:20:27.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.589+0000 7f247b6a8640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f247406cc30 con 0x7f24740cde50 2024-05-04T02:20:27.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.590+0000 7fc317fff640 1 Processor -- start 2024-05-04T02:20:27.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.590+0000 7fc317fff640 1 -- start start 2024-05-04T02:20:27.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.590+0000 7f3bf0986640 1 Processor -- start 2024-05-04T02:20:27.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.591+0000 7f3bf0986640 1 -- start start 2024-05-04T02:20:27.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.591+0000 7fc317fff640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc31004da40 0x7fc3100d6330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.591+0000 7fc317fff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fc3100480b0 0x7fc3100dfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.591+0000 7fc317fff640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3100464f0 con 0x7fc310047ca0 2024-05-04T02:20:27.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.591+0000 7fc317fff640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7fc3100467b0 con 0x7fc3100480b0 2024-05-04T02:20:27.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.591+0000 7fc317fff640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fc31004cea0 con 0x7fc31004da40 2024-05-04T02:20:27.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.593+0000 7f1371ffb640 1 -- 172.21.15.1:0/632456844 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f137801b070 con 0x7f137c155e40 2024-05-04T02:20:27.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.593+0000 7f1371ffb640 1 --2- 172.21.15.1:0/632456844 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f1360076320 0x7f1360078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.593+0000 7f3bf0986640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f3bec1527f0 0x7f3bec0c8560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.593+0000 7f3bf0986640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3bec073e60 0x7f3bec074270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.593+0000 7f3bf0986640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3bec0c3270 con 0x7f3bec158b30 2024-05-04T02:20:27.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.593+0000 7f1381452640 1 --2- 172.21.15.1:0/632456844 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f1360076320 0x7f1360078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:27.596 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.594+0000 7f3bf0986640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f3bec06e000 con 0x7f3bec1527f0 2024-05-04T02:20:27.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.594+0000 7f3bf0986640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f3bec0c4100 con 0x7f3bec073e60 2024-05-04T02:20:27.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.594+0000 7f1381452640 1 --2- 172.21.15.1:0/632456844 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f1360076320 0x7f1360078830 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f137400e250 tx=0x7f137400b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:27.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.608+0000 7f4b63b3f640 1 Processor -- start 2024-05-04T02:20:27.611 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.608+0000 7f4b63b3f640 1 -- start start 2024-05-04T02:20:27.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.610+0000 7f4b63b3f640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4b5c154970 0x7f4b5c15e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.610+0000 7f4b63b3f640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f4b5c0cb580 0x7f4b5c0ca290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.610+0000 7f4b63b3f640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b5c15db50 con 0x7f4b5c0c4fd0 2024-05-04T02:20:27.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.610+0000 7f4b63b3f640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f4b5c15e160 con 0x7f4b5c0cb580 2024-05-04T02:20:27.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.610+0000 7f4b63b3f640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f4b5c0c53e0 con 0x7f4b5c154970 2024-05-04T02:20:27.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.644+0000 7f908909f640 1 Processor -- start 2024-05-04T02:20:27.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.644+0000 7f908909f640 1 -- start start 2024-05-04T02:20:27.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.645+0000 7f908909f640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f90840cde50 0x7f908415cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.645+0000 7f908909f640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f90840cc590 0x7f90840cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.645+0000 7f908909f640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90840cd6c0 con 0x7f90840c7da0 2024-05-04T02:20:27.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.645+0000 7f908909f640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f90840c7070 con 0x7f90840cc590 2024-05-04T02:20:27.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.645+0000 7f908909f640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f90840cd980 con 0x7f90840cde50 2024-05-04T02:20:27.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.651+0000 7fc3177fe640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fc3100480b0 0x7fc3100dfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:27.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.651+0000 7fc3177fe640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fc3100480b0 0x7fc3100dfc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41604/0 (socket says 172.21.15.1:41604) 2024-05-04T02:20:27.653 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.651+0000 7fc3177fe640 1 -- 172.21.15.1:0/1976751913 learned_addr learned my addr 172.21.15.1:0/1976751913 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:27.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.654+0000 7fc3177fe640 1 -- 172.21.15.1:0/1976751913 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc31004da40 msgr2=0x7fc3100d6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:27.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.654+0000 7fc3177fe640 1 --2- 172.21.15.1:0/1976751913 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc31004da40 0x7fc3100d6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.654+0000 7fc3177fe640 1 -- 172.21.15.1:0/1976751913 >> v1:172.21.15.1:6789/0 conn(0x7fc310047ca0 legacy=0x7fc3100df570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:27.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.654+0000 7fc3177fe640 1 -- 172.21.15.1:0/1976751913 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc31004d180 con 0x7fc3100480b0 2024-05-04T02:20:27.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.654+0000 7f3bea59c640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f3bec1527f0 0x7f3bec0c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:27.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.655+0000 7fb67d785640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb6780cb200 0x7fb6781ec1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:27.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.656+0000 7f2478c43640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f24740c7da0 0x7f247406c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:27.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.656+0000 7fb67d785640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb6780cb200 0x7fb6781ec1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.1:47218/0 (socket says 172.21.15.1:47218) 2024-05-04T02:20:27.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.657+0000 7fb67d785640 1 -- 172.21.15.1:0/1667933240 learned_addr learned my addr 172.21.15.1:0/1667933240 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:27.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.657+0000 7f3bea59c640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f3bec1527f0 0x7f3bec0c8560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41610/0 (socket says 172.21.15.1:41610) 2024-05-04T02:20:27.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.657+0000 7f3bea59c640 1 -- 172.21.15.1:0/351267951 learned_addr learned my addr 172.21.15.1:0/351267951 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:27.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.657+0000 7fc3177fe640 1 --2- 172.21.15.1:0/1976751913 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc3100480b0 0x7fc3100dfc80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc31802e1c0 tx=0x7fc3180a74b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30999c1ea74b7177 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:27.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.657+0000 7f2478c43640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f24740c7da0 0x7f247406c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.1:47230/0 (socket says 172.21.15.1:47230) 2024-05-04T02:20:27.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.657+0000 7f2478c43640 1 -- 172.21.15.1:0/4102624882 learned_addr learned my addr 172.21.15.1:0/4102624882 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:27.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.660+0000 7f3bea59c640 1 -- 172.21.15.1:0/351267951 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3bec073e60 msgr2=0x7f3bec074270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:27.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.660+0000 7f3bea59c640 1 --2- 172.21.15.1:0/351267951 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3bec073e60 0x7f3bec074270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.660+0000 7f3bea59c640 1 -- 172.21.15.1:0/351267951 >> v1:172.21.15.1:6789/0 conn(0x7f3bec158b30 legacy=0x7f3bec158f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:27.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.660+0000 7f3bea59c640 1 -- 172.21.15.1:0/351267951 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bec158630 con 0x7f3bec1527f0 2024-05-04T02:20:27.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.661+0000 7fb67d785640 1 -- 172.21.15.1:0/1667933240 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6781614f0 msgr2=0x7fb678152850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.661+0000 7fb67d785640 1 --2- 172.21.15.1:0/1667933240 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6781614f0 0x7fb678152850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.661+0000 7fb67d785640 1 -- 172.21.15.1:0/1667933240 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6780ca980 msgr2=0x7fb6780cd530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.661+0000 7fb67d785640 1 --2- 172.21.15.1:0/1667933240 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6780ca980 0x7fb6780cd530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.661+0000 7fb67d785640 1 -- 172.21.15.1:0/1667933240 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6780cda70 con 0x7fb6780cb200 2024-05-04T02:20:27.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.664+0000 7f3bea59c640 1 --2- 172.21.15.1:0/351267951 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3bec1527f0 0x7f3bec0c8560 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3bec0cb6d0 tx=0x7f3bdc02b230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b373159dc3718a6 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:27.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.665+0000 7f2478c43640 1 -- 172.21.15.1:0/4102624882 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f24740cde50 msgr2=0x7f247415cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:27.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.665+0000 7f2478c43640 1 --2- 172.21.15.1:0/4102624882 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f24740cde50 0x7f247415cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.665+0000 7f2478c43640 1 -- 172.21.15.1:0/4102624882 >> v1:172.21.15.107:6789/0 conn(0x7f24740cc590 legacy=0x7f247415fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:27.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.666+0000 7f2478c43640 1 -- 172.21.15.1:0/4102624882 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24740cd980 con 0x7f24740c7da0 2024-05-04T02:20:27.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.666+0000 7f908359e640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f90840cc590 0x7f90840cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:27.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.668+0000 7f908359e640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f90840cc590 0x7f90840cc9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.1:47238/0 (socket says 172.21.15.1:47238) 2024-05-04T02:20:27.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.668+0000 7f908359e640 1 -- 172.21.15.1:0/176535910 learned_addr learned my addr 172.21.15.1:0/176535910 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:27.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.668+0000 7f89737fe640 1 -- 172.21.15.1:0/1491288967 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f897c00cb10 con 0x7f898c06dbe0 2024-05-04T02:20:27.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.669+0000 7f89737fe640 1 -- 172.21.15.1:0/1491288967 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f897c010070 con 0x7f898c06dbe0 2024-05-04T02:20:27.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.669+0000 7f89737fe640 1 -- 172.21.15.1:0/1491288967 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f897c015470 con 0x7f898c06dbe0 2024-05-04T02:20:27.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.669+0000 7f89917f3640 1 -- 172.21.15.1:0/1491288967 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f898c167250 con 0x7f898c06dbe0 2024-05-04T02:20:27.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.669+0000 7f89917f3640 1 -- 172.21.15.1:0/1491288967 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f898c208120 con 0x7f898c06dbe0 2024-05-04T02:20:27.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.669+0000 7f4b610da640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f4b5c0c4fd0 0x7f4b5c15af40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.1:54776/0 (socket says 172.21.15.1:54776) 2024-05-04T02:20:27.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.669+0000 7f4b610da640 1 -- 172.21.15.1:0/633763198 learned_addr learned my addr 172.21.15.1:0/633763198 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-05-04T02:20:27.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.670+0000 7f89917f3640 1 -- 172.21.15.1:0/1491288967 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f898c069bc0 con 0x7f898c06dbe0 2024-05-04T02:20:27.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.671+0000 7fc315ffb640 1 -- 172.21.15.1:0/1976751913 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3180b3070 con 0x7fc3100480b0 2024-05-04T02:20:27.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.671+0000 7fc315ffb640 1 -- 172.21.15.1:0/1976751913 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3180ac7d0 con 0x7fc3100480b0 2024-05-04T02:20:27.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.671+0000 7fc315ffb640 1 -- 172.21.15.1:0/1976751913 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3180acc00 con 0x7fc3100480b0 2024-05-04T02:20:27.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.672+0000 7fc317fff640 1 -- 172.21.15.1:0/1976751913 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc3100480b0 msgr2=0x7fc3100dfc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.672+0000 7fc317fff640 1 --2- 172.21.15.1:0/1976751913 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc3100480b0 0x7fc3100dfc80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc31802e1c0 tx=0x7fc3180a74b0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.672+0000 7fc317fff640 1 -- 172.21.15.1:0/1976751913 shutdown_connections 2024-05-04T02:20:27.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.672+0000 7fc317fff640 1 --2- 172.21.15.1:0/1976751913 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc3100480b0 0x7fc3100dfc80 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.672+0000 7fc317fff640 1 --2- 172.21.15.1:0/1976751913 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc31004da40 0x7fc3100d6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.672+0000 7fc317fff640 1 -- 172.21.15.1:0/1976751913 >> 172.21.15.1:0/1976751913 conn(0x7fc3100514b0 msgr2=0x7fc3100518c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:27.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.672+0000 7fc317fff640 1 -- 172.21.15.1:0/1976751913 shutdown_connections 2024-05-04T02:20:27.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.672+0000 7fc317fff640 1 -- 172.21.15.1:0/1976751913 wait complete. 2024-05-04T02:20:27.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.672+0000 7f4b620dc640 1 --2- 172.21.15.1:0/633763198 >> v2:172.21.15.1:3300/0 conn(0x7f4b5c0cb580 0x7f4b5c0ca290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:27.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.673+0000 7f3be959a640 1 -- 172.21.15.1:0/351267951 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc0089e0 con 0x7f3bec1527f0 2024-05-04T02:20:27.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.673+0000 7f3be959a640 1 -- 172.21.15.1:0/351267951 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bdc008b80 con 0x7f3bec1527f0 2024-05-04T02:20:27.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.673+0000 7f3be959a640 1 -- 172.21.15.1:0/351267951 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc00a0d0 con 0x7f3bec1527f0 2024-05-04T02:20:27.676 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.674+0000 7f3bf0986640 1 -- 172.21.15.1:0/351267951 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3bec1527f0 msgr2=0x7f3bec0c8560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.674+0000 7f3bf0986640 1 --2- 172.21.15.1:0/351267951 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3bec1527f0 0x7f3bec0c8560 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3bec0cb6d0 tx=0x7f3bdc02b230 comp rx=0 tx=0).stop 2024-05-04T02:20:27.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.674+0000 7f3bf0986640 1 -- 172.21.15.1:0/351267951 shutdown_connections 2024-05-04T02:20:27.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.674+0000 7f3bf0986640 1 --2- 172.21.15.1:0/351267951 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3bec073e60 0x7f3bec074270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.674+0000 7f3bf0986640 1 --2- 172.21.15.1:0/351267951 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3bec1527f0 0x7f3bec0c8560 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.674+0000 7f3bf0986640 1 -- 172.21.15.1:0/351267951 >> 172.21.15.1:0/351267951 conn(0x7f3bec072620 msgr2=0x7f3bec0cdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:27.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.675+0000 7f3bf0986640 1 -- 172.21.15.1:0/351267951 shutdown_connections 2024-05-04T02:20:27.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.675+0000 7fc317fff640 1 Processor -- start 2024-05-04T02:20:27.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.675+0000 7f908359e640 1 -- 172.21.15.1:0/176535910 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f90840cde50 msgr2=0x7f908415cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:27.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.675+0000 7f908359e640 1 --2- 172.21.15.1:0/176535910 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f90840cde50 0x7f908415cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.675+0000 7f908359e640 1 -- 172.21.15.1:0/176535910 >> v1:172.21.15.107:6789/0 conn(0x7f90840c7da0 legacy=0x7f908406c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:27.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.675+0000 7f908359e640 1 -- 172.21.15.1:0/176535910 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90840c72c0 con 0x7f90840cc590 2024-05-04T02:20:27.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.675+0000 7f3bf0986640 1 -- 172.21.15.1:0/351267951 wait complete. 2024-05-04T02:20:27.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.675+0000 7fc317fff640 1 -- start start 2024-05-04T02:20:27.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.675+0000 7f2478c43640 1 --2- 172.21.15.1:0/4102624882 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24740c7da0 0x7f247406c6f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2470009870 tx=0x7f247002a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba550acde11f55de server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:27.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.676+0000 7fc317fff640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc310047ca0 0x7fc3101758a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.676+0000 7fc317fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc3100480b0 0x7fc310177f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.676+0000 7fc317fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc31004da40 0x7fc310008310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.676+0000 7fc317fff640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc3100484c0 con 0x7fc31004da40 2024-05-04T02:20:27.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.676+0000 7fc317fff640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fc310047730 con 0x7fc3100480b0 2024-05-04T02:20:27.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.676+0000 7fc317fff640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fc31004d460 con 0x7fc310047ca0 2024-05-04T02:20:27.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.677+0000 7f3bf0986640 1 Processor -- start 2024-05-04T02:20:27.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.677+0000 7f3bf0986640 1 -- start start 2024-05-04T02:20:27.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.679+0000 7f3bf0986640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3bec1527f0 0x7f3bec1ee4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.679+0000 7f3bf0986640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3bec158b30 0x7f3bec1574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.679+0000 7f3bf0986640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3bec1de6b0 0x7f3bec14f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.679+0000 7f3bf0986640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f3bec0c3e20 con 0x7f3bec158b30 2024-05-04T02:20:27.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.679+0000 7f3bf0986640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f3bec0c3b40 con 0x7f3bec1527f0 2024-05-04T02:20:27.681 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.679+0000 7f3bf0986640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f3bec0c8aa0 con 0x7f3bec1de6b0 2024-05-04T02:20:27.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.680+0000 7f4b620dc640 1 -- 172.21.15.1:0/633763198 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4b5c154970 msgr2=0x7f4b5c15e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:27.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.680+0000 7f4b620dc640 1 --2- 172.21.15.1:0/633763198 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4b5c154970 0x7f4b5c15e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.680+0000 7f4b620dc640 1 -- 172.21.15.1:0/633763198 >> v1:172.21.15.107:6789/0 conn(0x7f4b5c0c4fd0 legacy=0x7f4b5c15af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.680+0000 7f4b620dc640 1 -- 172.21.15.1:0/633763198 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b5c0c5640 con 0x7f4b5c0cb580 2024-05-04T02:20:27.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.681+0000 7f908359e640 1 --2- 172.21.15.1:0/176535910 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f90840cc590 0x7f90840cc9a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f907c009e50 tx=0x7f907c02a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1c769988eb0e6d7 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:27.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.682+0000 7f4b620dc640 1 --2- 172.21.15.1:0/633763198 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b5c0cb580 0x7f4b5c0ca290 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4b54009d90 tx=0x7f4b5402a530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e378c6548e7388c server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:27.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.686+0000 7fb67d785640 1 --2- 172.21.15.1:0/1667933240 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb6780cb200 0x7fb6781ec1c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb668009960 tx=0x7fb6680046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:27.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.687+0000 7f3be9d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3bec158b30 0x7f3bec1574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:27.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.687+0000 7fc3177fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc31004da40 0x7fc310008310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:27.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.687+0000 7f246bfff640 1 -- 172.21.15.1:0/4102624882 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2470037070 con 0x7f24740c7da0 2024-05-04T02:20:27.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.687+0000 7f246bfff640 1 -- 172.21.15.1:0/4102624882 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2470032440 con 0x7f24740c7da0 2024-05-04T02:20:27.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.687+0000 7f246bfff640 1 -- 172.21.15.1:0/4102624882 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2470032810 con 0x7f24740c7da0 2024-05-04T02:20:27.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.688+0000 7f3be9d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3bec158b30 0x7f3bec1574e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41636/0 (socket says 172.21.15.1:41636) 2024-05-04T02:20:27.690 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.688+0000 7f3be9d9b640 1 -- 172.21.15.1:0/830994357 learned_addr learned my addr 172.21.15.1:0/830994357 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:27.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.688+0000 7f247b6a8640 1 -- 172.21.15.1:0/4102624882 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24740c7da0 msgr2=0x7f247406c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.688+0000 7f247b6a8640 1 --2- 172.21.15.1:0/4102624882 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24740c7da0 0x7f247406c6f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2470009870 tx=0x7f247002a250 comp rx=0 tx=0).stop 2024-05-04T02:20:27.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.688+0000 7f247b6a8640 1 -- 172.21.15.1:0/4102624882 shutdown_connections 2024-05-04T02:20:27.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.688+0000 7f247b6a8640 1 --2- 172.21.15.1:0/4102624882 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24740c7da0 0x7f247406c6f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.688+0000 7f247b6a8640 1 --2- 172.21.15.1:0/4102624882 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f24740cde50 0x7f247415cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.688+0000 7f247b6a8640 1 -- 172.21.15.1:0/4102624882 >> 172.21.15.1:0/4102624882 conn(0x7f24740d2590 msgr2=0x7f24740ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:27.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.689+0000 7f247b6a8640 1 -- 172.21.15.1:0/4102624882 shutdown_connections 2024-05-04T02:20:27.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.689+0000 7f247b6a8640 1 -- 172.21.15.1:0/4102624882 wait complete. 2024-05-04T02:20:27.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.689+0000 7fc3177fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc31004da40 0x7fc310008310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41622/0 (socket says 172.21.15.1:41622) 2024-05-04T02:20:27.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.689+0000 7fc3177fe640 1 -- 172.21.15.1:0/1263539349 learned_addr learned my addr 172.21.15.1:0/1263539349 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:27.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.689+0000 7f4b608d9640 1 -- 172.21.15.1:0/633763198 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b54007740 con 0x7f4b5c0cb580 2024-05-04T02:20:27.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.689+0000 7f4b608d9640 1 -- 172.21.15.1:0/633763198 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b540078e0 con 0x7f4b5c0cb580 2024-05-04T02:20:27.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.689+0000 7f4b608d9640 1 -- 172.21.15.1:0/633763198 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b54007cb0 con 0x7f4b5c0cb580 2024-05-04T02:20:27.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.690+0000 7f4b63b3f640 1 -- 172.21.15.1:0/633763198 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b5c0cb580 msgr2=0x7f4b5c0ca290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.690+0000 7f4b63b3f640 1 --2- 172.21.15.1:0/633763198 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b5c0cb580 0x7f4b5c0ca290 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4b54009d90 tx=0x7f4b5402a530 comp rx=0 tx=0).stop 2024-05-04T02:20:27.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.690+0000 7f4b63b3f640 1 -- 172.21.15.1:0/633763198 shutdown_connections 2024-05-04T02:20:27.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.690+0000 7f4b63b3f640 1 --2- 172.21.15.1:0/633763198 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b5c0cb580 0x7f4b5c0ca290 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.690+0000 7f4b63b3f640 1 --2- 172.21.15.1:0/633763198 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4b5c154970 0x7f4b5c15e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.690+0000 7f4b63b3f640 1 -- 172.21.15.1:0/633763198 >> 172.21.15.1:0/633763198 conn(0x7f4b5c073720 msgr2=0x7f4b5c073b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:27.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.690+0000 7f4b63b3f640 1 -- 172.21.15.1:0/633763198 shutdown_connections 2024-05-04T02:20:27.694 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.690+0000 7f4b63b3f640 1 -- 172.21.15.1:0/633763198 wait complete. 2024-05-04T02:20:27.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.690+0000 7f247b6a8640 1 Processor -- start 2024-05-04T02:20:27.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.691+0000 7f247b6a8640 1 -- start start 2024-05-04T02:20:27.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.692+0000 7f247b6a8640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f24740c7da0 0x7f24741f2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.692+0000 7f247b6a8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24740cc590 0x7f247415fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.692+0000 7f247b6a8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f247406d030 0x7f2474152240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.692+0000 7f247b6a8640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f24740c7880 con 0x7f247406d030 2024-05-04T02:20:27.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.692+0000 7f247b6a8640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f24740c75a0 con 0x7f24740cc590 2024-05-04T02:20:27.695 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.692+0000 7f247b6a8640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f2474156b40 con 0x7f24740c7da0 2024-05-04T02:20:27.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.692+0000 7f4b63b3f640 1 Processor -- start 2024-05-04T02:20:27.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.693+0000 7f4b63b3f640 1 -- start start 2024-05-04T02:20:27.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.693+0000 7fc3167fc640 1 --2- 172.21.15.1:0/1263539349 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc3100480b0 0x7fc310177f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:27.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.694+0000 7f4b63b3f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b5c0c4fd0 0x7f4b5c145010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.694+0000 7f4b63b3f640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4b5c0cb580 0x7f4b5c1e5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.694+0000 7f4b63b3f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b5c154970 0x7f4b5c153cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.694+0000 7f4b63b3f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4b5c0cb990 con 0x7f4b5c0c4fd0 2024-05-04T02:20:27.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.694+0000 7f4b63b3f640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f4b5c15ddf0 con 0x7f4b5c154970 2024-05-04T02:20:27.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.694+0000 7f4b63b3f640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f4b5c0c5c00 con 0x7f4b5c0cb580 2024-05-04T02:20:27.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.696+0000 7fc3177fe640 1 -- 172.21.15.1:0/1263539349 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc310047ca0 msgr2=0x7fc3101758a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.696+0000 7fc3177fe640 1 --2- 172.21.15.1:0/1263539349 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc310047ca0 0x7fc3101758a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.696+0000 7fc3177fe640 1 -- 172.21.15.1:0/1263539349 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc3100480b0 msgr2=0x7fc310177f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.696+0000 7fc3177fe640 1 --2- 172.21.15.1:0/1263539349 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc3100480b0 0x7fc310177f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.696+0000 7fc3177fe640 1 -- 172.21.15.1:0/1263539349 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc310175de0 con 0x7fc31004da40 2024-05-04T02:20:27.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.699+0000 7f3be9d9b640 1 -- 172.21.15.1:0/830994357 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3bec1de6b0 msgr2=0x7f3bec14f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.699+0000 7f3be9d9b640 1 --2- 172.21.15.1:0/830994357 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3bec1de6b0 0x7f3bec14f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.699+0000 7f3be9d9b640 1 -- 172.21.15.1:0/830994357 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3bec1527f0 msgr2=0x7f3bec1ee4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.699+0000 7f3be9d9b640 1 --2- 172.21.15.1:0/830994357 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3bec1527f0 0x7f3bec1ee4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.702 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.700+0000 7f3be9d9b640 1 -- 172.21.15.1:0/830994357 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bec1eea10 con 0x7f3bec158b30 2024-05-04T02:20:27.706 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.704+0000 7fc3177fe640 1 --2- 172.21.15.1:0/1263539349 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc31004da40 0x7fc310008310 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc318052170 tx=0x7fc31806b590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:27.707 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.705+0000 7f3be9d9b640 1 --2- 172.21.15.1:0/830994357 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3bec158b30 0x7f3bec1574e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3be000b410 tx=0x7f3be000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:27.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.708+0000 7f2479c45640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f247406d030 0x7f2474152240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:27.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.710+0000 7fc2ff7fe640 1 -- 172.21.15.1:0/1263539349 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3180be020 con 0x7fc31004da40 2024-05-04T02:20:27.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.711+0000 7fc2ff7fe640 1 -- 172.21.15.1:0/1263539349 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3180aec30 con 0x7fc31004da40 2024-05-04T02:20:27.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.711+0000 7fc2ff7fe640 1 -- 172.21.15.1:0/1263539349 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3180b3040 con 0x7fc31004da40 2024-05-04T02:20:27.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.711+0000 7fc317fff640 1 -- 172.21.15.1:0/1263539349 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc310167470 con 0x7fc31004da40 2024-05-04T02:20:27.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.711+0000 7fc317fff640 1 -- 172.21.15.1:0/1263539349 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc310167190 con 0x7fc31004da40 2024-05-04T02:20:27.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.711+0000 7f2479c45640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f247406d030 0x7f2474152240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41646/0 (socket says 172.21.15.1:41646) 2024-05-04T02:20:27.713 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.711+0000 7f2479c45640 1 -- 172.21.15.1:0/3263601603 learned_addr learned my addr 172.21.15.1:0/3263601603 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:27.714 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.712+0000 7fc2fdffb640 1 -- 172.21.15.1:0/1263539349 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2f0005290 con 0x7fc31004da40 2024-05-04T02:20:27.863 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.861+0000 7f1371ffb640 1 -- 172.21.15.1:0/632456844 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f13780043b0 con 0x7f137c155e40 2024-05-04T02:20:27.875 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.873+0000 7f1371ffb640 1 -- 172.21.15.1:0/632456844 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f13780612c0 con 0x7f137c155e40 2024-05-04T02:20:27.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.923+0000 7f3bdaffd640 1 -- 172.21.15.1:0/830994357 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3be0015020 con 0x7f3bec158b30 2024-05-04T02:20:27.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.923+0000 7f3bdaffd640 1 -- 172.21.15.1:0/830994357 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3be0011850 con 0x7f3bec158b30 2024-05-04T02:20:27.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.923+0000 7f3bf0986640 1 -- 172.21.15.1:0/830994357 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bec1505a0 con 0x7f3bec158b30 2024-05-04T02:20:27.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.923+0000 7f3bf0986640 1 -- 172.21.15.1:0/830994357 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bec0caa90 con 0x7f3bec158b30 2024-05-04T02:20:27.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.924+0000 7f3bf0986640 1 -- 172.21.15.1:0/830994357 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bec1edde0 con 0x7f3bec158b30 2024-05-04T02:20:27.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.951+0000 7f2479444640 1 --2- 172.21.15.1:0/3263601603 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f24740c7da0 0x7f24741f2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:27.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.951+0000 7f4b610da640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4b5c0cb580 0x7f4b5c1e5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:27.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.952+0000 7f4b610da640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4b5c0cb580 0x7f4b5c1e5320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.1:49934/0 (socket says 172.21.15.1:49934) 2024-05-04T02:20:27.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.952+0000 7f4b610da640 1 -- 172.21.15.1:0/2428605116 learned_addr learned my addr 172.21.15.1:0/2428605116 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:27.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.959+0000 7f2479444640 1 -- 172.21.15.1:0/3263601603 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24740cc590 msgr2=0x7f247415fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.959+0000 7f2479444640 1 --2- 172.21.15.1:0/3263601603 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24740cc590 0x7f247415fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.959+0000 7f2479444640 1 -- 172.21.15.1:0/3263601603 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f247406d030 msgr2=0x7f2474152240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.959+0000 7f2479444640 1 --2- 172.21.15.1:0/3263601603 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f247406d030 0x7f2474152240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.959+0000 7f2479444640 1 -- 172.21.15.1:0/3263601603 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2474159c70 con 0x7f24740c7da0 2024-05-04T02:20:27.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.962+0000 7f4b610da640 1 -- 172.21.15.1:0/2428605116 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b5c154970 msgr2=0x7f4b5c153cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.962+0000 7f4b610da640 1 --2- 172.21.15.1:0/2428605116 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b5c154970 0x7f4b5c153cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.962+0000 7f4b610da640 1 -- 172.21.15.1:0/2428605116 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b5c0c4fd0 msgr2=0x7f4b5c145010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.962+0000 7f4b610da640 1 --2- 172.21.15.1:0/2428605116 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b5c0c4fd0 0x7f4b5c145010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.962+0000 7f4b610da640 1 -- 172.21.15.1:0/2428605116 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b5c1e5860 con 0x7f4b5c0cb580 2024-05-04T02:20:27.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.966+0000 7f2479444640 1 --2- 172.21.15.1:0/3263601603 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f24740c7da0 0x7f24741f2460 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f246400b3e0 tx=0x7f246400b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:27.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.967+0000 7f4b610da640 1 --2- 172.21.15.1:0/2428605116 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4b5c0cb580 0x7f4b5c1e5320 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c00c370 tx=0x7f4b4c00c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:27.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.974+0000 7f9081d9b640 1 -- 172.21.15.1:0/176535910 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f907c036070 con 0x7f90840cc590 2024-05-04T02:20:27.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.974+0000 7f9081d9b640 1 -- 172.21.15.1:0/176535910 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f907c031600 con 0x7f90840cc590 2024-05-04T02:20:27.976 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.974+0000 7f9081d9b640 1 -- 172.21.15.1:0/176535910 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f907c0319d0 con 0x7f90840cc590 2024-05-04T02:20:27.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.975+0000 7f908909f640 1 -- 172.21.15.1:0/176535910 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f90840cc590 msgr2=0x7f90840cc9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.975+0000 7f908909f640 1 --2- 172.21.15.1:0/176535910 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f90840cc590 0x7f90840cc9a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f907c009e50 tx=0x7f907c02a710 comp rx=0 tx=0).stop 2024-05-04T02:20:27.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.975+0000 7f908909f640 1 -- 172.21.15.1:0/176535910 shutdown_connections 2024-05-04T02:20:27.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.975+0000 7f908909f640 1 --2- 172.21.15.1:0/176535910 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f90840cc590 0x7f90840cc9a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.975+0000 7f908909f640 1 --2- 172.21.15.1:0/176535910 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f90840cde50 0x7f908415cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.975+0000 7f908909f640 1 -- 172.21.15.1:0/176535910 >> 172.21.15.1:0/176535910 conn(0x7f90840d2590 msgr2=0x7f90840ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:27.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.975+0000 7f908909f640 1 -- 172.21.15.1:0/176535910 shutdown_connections 2024-05-04T02:20:27.978 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.975+0000 7f908909f640 1 -- 172.21.15.1:0/176535910 wait complete. 2024-05-04T02:20:27.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.977+0000 7f908909f640 1 Processor -- start 2024-05-04T02:20:27.979 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.977+0000 7f908909f640 1 -- start start 2024-05-04T02:20:27.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.979+0000 7f908909f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f90840c7da0 0x7f908415d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.979+0000 7f908909f640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f90840cc590 0x7f90840cb710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.979+0000 7f908909f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9084156690 0x7f90840cabd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:27.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.979+0000 7f908909f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f9084156b40 con 0x7f9084156690 2024-05-04T02:20:27.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.979+0000 7f908909f640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f90840c7880 con 0x7f90840c7da0 2024-05-04T02:20:27.981 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.979+0000 7f908909f640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f90840cd310 con 0x7f90840cc590 2024-05-04T02:20:27.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.979+0000 7f4b527fc640 1 -- 172.21.15.1:0/2428605116 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b4c017070 con 0x7f4b5c0cb580 2024-05-04T02:20:27.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.979+0000 7f4b527fc640 1 -- 172.21.15.1:0/2428605116 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b4c005ce0 con 0x7f4b5c0cb580 2024-05-04T02:20:27.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.979+0000 7f4b527fc640 1 -- 172.21.15.1:0/2428605116 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b4c0072f0 con 0x7f4b5c0cb580 2024-05-04T02:20:27.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.979+0000 7f4b63b3f640 1 -- 172.21.15.1:0/2428605116 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b5c154230 con 0x7f4b5c0cb580 2024-05-04T02:20:27.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.979+0000 7fb66e7fc640 1 -- 172.21.15.1:0/1667933240 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb668041020 con 0x7fb6780cb200 2024-05-04T02:20:27.982 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.979+0000 7fb66e7fc640 1 -- 172.21.15.1:0/1667933240 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb668030970 con 0x7fb6780cb200 2024-05-04T02:20:27.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.979+0000 7f4b63b3f640 1 -- 172.21.15.1:0/2428605116 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b5c153270 con 0x7f4b5c0cb580 2024-05-04T02:20:27.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.979+0000 7fb6801ea640 1 -- 172.21.15.1:0/1667933240 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6781ed980 con 0x7fb6780cb200 2024-05-04T02:20:27.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.979+0000 7f2469ffb640 1 -- 172.21.15.1:0/3263601603 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2464015020 con 0x7f24740c7da0 2024-05-04T02:20:27.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.979+0000 7f2469ffb640 1 -- 172.21.15.1:0/3263601603 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2464011850 con 0x7f24740c7da0 2024-05-04T02:20:27.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.979+0000 7f2469ffb640 1 -- 172.21.15.1:0/3263601603 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2464011c40 con 0x7f24740c7da0 2024-05-04T02:20:27.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.980+0000 7fb66e7fc640 1 -- 172.21.15.1:0/1667933240 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb668037040 con 0x7fb6780cb200 2024-05-04T02:20:27.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.980+0000 7f908259c640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f90840cc590 0x7f90840cb710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:27.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.980+0000 7f247b6a8640 1 -- 172.21.15.1:0/3263601603 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24741600a0 con 0x7f24740c7da0 2024-05-04T02:20:27.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.980+0000 7fb6801ea640 1 -- 172.21.15.1:0/1667933240 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6781edc20 con 0x7fb6780cb200 2024-05-04T02:20:27.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.981+0000 7f247b6a8640 1 -- 172.21.15.1:0/3263601603 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f247415dd80 con 0x7f24740c7da0 2024-05-04T02:20:27.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.980+0000 7f4b63b3f640 1 -- 172.21.15.1:0/2428605116 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b5c152fd0 con 0x7f4b5c0cb580 2024-05-04T02:20:27.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.981+0000 7fb6801ea640 1 -- 172.21.15.1:0/1667933240 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6781f7b60 con 0x7fb6780cb200 2024-05-04T02:20:27.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.982+0000 7f247b6a8640 1 -- 172.21.15.1:0/3263601603 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2474069bc0 con 0x7f24740c7da0 2024-05-04T02:20:27.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.982+0000 7f908259c640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f90840cc590 0x7f90840cb710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.1:49936/0 (socket says 172.21.15.1:49936) 2024-05-04T02:20:27.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.982+0000 7f908259c640 1 -- 172.21.15.1:0/808563636 learned_addr learned my addr 172.21.15.1:0/808563636 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:27.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.992+0000 7f908259c640 1 -- 172.21.15.1:0/808563636 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f90840c7da0 msgr2=0x7f908415d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.992+0000 7f908259c640 1 --2- 172.21.15.1:0/808563636 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f90840c7da0 0x7f908415d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.992+0000 7f908259c640 1 -- 172.21.15.1:0/808563636 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9084156690 msgr2=0x7f90840cabd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:27.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.992+0000 7f908259c640 1 --2- 172.21.15.1:0/808563636 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9084156690 0x7f90840cabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:27.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.992+0000 7f908259c640 1 -- 172.21.15.1:0/808563636 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90841f24a0 con 0x7f90840cc590 2024-05-04T02:20:28.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.998+0000 7f89737fe640 1 -- 172.21.15.1:0/1491288967 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f897c00c040 con 0x7f898c06dbe0 2024-05-04T02:20:28.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.998+0000 7f89737fe640 1 --2- 172.21.15.1:0/1491288967 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f8978076320 0x7f8978078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:28.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.999+0000 7f898a7fc640 1 --2- 172.21.15.1:0/1491288967 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f8978076320 0x7f8978078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:28.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:27.999+0000 7f898a7fc640 1 --2- 172.21.15.1:0/1491288967 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f8978076320 0x7f8978078830 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8980036000 tx=0x7f8980030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:28.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.004+0000 7f89737fe640 1 -- 172.21.15.1:0/1491288967 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f897c05cbd0 con 0x7f898c06dbe0 2024-05-04T02:20:28.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.030+0000 7f3bdaffd640 1 -- 172.21.15.1:0/830994357 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3be0011c00 con 0x7f3bec158b30 2024-05-04T02:20:28.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.030+0000 7fc2ff7fe640 1 -- 172.21.15.1:0/1263539349 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc3180c1020 con 0x7fc31004da40 2024-05-04T02:20:28.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.031+0000 7fc2ff7fe640 1 --2- 172.21.15.1:0/1263539349 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fc304076350 0x7fc304078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:28.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.031+0000 7fc316ffd640 1 --2- 172.21.15.1:0/1263539349 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fc304076350 0x7fc304078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:28.033 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.032+0000 7fc316ffd640 1 --2- 172.21.15.1:0/1263539349 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fc304076350 0x7fc304078860 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc308009670 tx=0x7fc308006bf0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:28.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.051+0000 7fc2ff7fe640 1 -- 172.21.15.1:0/1263539349 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fc3180ac6b0 con 0x7fc31004da40 2024-05-04T02:20:28.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.051+0000 7fc2ff7fe640 1 -- 172.21.15.1:0/1263539349 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc3180c8030 con 0x7fc31004da40 2024-05-04T02:20:28.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.071+0000 7f13836b6640 1 -- 172.21.15.1:0/632456844 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f137c0c6c70 con 0x7f137c155e40 2024-05-04T02:20:28.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.243+0000 7fc2fdffb640 1 -- 172.21.15.1:0/1263539349 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fc2f0005850 con 0x7fc31004da40 2024-05-04T02:20:28.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.294+0000 7f89737fe640 1 -- 172.21.15.1:0/1491288967 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f897c061040 con 0x7f898c06dbe0 2024-05-04T02:20:28.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.298+0000 7fb66e7fc640 1 -- 172.21.15.1:0/1667933240 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb668044020 con 0x7fb6780cb200 2024-05-04T02:20:28.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.298+0000 7fb66e7fc640 1 --2- 172.21.15.1:0/1667933240 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fb65c076300 0x7fb65c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:28.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.298+0000 7fb67df86640 1 --2- 172.21.15.1:0/1667933240 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fb65c076300 0x7fb65c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:28.301 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.299+0000 7fb67df86640 1 --2- 172.21.15.1:0/1667933240 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fb65c076300 0x7fb65c078810 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb674001550 tx=0x7fb674007970 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:28.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.303+0000 7fb66e7fc640 1 -- 172.21.15.1:0/1667933240 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fb668030d60 con 0x7fb6780cb200 2024-05-04T02:20:28.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.314+0000 7fb66e7fc640 1 -- 172.21.15.1:0/1667933240 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb66804b030 con 0x7fb6780cb200 2024-05-04T02:20:28.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.369+0000 7f3bdaffd640 1 -- 172.21.15.1:0/830994357 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3be0018020 con 0x7f3bec158b30 2024-05-04T02:20:28.371 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.370+0000 7f3bdaffd640 1 --2- 172.21.15.1:0/830994357 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f3bcc076350 0x7f3bcc078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:28.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.370+0000 7f3bea59c640 1 --2- 172.21.15.1:0/830994357 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f3bcc076350 0x7f3bcc078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:28.372 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.371+0000 7f3bea59c640 1 --2- 172.21.15.1:0/830994357 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f3bcc076350 0x7f3bcc078860 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc034000 tx=0x7f3bdc02d000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:28.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.387+0000 7f3bdaffd640 1 -- 172.21.15.1:0/830994357 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f3be0011da0 con 0x7f3bec158b30 2024-05-04T02:20:28.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.387+0000 7f3bdaffd640 1 -- 172.21.15.1:0/830994357 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f3be001f020 con 0x7f3bec158b30 2024-05-04T02:20:28.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.396+0000 7fc2ff7fe640 1 -- 172.21.15.1:0/1263539349 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc3180fefb0 con 0x7fc31004da40 2024-05-04T02:20:28.399 INFO:teuthology.orchestra.run.smithi001.stdout:64424509449 2024-05-04T02:20:28.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.400+0000 7fc2fdffb640 1 -- 172.21.15.1:0/1263539349 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fc304076350 msgr2=0x7fc304078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:28.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.400+0000 7fc2fdffb640 1 --2- 172.21.15.1:0/1263539349 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fc304076350 0x7fc304078860 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc308009670 tx=0x7fc308006bf0 comp rx=0 tx=0).stop 2024-05-04T02:20:28.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.400+0000 7fc2fdffb640 1 -- 172.21.15.1:0/1263539349 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc31004da40 msgr2=0x7fc310008310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:28.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.400+0000 7fc2fdffb640 1 --2- 172.21.15.1:0/1263539349 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc31004da40 0x7fc310008310 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc318052170 tx=0x7fc31806b590 comp rx=0 tx=0).stop 2024-05-04T02:20:28.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.400+0000 7fc2fdffb640 1 -- 172.21.15.1:0/1263539349 shutdown_connections 2024-05-04T02:20:28.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.400+0000 7fc2fdffb640 1 --2- 172.21.15.1:0/1263539349 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fc304076350 0x7fc304078860 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:28.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.400+0000 7fc2fdffb640 1 --2- 172.21.15.1:0/1263539349 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc31004da40 0x7fc310008310 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:28.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.400+0000 7fc2fdffb640 1 --2- 172.21.15.1:0/1263539349 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc3100480b0 0x7fc310177f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:28.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.400+0000 7fc2fdffb640 1 --2- 172.21.15.1:0/1263539349 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc310047ca0 0x7fc3101758a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:28.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.400+0000 7fc2fdffb640 1 -- 172.21.15.1:0/1263539349 >> 172.21.15.1:0/1263539349 conn(0x7fc3100514b0 msgr2=0x7fc3100cf150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:28.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.400+0000 7fc2fdffb640 1 -- 172.21.15.1:0/1263539349 shutdown_connections 2024-05-04T02:20:28.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.400+0000 7fc2fdffb640 1 -- 172.21.15.1:0/1263539349 wait complete. 2024-05-04T02:20:28.416 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.6 2024-05-04T02:20:28.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.511+0000 7fb6801ea640 1 -- 172.21.15.1:0/1667933240 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fb67815ec10 con 0x7fb6780cb200 2024-05-04T02:20:28.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.515+0000 7f908259c640 1 --2- 172.21.15.1:0/808563636 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f90840cc590 0x7f90840cb710 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f907800b3e0 tx=0x7f907800b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:28.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.519+0000 7f89917f3640 1 -- 172.21.15.1:0/1491288967 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f898c0c4740 con 0x7f898c06dbe0 2024-05-04T02:20:28.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.520+0000 7fb66e7fc640 1 -- 172.21.15.1:0/1667933240 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb668081b50 con 0x7fb6780cb200 2024-05-04T02:20:28.522 INFO:teuthology.orchestra.run.smithi001.stdout:64424509448 2024-05-04T02:20:28.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.523+0000 7fb6801ea640 1 -- 172.21.15.1:0/1667933240 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fb65c076300 msgr2=0x7fb65c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:28.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.523+0000 7fb6801ea640 1 --2- 172.21.15.1:0/1667933240 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fb65c076300 0x7fb65c078810 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb674001550 tx=0x7fb674007970 comp rx=0 tx=0).stop 2024-05-04T02:20:28.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.523+0000 7fb6801ea640 1 -- 172.21.15.1:0/1667933240 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb6780cb200 msgr2=0x7fb6781ec1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:28.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.523+0000 7fb6801ea640 1 --2- 172.21.15.1:0/1667933240 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb6780cb200 0x7fb6781ec1c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb668009960 tx=0x7fb6680046c0 comp rx=0 tx=0).stop 2024-05-04T02:20:28.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.523+0000 7fb6801ea640 1 -- 172.21.15.1:0/1667933240 shutdown_connections 2024-05-04T02:20:28.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.523+0000 7fb6801ea640 1 --2- 172.21.15.1:0/1667933240 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fb65c076300 0x7fb65c078810 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:28.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.523+0000 7fb6801ea640 1 --2- 172.21.15.1:0/1667933240 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fb6781614f0 0x7fb678152850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:28.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.523+0000 7fb6801ea640 1 --2- 172.21.15.1:0/1667933240 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb6780cb200 0x7fb6781ec1c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:28.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.523+0000 7fb6801ea640 1 --2- 172.21.15.1:0/1667933240 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fb6780ca980 0x7fb6780cd530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:28.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.523+0000 7fb6801ea640 1 -- 172.21.15.1:0/1667933240 >> 172.21.15.1:0/1667933240 conn(0x7fb6780731f0 msgr2=0x7fb678158c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:28.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.523+0000 7fb6801ea640 1 -- 172.21.15.1:0/1667933240 shutdown_connections 2024-05-04T02:20:28.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.523+0000 7fb6801ea640 1 -- 172.21.15.1:0/1667933240 wait complete. 2024-05-04T02:20:28.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.528+0000 7f89737fe640 1 -- 172.21.15.1:0/1491288967 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f897c060940 con 0x7f898c06dbe0 2024-05-04T02:20:28.530 INFO:teuthology.orchestra.run.smithi001.stdout:64424509449 2024-05-04T02:20:28.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.530+0000 7f89917f3640 1 -- 172.21.15.1:0/1491288967 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f8978076320 msgr2=0x7f8978078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:28.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.530+0000 7f89917f3640 1 --2- 172.21.15.1:0/1491288967 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f8978076320 0x7f8978078830 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8980036000 tx=0x7f8980030000 comp rx=0 tx=0).stop 2024-05-04T02:20:28.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.530+0000 7f89917f3640 1 -- 172.21.15.1:0/1491288967 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f898c06dbe0 msgr2=0x7f898c20bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:28.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.530+0000 7f89917f3640 1 --2- 172.21.15.1:0/1491288967 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f898c06dbe0 0x7f898c20bb30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f897c00b6b0 tx=0x7f897c00bb70 comp rx=0 tx=0).stop 2024-05-04T02:20:28.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.530+0000 7f89917f3640 1 -- 172.21.15.1:0/1491288967 shutdown_connections 2024-05-04T02:20:28.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.530+0000 7f89917f3640 1 --2- 172.21.15.1:0/1491288967 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f8978076320 0x7f8978078830 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:28.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.530+0000 7f89917f3640 1 --2- 172.21.15.1:0/1491288967 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f898c1634b0 0x7f898c15edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:28.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.530+0000 7f89917f3640 1 --2- 172.21.15.1:0/1491288967 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f898c073ef0 0x7f898c165550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:28.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.530+0000 7f89917f3640 1 --2- 172.21.15.1:0/1491288967 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f898c06dbe0 0x7f898c20bb30 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:28.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.530+0000 7f89917f3640 1 -- 172.21.15.1:0/1491288967 >> 172.21.15.1:0/1491288967 conn(0x7f898c0ca060 msgr2=0x7f898c160b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:28.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.530+0000 7f89917f3640 1 -- 172.21.15.1:0/1491288967 shutdown_connections 2024-05-04T02:20:28.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.530+0000 7f89917f3640 1 -- 172.21.15.1:0/1491288967 wait complete. 2024-05-04T02:20:28.537 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.1 2024-05-04T02:20:28.545 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.2 2024-05-04T02:20:28.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.550+0000 7f2469ffb640 1 -- 172.21.15.1:0/3263601603 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2464018020 con 0x7f24740c7da0 2024-05-04T02:20:28.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.551+0000 7f2469ffb640 1 --2- 172.21.15.1:0/3263601603 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f2458076320 0x7f2458078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:28.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.551+0000 7f2478c43640 1 --2- 172.21.15.1:0/3263601603 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f2458076320 0x7f2458078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:28.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.551+0000 7f2478c43640 1 --2- 172.21.15.1:0/3263601603 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f2458076320 0x7f2458078830 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2470034000 tx=0x7f247002c000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:28.556 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.554+0000 7f2469ffb640 1 -- 172.21.15.1:0/3263601603 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f2464011de0 con 0x7f24740c7da0 2024-05-04T02:20:28.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.565+0000 7f2469ffb640 1 -- 172.21.15.1:0/3263601603 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f246401f020 con 0x7f24740c7da0 2024-05-04T02:20:28.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.573+0000 7f4b527fc640 1 -- 172.21.15.1:0/2428605116 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4b4c01a070 con 0x7f4b5c0cb580 2024-05-04T02:20:28.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.573+0000 7f4b527fc640 1 --2- 172.21.15.1:0/2428605116 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f4b40076320 0x7f4b40078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:28.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.573+0000 7f4b618db640 1 --2- 172.21.15.1:0/2428605116 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f4b40076320 0x7f4b40078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:28.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.574+0000 7f4b618db640 1 --2- 172.21.15.1:0/2428605116 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f4b40076320 0x7f4b40078830 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4b58009670 tx=0x7f4b58006bf0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:28.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.577+0000 7f4b527fc640 1 -- 172.21.15.1:0/2428605116 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f4b4c05c2a0 con 0x7f4b5c0cb580 2024-05-04T02:20:28.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.589+0000 7f4b527fc640 1 -- 172.21.15.1:0/2428605116 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4b5c152fd0 con 0x7f4b5c0cb580 2024-05-04T02:20:28.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.600+0000 7f906b7fe640 1 -- 172.21.15.1:0/808563636 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9078015020 con 0x7f90840cc590 2024-05-04T02:20:28.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.600+0000 7f906b7fe640 1 -- 172.21.15.1:0/808563636 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9078011850 con 0x7f90840cc590 2024-05-04T02:20:28.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.600+0000 7f908909f640 1 -- 172.21.15.1:0/808563636 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f908415dff0 con 0x7f90840cc590 2024-05-04T02:20:28.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.600+0000 7f906b7fe640 1 -- 172.21.15.1:0/808563636 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9078011c40 con 0x7f90840cc590 2024-05-04T02:20:28.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.600+0000 7f908909f640 1 -- 172.21.15.1:0/808563636 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f90841f2a40 con 0x7f90840cc590 2024-05-04T02:20:28.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.601+0000 7f908909f640 1 -- 172.21.15.1:0/808563636 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9084069bc0 con 0x7f90840cc590 2024-05-04T02:20:28.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.601+0000 7f1371ffb640 1 -- 172.21.15.1:0/632456844 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1378060bc0 con 0x7f137c155e40 2024-05-04T02:20:28.605 INFO:teuthology.orchestra.run.smithi001.stdout:64424509449 2024-05-04T02:20:28.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.604+0000 7f13836b6640 1 -- 172.21.15.1:0/632456844 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f1360076320 msgr2=0x7f1360078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:28.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.604+0000 7f13836b6640 1 --2- 172.21.15.1:0/632456844 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f1360076320 0x7f1360078830 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f137400e250 tx=0x7f137400b040 comp rx=0 tx=0).stop 2024-05-04T02:20:28.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.604+0000 7f13836b6640 1 -- 172.21.15.1:0/632456844 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f137c155e40 msgr2=0x7f137c12cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:28.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.604+0000 7f13836b6640 1 --2- 172.21.15.1:0/632456844 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f137c155e40 0x7f137c12cf30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f137800d5d0 tx=0x7f137800da90 comp rx=0 tx=0).stop 2024-05-04T02:20:28.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.604+0000 7f13836b6640 1 -- 172.21.15.1:0/632456844 shutdown_connections 2024-05-04T02:20:28.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.604+0000 7f13836b6640 1 --2- 172.21.15.1:0/632456844 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f1360076320 0x7f1360078830 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:28.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.604+0000 7f13836b6640 1 --2- 172.21.15.1:0/632456844 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f137c155e40 0x7f137c12cf30 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:28.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.604+0000 7f13836b6640 1 --2- 172.21.15.1:0/632456844 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f137c0c3dc0 0x7f137c0c6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:28.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.604+0000 7f13836b6640 1 --2- 172.21.15.1:0/632456844 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f137c0c39b0 0x7f137c141020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:28.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.604+0000 7f13836b6640 1 -- 172.21.15.1:0/632456844 >> 172.21.15.1:0/632456844 conn(0x7f137c0caaf0 msgr2=0x7f137c06d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:28.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.604+0000 7f13836b6640 1 -- 172.21.15.1:0/632456844 shutdown_connections 2024-05-04T02:20:28.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.604+0000 7f13836b6640 1 -- 172.21.15.1:0/632456844 wait complete. 2024-05-04T02:20:28.618 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.7 2024-05-04T02:20:28.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.649+0000 7f3bf0986640 1 -- 172.21.15.1:0/830994357 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f3bec076740 con 0x7f3bec158b30 2024-05-04T02:20:28.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.656+0000 7f3bdaffd640 1 -- 172.21.15.1:0/830994357 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3be0061430 con 0x7f3bec158b30 2024-05-04T02:20:28.659 INFO:teuthology.orchestra.run.smithi001.stdout:64424509449 2024-05-04T02:20:28.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.659+0000 7f3bf0986640 1 -- 172.21.15.1:0/830994357 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f3bcc076350 msgr2=0x7f3bcc078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:28.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.659+0000 7f3bf0986640 1 --2- 172.21.15.1:0/830994357 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f3bcc076350 0x7f3bcc078860 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc034000 tx=0x7f3bdc02d000 comp rx=0 tx=0).stop 2024-05-04T02:20:28.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.659+0000 7f3bf0986640 1 -- 172.21.15.1:0/830994357 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3bec158b30 msgr2=0x7f3bec1574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:28.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.659+0000 7f3bf0986640 1 --2- 172.21.15.1:0/830994357 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3bec158b30 0x7f3bec1574e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3be000b410 tx=0x7f3be000b8d0 comp rx=0 tx=0).stop 2024-05-04T02:20:28.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.659+0000 7f3bf0986640 1 -- 172.21.15.1:0/830994357 shutdown_connections 2024-05-04T02:20:28.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.659+0000 7f3bf0986640 1 --2- 172.21.15.1:0/830994357 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f3bcc076350 0x7f3bcc078860 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:28.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.659+0000 7f3bf0986640 1 --2- 172.21.15.1:0/830994357 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3bec1de6b0 0x7f3bec14f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:28.661 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.659+0000 7f3bf0986640 1 --2- 172.21.15.1:0/830994357 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3bec158b30 0x7f3bec1574e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:28.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.659+0000 7f3bf0986640 1 --2- 172.21.15.1:0/830994357 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3bec1527f0 0x7f3bec1ee4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:28.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.659+0000 7f3bf0986640 1 -- 172.21.15.1:0/830994357 >> 172.21.15.1:0/830994357 conn(0x7f3bec073e60 msgr2=0x7f3bec151bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:28.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.659+0000 7f3bf0986640 1 -- 172.21.15.1:0/830994357 shutdown_connections 2024-05-04T02:20:28.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.659+0000 7f3bf0986640 1 -- 172.21.15.1:0/830994357 wait complete. 2024-05-04T02:20:28.672 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.5 2024-05-04T02:20:28.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.786+0000 7f4b63b3f640 1 -- 172.21.15.1:0/2428605116 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f4b5c076740 con 0x7f4b5c0cb580 2024-05-04T02:20:28.800 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.798+0000 7f247b6a8640 1 -- 172.21.15.1:0/3263601603 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f24740c6c40 con 0x7f24740c7da0 2024-05-04T02:20:28.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.888+0000 7f906b7fe640 1 -- 172.21.15.1:0/808563636 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9078018020 con 0x7f90840cc590 2024-05-04T02:20:28.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.889+0000 7f906b7fe640 1 --2- 172.21.15.1:0/808563636 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f9070076320 0x7f9070078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:28.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.889+0000 7f9082d9d640 1 --2- 172.21.15.1:0/808563636 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f9070076320 0x7f9070078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:28.892 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.890+0000 7f9082d9d640 1 --2- 172.21.15.1:0/808563636 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f9070076320 0x7f9070078830 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f908406e200 tx=0x7f9074006bf0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:28.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.893+0000 7f906b7fe640 1 -- 172.21.15.1:0/808563636 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f9078011de0 con 0x7f90840cc590 2024-05-04T02:20:28.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.893+0000 7f2469ffb640 1 -- 172.21.15.1:0/3263601603 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2474159c70 con 0x7f24740c7da0 2024-05-04T02:20:28.896 INFO:teuthology.orchestra.run.smithi001.stdout:55834574856 2024-05-04T02:20:28.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.896+0000 7f247b6a8640 1 -- 172.21.15.1:0/3263601603 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f2458076320 msgr2=0x7f2458078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:28.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.896+0000 7f247b6a8640 1 --2- 172.21.15.1:0/3263601603 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f2458076320 0x7f2458078830 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2470034000 tx=0x7f247002c000 comp rx=0 tx=0).stop 2024-05-04T02:20:28.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.896+0000 7f247b6a8640 1 -- 172.21.15.1:0/3263601603 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f24740c7da0 msgr2=0x7f24741f2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:28.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.896+0000 7f247b6a8640 1 --2- 172.21.15.1:0/3263601603 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f24740c7da0 0x7f24741f2460 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f246400b3e0 tx=0x7f246400b8a0 comp rx=0 tx=0).stop 2024-05-04T02:20:28.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.896+0000 7f247b6a8640 1 -- 172.21.15.1:0/3263601603 shutdown_connections 2024-05-04T02:20:28.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.896+0000 7f247b6a8640 1 --2- 172.21.15.1:0/3263601603 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f2458076320 0x7f2458078830 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:28.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.896+0000 7f247b6a8640 1 --2- 172.21.15.1:0/3263601603 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f247406d030 0x7f2474152240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:28.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.896+0000 7f247b6a8640 1 --2- 172.21.15.1:0/3263601603 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24740cc590 0x7f247415fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:28.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.896+0000 7f247b6a8640 1 --2- 172.21.15.1:0/3263601603 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f24740c7da0 0x7f24741f2460 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:28.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.896+0000 7f247b6a8640 1 -- 172.21.15.1:0/3263601603 >> 172.21.15.1:0/3263601603 conn(0x7f24740d2590 msgr2=0x7f24740b5c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:28.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.896+0000 7f247b6a8640 1 -- 172.21.15.1:0/3263601603 shutdown_connections 2024-05-04T02:20:28.899 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.896+0000 7f247b6a8640 1 -- 172.21.15.1:0/3263601603 wait complete. 2024-05-04T02:20:28.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.904+0000 7f906b7fe640 1 -- 172.21.15.1:0/808563636 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f907801f020 con 0x7f90840cc590 2024-05-04T02:20:28.909 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.0 2024-05-04T02:20:28.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.985+0000 7f4b527fc640 1 -- 172.21.15.1:0/2428605116 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4b4c021020 con 0x7f4b5c0cb580 2024-05-04T02:20:28.988 INFO:teuthology.orchestra.run.smithi001.stdout:60129542153 2024-05-04T02:20:28.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.988+0000 7f4b63b3f640 1 -- 172.21.15.1:0/2428605116 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f4b40076320 msgr2=0x7f4b40078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:28.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.988+0000 7f4b63b3f640 1 --2- 172.21.15.1:0/2428605116 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f4b40076320 0x7f4b40078830 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4b58009670 tx=0x7f4b58006bf0 comp rx=0 tx=0).stop 2024-05-04T02:20:28.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.988+0000 7f4b63b3f640 1 -- 172.21.15.1:0/2428605116 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4b5c0cb580 msgr2=0x7f4b5c1e5320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:28.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.988+0000 7f4b63b3f640 1 --2- 172.21.15.1:0/2428605116 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4b5c0cb580 0x7f4b5c1e5320 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c00c370 tx=0x7f4b4c00c830 comp rx=0 tx=0).stop 2024-05-04T02:20:28.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.988+0000 7f4b63b3f640 1 -- 172.21.15.1:0/2428605116 shutdown_connections 2024-05-04T02:20:28.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.988+0000 7f4b63b3f640 1 --2- 172.21.15.1:0/2428605116 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f4b40076320 0x7f4b40078830 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:28.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.988+0000 7f4b63b3f640 1 --2- 172.21.15.1:0/2428605116 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4b5c154970 0x7f4b5c153cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:28.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.988+0000 7f4b63b3f640 1 --2- 172.21.15.1:0/2428605116 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4b5c0cb580 0x7f4b5c1e5320 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:28.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.988+0000 7f4b63b3f640 1 --2- 172.21.15.1:0/2428605116 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4b5c0c4fd0 0x7f4b5c145010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:28.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.988+0000 7f4b63b3f640 1 -- 172.21.15.1:0/2428605116 >> 172.21.15.1:0/2428605116 conn(0x7f4b5c073720 msgr2=0x7f4b5c073b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:28.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.988+0000 7f4b63b3f640 1 -- 172.21.15.1:0/2428605116 shutdown_connections 2024-05-04T02:20:28.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:28.988+0000 7f4b63b3f640 1 -- 172.21.15.1:0/2428605116 wait complete. 2024-05-04T02:20:29.002 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.4 2024-05-04T02:20:29.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.119+0000 7f908909f640 1 -- 172.21.15.1:0/808563636 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f90840c6c40 con 0x7f90840cc590 2024-05-04T02:20:29.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.124+0000 7f906b7fe640 1 -- 172.21.15.1:0/808563636 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9078061510 con 0x7f90840cc590 2024-05-04T02:20:29.126 INFO:teuthology.orchestra.run.smithi001.stdout:64424509449 2024-05-04T02:20:29.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.126+0000 7f908909f640 1 -- 172.21.15.1:0/808563636 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f9070076320 msgr2=0x7f9070078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:29.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.126+0000 7f908909f640 1 --2- 172.21.15.1:0/808563636 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f9070076320 0x7f9070078830 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f908406e200 tx=0x7f9074006bf0 comp rx=0 tx=0).stop 2024-05-04T02:20:29.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.126+0000 7f908909f640 1 -- 172.21.15.1:0/808563636 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f90840cc590 msgr2=0x7f90840cb710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:29.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.126+0000 7f908909f640 1 --2- 172.21.15.1:0/808563636 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f90840cc590 0x7f90840cb710 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f907800b3e0 tx=0x7f907800b8a0 comp rx=0 tx=0).stop 2024-05-04T02:20:29.128 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.126+0000 7f908909f640 1 -- 172.21.15.1:0/808563636 shutdown_connections 2024-05-04T02:20:29.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.126+0000 7f908909f640 1 --2- 172.21.15.1:0/808563636 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f9070076320 0x7f9070078830 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:29.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.126+0000 7f908909f640 1 --2- 172.21.15.1:0/808563636 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f9084156690 0x7f90840cabd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:29.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.126+0000 7f908909f640 1 --2- 172.21.15.1:0/808563636 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f90840cc590 0x7f90840cb710 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:29.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.126+0000 7f908909f640 1 --2- 172.21.15.1:0/808563636 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f90840c7da0 0x7f908415d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:29.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.126+0000 7f908909f640 1 -- 172.21.15.1:0/808563636 >> 172.21.15.1:0/808563636 conn(0x7f90840d2590 msgr2=0x7f90840cc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:29.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.126+0000 7f908909f640 1 -- 172.21.15.1:0/808563636 shutdown_connections 2024-05-04T02:20:29.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.126+0000 7f908909f640 1 -- 172.21.15.1:0/808563636 wait complete. 2024-05-04T02:20:29.139 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.3 2024-05-04T02:20:29.417 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-04T02:20:29.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.529+0000 7f7734b34640 1 Processor -- start 2024-05-04T02:20:29.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.529+0000 7f7734b34640 1 -- start start 2024-05-04T02:20:29.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.530+0000 7f7734b34640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f77300c7e70 0x7f7730159da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:29.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.530+0000 7f7734b34640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f773008d6f0 con 0x7f77300c8740 2024-05-04T02:20:29.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.530+0000 7f7734b34640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77300c3650 con 0x7f77300c8330 2024-05-04T02:20:29.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.530+0000 7f7734b34640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f7730160a20 con 0x7f77300c7e70 2024-05-04T02:20:29.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.531+0000 7f772ed9d640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f77300c8740 0x7f7730160310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:56918/0 (socket says 172.21.15.1:56918) 2024-05-04T02:20:29.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.531+0000 7f7727fff640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f77300c8330 0x7f773015fc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.1:54794/0 (socket says 172.21.15.1:54794) 2024-05-04T02:20:29.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.531+0000 7f772ed9d640 1 -- 172.21.15.1:0/436078773 learned_addr learned my addr 172.21.15.1:0/436078773 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-05-04T02:20:29.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.531+0000 7f772e59c640 1 --2- 172.21.15.1:0/436078773 >> v2:172.21.15.1:3300/0 conn(0x7f77300c7e70 0x7f7730159da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:29.535 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.533+0000 7f772dd9b640 1 -- 172.21.15.1:0/436078773 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3959034469 0 0) 0x7f77300c3650 con 0x7f77300c8330 2024-05-04T02:20:29.535 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.533+0000 7f772dd9b640 1 -- 172.21.15.1:0/436078773 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f771c003520 con 0x7f77300c8330 2024-05-04T02:20:29.538 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-04T02:20:29.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.537+0000 7f772e59c640 1 -- 172.21.15.1:0/436078773 >> v1:172.21.15.107:6789/0 conn(0x7f77300c8330 legacy=0x7f773015fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:29.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.537+0000 7f772e59c640 1 -- 172.21.15.1:0/436078773 >> v1:172.21.15.1:6789/0 conn(0x7f77300c8740 legacy=0x7f7730160310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:29.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.537+0000 7f772e59c640 1 -- 172.21.15.1:0/436078773 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77300c4de0 con 0x7f77300c7e70 2024-05-04T02:20:29.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.539+0000 7f772e59c640 1 --2- 172.21.15.1:0/436078773 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77300c7e70 0x7f7730159da0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f77200097a0 tx=0x7f772002a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a804e2ad116f644 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:29.546 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-04T02:20:29.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.545+0000 7f772dd9b640 1 -- 172.21.15.1:0/436078773 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7720037070 con 0x7f77300c7e70 2024-05-04T02:20:29.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.545+0000 7f772dd9b640 1 -- 172.21.15.1:0/436078773 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7720032640 con 0x7f77300c7e70 2024-05-04T02:20:29.547 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.545+0000 7f772dd9b640 1 -- 172.21.15.1:0/436078773 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7720032a10 con 0x7f77300c7e70 2024-05-04T02:20:29.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.546+0000 7f7734b34640 1 -- 172.21.15.1:0/436078773 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77300c7e70 msgr2=0x7f7730159da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:29.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.546+0000 7f7734b34640 1 --2- 172.21.15.1:0/436078773 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77300c7e70 0x7f7730159da0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f77200097a0 tx=0x7f772002a2c0 comp rx=0 tx=0).stop 2024-05-04T02:20:29.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.546+0000 7f7734b34640 1 -- 172.21.15.1:0/436078773 shutdown_connections 2024-05-04T02:20:29.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.546+0000 7f7734b34640 1 --2- 172.21.15.1:0/436078773 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77300c7e70 0x7f7730159da0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:29.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.546+0000 7f7734b34640 1 -- 172.21.15.1:0/436078773 >> 172.21.15.1:0/436078773 conn(0x7f77300cf6e0 msgr2=0x7f77300cfaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:29.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.546+0000 7f7734b34640 1 -- 172.21.15.1:0/436078773 shutdown_connections 2024-05-04T02:20:29.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.546+0000 7f7734b34640 1 -- 172.21.15.1:0/436078773 wait complete. 2024-05-04T02:20:29.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.548+0000 7f7734b34640 1 Processor -- start 2024-05-04T02:20:29.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.548+0000 7f7734b34640 1 -- start start 2024-05-04T02:20:29.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.549+0000 7f7734b34640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77300c7e70 0x7f77301f33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:29.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.549+0000 7f7734b34640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f77300c8330 0x7f77300c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:29.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.549+0000 7f7734b34640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f77300c8740 0x7f7730152e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:29.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.549+0000 7f7734b34640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f77300c53a0 con 0x7f77300c7e70 2024-05-04T02:20:29.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.549+0000 7f7734b34640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f77300c59f0 con 0x7f77300c8740 2024-05-04T02:20:29.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.549+0000 7f7734b34640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f77300c5680 con 0x7f77300c8330 2024-05-04T02:20:29.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.550+0000 7f772e59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77300c7e70 0x7f77301f33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:29.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.550+0000 7f7727fff640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f77300c8330 0x7f77300c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:29.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.550+0000 7f772ed9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f77300c8740 0x7f7730152e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:29.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.551+0000 7f772e59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77300c7e70 0x7f77301f33c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41698/0 (socket says 172.21.15.1:41698) 2024-05-04T02:20:29.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.551+0000 7f7727fff640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f77300c8330 0x7f77300c9f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.1:49942/0 (socket says 172.21.15.1:49942) 2024-05-04T02:20:29.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.551+0000 7f772e59c640 1 -- 172.21.15.1:0/422206552 learned_addr learned my addr 172.21.15.1:0/422206552 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:29.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.556+0000 7f772e59c640 1 -- 172.21.15.1:0/422206552 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f77300c8330 msgr2=0x7f77300c9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:29.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.556+0000 7f772e59c640 1 --2- 172.21.15.1:0/422206552 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f77300c8330 0x7f77300c9f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:29.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.556+0000 7f772e59c640 1 -- 172.21.15.1:0/422206552 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f77300c8740 msgr2=0x7f7730152e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:29.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.556+0000 7f772e59c640 1 --2- 172.21.15.1:0/422206552 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f77300c8740 0x7f7730152e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:29.558 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.556+0000 7f772e59c640 1 -- 172.21.15.1:0/422206552 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77301f3900 con 0x7f77300c7e70 2024-05-04T02:20:29.560 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.558+0000 7f772e59c640 1 --2- 172.21.15.1:0/422206552 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77300c7e70 0x7f77301f33c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7720009890 tx=0x7f77200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:29.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.563+0000 7f7726ffd640 1 -- 172.21.15.1:0/422206552 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7720040020 con 0x7f77300c7e70 2024-05-04T02:20:29.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.563+0000 7f7726ffd640 1 -- 172.21.15.1:0/422206552 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7720038040 con 0x7f77300c7e70 2024-05-04T02:20:29.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.563+0000 7f7734b34640 1 -- 172.21.15.1:0/422206552 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7730158be0 con 0x7f77300c7e70 2024-05-04T02:20:29.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.563+0000 7f7726ffd640 1 -- 172.21.15.1:0/422206552 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7720037070 con 0x7f77300c7e70 2024-05-04T02:20:29.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.563+0000 7f7734b34640 1 -- 172.21.15.1:0/422206552 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77301f2bc0 con 0x7f77300c7e70 2024-05-04T02:20:29.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.564+0000 7f7734b34640 1 -- 172.21.15.1:0/422206552 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7730159100 con 0x7f77300c7e70 2024-05-04T02:20:29.619 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-04T02:20:29.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.654+0000 7fc723f76640 1 Processor -- start 2024-05-04T02:20:29.656 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.654+0000 7fc723f76640 1 -- start start 2024-05-04T02:20:29.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.656+0000 7fc723f76640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fc71c0c8070 0x7fc71c0726b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:29.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.656+0000 7fc723f76640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fc71c06c7f0 0x7fc71c06dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:29.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.656+0000 7fc723f76640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc71c071080 con 0x7fc71c15d900 2024-05-04T02:20:29.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.656+0000 7fc723f76640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7fc71c0c5410 con 0x7fc71c06c7f0 2024-05-04T02:20:29.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.656+0000 7fc723f76640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fc71c0c56b0 con 0x7fc71c0c8070 2024-05-04T02:20:29.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.656+0000 7fc721511640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fc71c0c8070 0x7fc71c0726b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:29.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.657+0000 7fc721d12640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fc71c15d900 0x7fc71c154540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.1:54808/0 (socket says 172.21.15.1:54808) 2024-05-04T02:20:29.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.657+0000 7fc721d12640 1 -- 172.21.15.1:0/690405803 learned_addr learned my addr 172.21.15.1:0/690405803 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-05-04T02:20:29.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.660+0000 7fadb96fa640 1 Processor -- start 2024-05-04T02:20:29.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.660+0000 7fadb96fa640 1 -- start start 2024-05-04T02:20:29.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.662+0000 7fadb96fa640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fadb40ca870 0x7fadb415d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:29.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.662+0000 7fadb96fa640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadb40c8d70 con 0x7fadb40b73c0 2024-05-04T02:20:29.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.662+0000 7fadb96fa640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadb40c9010 con 0x7fadb4156af0 2024-05-04T02:20:29.664 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.662+0000 7fadb96fa640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7fadb415d5d0 con 0x7fadb40ca870 2024-05-04T02:20:29.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.662+0000 7fc721511640 1 -- 172.21.15.1:0/690405803 >> v2:172.21.15.1:3300/0 conn(0x7fc71c06c7f0 msgr2=0x7fc71c06dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:29.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.662+0000 7fc721511640 1 --2- 172.21.15.1:0/690405803 >> v2:172.21.15.1:3300/0 conn(0x7fc71c06c7f0 0x7fc71c06dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:29.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.662+0000 7fc721511640 1 -- 172.21.15.1:0/690405803 >> v1:172.21.15.107:6789/0 conn(0x7fc71c15d900 legacy=0x7fc71c154540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:29.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.662+0000 7fc721511640 1 -- 172.21.15.1:0/690405803 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc71c06d4b0 con 0x7fc71c0c8070 2024-05-04T02:20:29.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.666+0000 7fc721511640 1 --2- 172.21.15.1:0/690405803 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc71c0c8070 0x7fc71c0726b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc71c073650 tx=0x7fc70c02a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f62ff93736693f35 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:29.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.668+0000 7fadb2ffd640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fadb4156af0 0x7fadb40ccfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.1:54814/0 (socket says 172.21.15.1:54814) 2024-05-04T02:20:29.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.668+0000 7fadb2ffd640 1 -- 172.21.15.1:0/2472566529 learned_addr learned my addr 172.21.15.1:0/2472566529 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-05-04T02:20:29.673 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-04T02:20:29.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.672+0000 7fc720d10640 1 -- 172.21.15.1:0/690405803 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc70c037070 con 0x7fc71c0c8070 2024-05-04T02:20:29.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.672+0000 7fc720d10640 1 -- 172.21.15.1:0/690405803 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc70c032440 con 0x7fc71c0c8070 2024-05-04T02:20:29.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.672+0000 7fc720d10640 1 -- 172.21.15.1:0/690405803 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc70c032810 con 0x7fc71c0c8070 2024-05-04T02:20:29.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.672+0000 7fc723f76640 1 -- 172.21.15.1:0/690405803 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc71c0c8070 msgr2=0x7fc71c0726b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:29.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.672+0000 7fc723f76640 1 --2- 172.21.15.1:0/690405803 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc71c0c8070 0x7fc71c0726b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc71c073650 tx=0x7fc70c02a230 comp rx=0 tx=0).stop 2024-05-04T02:20:29.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.673+0000 7fc723f76640 1 -- 172.21.15.1:0/690405803 shutdown_connections 2024-05-04T02:20:29.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.673+0000 7fc723f76640 1 --2- 172.21.15.1:0/690405803 >> v2:172.21.15.1:3300/0 conn(0x7fc71c06c7f0 0x7fc71c06dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:29.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.673+0000 7fc723f76640 1 --2- 172.21.15.1:0/690405803 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc71c0c8070 0x7fc71c0726b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:29.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.673+0000 7fc723f76640 1 -- 172.21.15.1:0/690405803 >> 172.21.15.1:0/690405803 conn(0x7fc71c071b90 msgr2=0x7fc71c071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:29.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.673+0000 7fc723f76640 1 -- 172.21.15.1:0/690405803 shutdown_connections 2024-05-04T02:20:29.675 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.673+0000 7fc723f76640 1 -- 172.21.15.1:0/690405803 wait complete. 2024-05-04T02:20:29.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.675+0000 7fc723f76640 1 Processor -- start 2024-05-04T02:20:29.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.675+0000 7fc723f76640 1 -- start start 2024-05-04T02:20:29.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.675+0000 7fadb1ffb640 1 -- 172.21.15.1:0/2472566529 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3773065171 0 0) 0x7fadb40c9010 con 0x7fadb4156af0 2024-05-04T02:20:29.677 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.675+0000 7fadb1ffb640 1 -- 172.21.15.1:0/2472566529 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad9c003520 con 0x7fadb4156af0 2024-05-04T02:20:29.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.676+0000 7fc723f76640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc71c06c7f0 0x7fc71c1effe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:29.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.676+0000 7fc723f76640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc71c0c8070 0x7fc71c15b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:29.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.676+0000 7fc723f76640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc71c15d900 0x7fc71c1528c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:29.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.676+0000 7fc723f76640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fc71c06d790 con 0x7fc71c06c7f0 2024-05-04T02:20:29.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.676+0000 7fc723f76640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fc71c06dd00 con 0x7fc71c15d900 2024-05-04T02:20:29.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.676+0000 7fc723f76640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fc71c06cc00 con 0x7fc71c0c8070 2024-05-04T02:20:29.679 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.677+0000 7fc721511640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc71c0c8070 0x7fc71c15b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:29.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.677+0000 7fc721511640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc71c0c8070 0x7fc71c15b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.1:49948/0 (socket says 172.21.15.1:49948) 2024-05-04T02:20:29.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.677+0000 7fc721511640 1 -- 172.21.15.1:0/1953087197 learned_addr learned my addr 172.21.15.1:0/1953087197 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:29.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.679+0000 7fadb1ffb640 1 -- 172.21.15.1:0/2472566529 <== mon.1 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1712258297 0 0) 0x7fad9c003520 con 0x7fadb4156af0 2024-05-04T02:20:29.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.679+0000 7fadb1ffb640 1 -- 172.21.15.1:0/2472566529 >> v2:172.21.15.1:3300/0 conn(0x7fadb40ca870 msgr2=0x7fadb415d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:29.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.679+0000 7fadb1ffb640 1 --2- 172.21.15.1:0/2472566529 >> v2:172.21.15.1:3300/0 conn(0x7fadb40ca870 0x7fadb415d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:29.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.679+0000 7fadb1ffb640 1 -- 172.21.15.1:0/2472566529 >> v1:172.21.15.1:6789/0 conn(0x7fadb40b73c0 legacy=0x7fadb40ca160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:29.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.679+0000 7fadb1ffb640 1 -- 172.21.15.1:0/2472566529 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadb40c92f0 con 0x7fadb4156af0 2024-05-04T02:20:29.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.679+0000 7fadb1ffb640 1 -- 172.21.15.1:0/2472566529 <== mon.1 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1418761865 0 0) 0x7fada40016f0 con 0x7fadb4156af0 2024-05-04T02:20:29.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.679+0000 7fadb1ffb640 1 -- 172.21.15.1:0/2472566529 >> v1:172.21.15.107:6789/0 conn(0x7fadb4156af0 legacy=0x7fadb40ccfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:29.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.679+0000 7fadb1ffb640 1 --2- 172.21.15.1:0/2472566529 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fad9c003a50 0x7fad9c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:29.682 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.679+0000 7fadb1ffb640 1 --2- 172.21.15.1:0/2472566529 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fad9c004800 0x7fad9c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:29.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.679+0000 7fadb1ffb640 1 --2- 172.21.15.1:0/2472566529 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fad9c0053f0 0x7fad9c00ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:29.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.679+0000 7fadb1ffb640 1 -- 172.21.15.1:0/2472566529 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fadb415d5d0 con 0x7fad9c004800 2024-05-04T02:20:29.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.679+0000 7fadb1ffb640 1 -- 172.21.15.1:0/2472566529 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fad9c00c350 con 0x7fad9c0053f0 2024-05-04T02:20:29.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.679+0000 7fadb1ffb640 1 -- 172.21.15.1:0/2472566529 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fad9c00c550 con 0x7fad9c003a50 2024-05-04T02:20:29.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.679+0000 7fc722513640 1 --2- 172.21.15.1:0/1953087197 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc71c15d900 0x7fc71c1528c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:29.683 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.682+0000 7fadb37fe640 1 --2- 172.21.15.1:0/2472566529 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fad9c0053f0 0x7fad9c00ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:29.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.683+0000 7fc721511640 1 -- 172.21.15.1:0/1953087197 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc71c15d900 msgr2=0x7fc71c1528c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:29.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.683+0000 7fc721511640 1 --2- 172.21.15.1:0/1953087197 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc71c15d900 0x7fc71c1528c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:29.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.683+0000 7fc721511640 1 -- 172.21.15.1:0/1953087197 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc71c06c7f0 msgr2=0x7fc71c1effe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:29.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.683+0000 7fc721511640 1 --2- 172.21.15.1:0/1953087197 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc71c06c7f0 0x7fc71c1effe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:29.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.683+0000 7fc721511640 1 -- 172.21.15.1:0/1953087197 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc71c15bda0 con 0x7fc71c0c8070 2024-05-04T02:20:29.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.686+0000 7fadb2ffd640 1 --2- 172.21.15.1:0/2472566529 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fad9c003a50 0x7fad9c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:29.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.687+0000 7fc721511640 1 --2- 172.21.15.1:0/1953087197 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc71c0c8070 0x7fc71c15b860 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc70c009890 tx=0x7fc70c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:29.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.690+0000 7fadb2ffd640 1 -- 172.21.15.1:0/2472566529 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fad9c0053f0 msgr2=0x7fad9c00ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:29.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.690+0000 7fadb2ffd640 1 --2- 172.21.15.1:0/2472566529 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fad9c0053f0 0x7fad9c00ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:29.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.690+0000 7fadb2ffd640 1 -- 172.21.15.1:0/2472566529 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fad9c004800 msgr2=0x7fad9c004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:29.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.690+0000 7fadb2ffd640 1 --2- 172.21.15.1:0/2472566529 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fad9c004800 0x7fad9c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:29.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.690+0000 7fadb37fe640 1 -- 172.21.15.1:0/2472566529 reap_dead start 2024-05-04T02:20:29.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.690+0000 7fadb2ffd640 1 -- 172.21.15.1:0/2472566529 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad9c003520 con 0x7fad9c003a50 2024-05-04T02:20:29.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.696+0000 7fc7127fc640 1 -- 172.21.15.1:0/1953087197 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc70c037040 con 0x7fc71c0c8070 2024-05-04T02:20:29.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.696+0000 7fc7127fc640 1 -- 172.21.15.1:0/1953087197 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc70c042070 con 0x7fc71c0c8070 2024-05-04T02:20:29.698 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.696+0000 7fc723f76640 1 -- 172.21.15.1:0/1953087197 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc71c14e0f0 con 0x7fc71c0c8070 2024-05-04T02:20:29.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.696+0000 7fadb2ffd640 1 --2- 172.21.15.1:0/2472566529 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fad9c003a50 0x7fad9c003ea0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fadb4052220 tx=0x7fad9c005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8e87b68ca5de6bf server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:29.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.696+0000 7fc7127fc640 1 -- 172.21.15.1:0/1953087197 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc70c030bd0 con 0x7fc71c0c8070 2024-05-04T02:20:29.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.696+0000 7fc723f76640 1 -- 172.21.15.1:0/1953087197 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc71c14e970 con 0x7fc71c0c8070 2024-05-04T02:20:29.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.697+0000 7fc723f76640 1 -- 172.21.15.1:0/1953087197 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc71c14e3e0 con 0x7fc71c0c8070 2024-05-04T02:20:29.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.708+0000 7fadb1ffb640 1 -- 172.21.15.1:0/2472566529 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada4007ce0 con 0x7fad9c003a50 2024-05-04T02:20:29.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.708+0000 7fadb1ffb640 1 -- 172.21.15.1:0/2472566529 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fada4005ad0 con 0x7fad9c003a50 2024-05-04T02:20:29.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.708+0000 7fadb1ffb640 1 -- 172.21.15.1:0/2472566529 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada4007070 con 0x7fad9c003a50 2024-05-04T02:20:29.711 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.709+0000 7fadb96fa640 1 -- 172.21.15.1:0/2472566529 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fad9c003a50 msgr2=0x7fad9c003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:29.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.709+0000 7fadb96fa640 1 --2- 172.21.15.1:0/2472566529 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fad9c003a50 0x7fad9c003ea0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fadb4052220 tx=0x7fad9c005830 comp rx=0 tx=0).stop 2024-05-04T02:20:29.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.709+0000 7fadb96fa640 1 -- 172.21.15.1:0/2472566529 shutdown_connections 2024-05-04T02:20:29.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.709+0000 7fadb96fa640 1 --2- 172.21.15.1:0/2472566529 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fad9c003a50 0x7fad9c003ea0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:29.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.709+0000 7fadb96fa640 1 -- 172.21.15.1:0/2472566529 >> 172.21.15.1:0/2472566529 conn(0x7fadb40ce980 msgr2=0x7fadb408cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:29.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.709+0000 7fadb96fa640 1 -- 172.21.15.1:0/2472566529 shutdown_connections 2024-05-04T02:20:29.712 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.709+0000 7fadb96fa640 1 -- 172.21.15.1:0/2472566529 wait complete. 2024-05-04T02:20:29.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.713+0000 7fadb96fa640 1 Processor -- start 2024-05-04T02:20:29.715 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.713+0000 7fadb96fa640 1 -- start start 2024-05-04T02:20:29.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.715+0000 7fadb96fa640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fad9c003a50 0x7fadb41f5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:29.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.715+0000 7fadb96fa640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fadb415f4b0 0x7fadb40cd160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:29.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.715+0000 7fadb96fa640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fadb415d770 0x7fadb414ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:29.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.715+0000 7fadb96fa640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fadb40c98b0 con 0x7fadb415d770 2024-05-04T02:20:29.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.715+0000 7fadb96fa640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fadb40c9c20 con 0x7fad9c003a50 2024-05-04T02:20:29.717 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.715+0000 7fadb96fa640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fadb40b77d0 con 0x7fadb415f4b0 2024-05-04T02:20:29.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.716+0000 7fadb2ffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fad9c003a50 0x7fadb41f5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:29.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.716+0000 7fadb2ffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fad9c003a50 0x7fadb41f5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.1:47340/0 (socket says 172.21.15.1:47340) 2024-05-04T02:20:29.718 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.716+0000 7fadb2ffd640 1 -- 172.21.15.1:0/3755642654 learned_addr learned my addr 172.21.15.1:0/3755642654 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:29.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.720+0000 7fadb2ffd640 1 -- 172.21.15.1:0/3755642654 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fadb415f4b0 msgr2=0x7fadb40cd160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:29.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.720+0000 7fadb2ffd640 1 --2- 172.21.15.1:0/3755642654 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fadb415f4b0 0x7fadb40cd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:29.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.720+0000 7fadb2ffd640 1 -- 172.21.15.1:0/3755642654 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fadb415d770 msgr2=0x7fadb414ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:29.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.720+0000 7fadb2ffd640 1 --2- 172.21.15.1:0/3755642654 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fadb415d770 0x7fadb414ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:29.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.720+0000 7fadb2ffd640 1 -- 172.21.15.1:0/3755642654 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadb415eec0 con 0x7fad9c003a50 2024-05-04T02:20:29.725 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.723+0000 7fadb2ffd640 1 --2- 172.21.15.1:0/3755642654 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fad9c003a50 0x7fadb41f5cf0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fada402acf0 tx=0x7fada8000fb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:29.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.728+0000 7fad9b7fe640 1 -- 172.21.15.1:0/3755642654 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada4042070 con 0x7fad9c003a50 2024-05-04T02:20:29.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.728+0000 7fad9b7fe640 1 -- 172.21.15.1:0/3755642654 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fada40047e0 con 0x7fad9c003a50 2024-05-04T02:20:29.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.728+0000 7fad9b7fe640 1 -- 172.21.15.1:0/3755642654 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada4037040 con 0x7fad9c003a50 2024-05-04T02:20:29.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.728+0000 7fadb96fa640 1 -- 172.21.15.1:0/3755642654 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadb414f800 con 0x7fad9c003a50 2024-05-04T02:20:29.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.728+0000 7fadb96fa640 1 -- 172.21.15.1:0/3755642654 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadb414fdc0 con 0x7fad9c003a50 2024-05-04T02:20:29.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.729+0000 7fadb96fa640 1 -- 172.21.15.1:0/3755642654 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadb4076740 con 0x7fad9c003a50 2024-05-04T02:20:29.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.738+0000 7f306662b640 1 Processor -- start 2024-05-04T02:20:29.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.738+0000 7f306662b640 1 -- start start 2024-05-04T02:20:29.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.740+0000 7f306662b640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f306015cfb0 0x7f3060167ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:29.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.740+0000 7f306662b640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30600cd6c0 con 0x7f30600c7da0 2024-05-04T02:20:29.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.740+0000 7f306662b640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30600cd980 con 0x7f30600cde50 2024-05-04T02:20:29.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.740+0000 7f306662b640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f30600c7070 con 0x7f306015cfb0 2024-05-04T02:20:29.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.788+0000 7fa879cf2640 1 Processor -- start 2024-05-04T02:20:29.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.788+0000 7fa879cf2640 1 -- start start 2024-05-04T02:20:29.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.790+0000 7fa879cf2640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fa8740b3c30 0x7fa87415d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:29.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.790+0000 7fa879cf2640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa87415dd70 0x7fa87415e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:29.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.790+0000 7fa879cf2640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa87406d100 con 0x7fa874071bf0 2024-05-04T02:20:29.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.790+0000 7fa879cf2640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7fa8740b3090 con 0x7fa8740b3c30 2024-05-04T02:20:29.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.790+0000 7fa879cf2640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa87406d3a0 con 0x7fa87415dd70 2024-05-04T02:20:29.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.871+0000 7f7726ffd640 1 -- 172.21.15.1:0/422206552 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7720043020 con 0x7f77300c7e70 2024-05-04T02:20:29.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.871+0000 7f7726ffd640 1 --2- 172.21.15.1:0/422206552 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f7710076300 0x7f7710078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:29.873 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.871+0000 7f7727fff640 1 --2- 172.21.15.1:0/422206552 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f7710076300 0x7f7710078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:29.874 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.872+0000 7f7727fff640 1 --2- 172.21.15.1:0/422206552 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f7710076300 0x7f7710078810 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7730071360 tx=0x7f7718007cd0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:29.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.886+0000 7f7726ffd640 1 -- 172.21.15.1:0/422206552 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f7720030d90 con 0x7f77300c7e70 2024-05-04T02:20:29.888 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.886+0000 7f7726ffd640 1 -- 172.21.15.1:0/422206552 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7720081240 con 0x7f77300c7e70 2024-05-04T02:20:29.906 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.904+0000 7fa8737fe640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fa874071bf0 0x7fa8740b3520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:56940/0 (socket says 172.21.15.1:56940) 2024-05-04T02:20:29.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.904+0000 7fa8737fe640 1 -- 172.21.15.1:0/147977920 learned_addr learned my addr 172.21.15.1:0/147977920 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-05-04T02:20:29.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.905+0000 7fa872ffd640 1 --2- 172.21.15.1:0/147977920 >> v2:172.21.15.1:3300/0 conn(0x7fa8740b3c30 0x7fa87415d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:29.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.905+0000 7f305f7fe640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f30600c7da0 0x7f30600cc590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:56934/0 (socket says 172.21.15.1:56934) 2024-05-04T02:20:29.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.905+0000 7f305f7fe640 1 -- 172.21.15.1:0/2539555487 learned_addr learned my addr 172.21.15.1:0/2539555487 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-05-04T02:20:29.910 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-04T02:20:29.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.909+0000 7fa872ffd640 1 -- 172.21.15.1:0/147977920 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa87415dd70 msgr2=0x7fa87415e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:29.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.909+0000 7fa872ffd640 1 --2- 172.21.15.1:0/147977920 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa87415dd70 0x7fa87415e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:29.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.909+0000 7fa872ffd640 1 -- 172.21.15.1:0/147977920 >> v1:172.21.15.1:6789/0 conn(0x7fa874071bf0 legacy=0x7fa8740b3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:29.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.909+0000 7fa872ffd640 1 -- 172.21.15.1:0/147977920 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa87406f770 con 0x7fa8740b3c30 2024-05-04T02:20:29.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.914+0000 7fa872ffd640 1 --2- 172.21.15.1:0/147977920 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa8740b3c30 0x7fa87415d830 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa8680097a0 tx=0x7fa86802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=674b98508acceaf8 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:29.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.919+0000 7f305effd640 1 -- 172.21.15.1:0/2539555487 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3408894987 0 0) 0x7f30600cd6c0 con 0x7f30600c7da0 2024-05-04T02:20:29.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.919+0000 7f305effd640 1 -- 172.21.15.1:0/2539555487 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3048003520 con 0x7f30600c7da0 2024-05-04T02:20:29.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.925+0000 7fa8727fc640 1 -- 172.21.15.1:0/147977920 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa868037070 con 0x7fa8740b3c30 2024-05-04T02:20:29.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.925+0000 7fa8727fc640 1 -- 172.21.15.1:0/147977920 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa868032440 con 0x7fa8740b3c30 2024-05-04T02:20:29.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.926+0000 7fa8727fc640 1 -- 172.21.15.1:0/147977920 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa86802ae60 con 0x7fa8740b3c30 2024-05-04T02:20:29.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.927+0000 7fa879cf2640 1 -- 172.21.15.1:0/147977920 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa8740b3c30 msgr2=0x7fa87415d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:29.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.927+0000 7fa879cf2640 1 --2- 172.21.15.1:0/147977920 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa8740b3c30 0x7fa87415d830 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa8680097a0 tx=0x7fa86802a110 comp rx=0 tx=0).stop 2024-05-04T02:20:29.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.927+0000 7fa879cf2640 1 -- 172.21.15.1:0/147977920 shutdown_connections 2024-05-04T02:20:29.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.927+0000 7fa879cf2640 1 --2- 172.21.15.1:0/147977920 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa87415dd70 0x7fa87415e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:29.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.927+0000 7fa879cf2640 1 --2- 172.21.15.1:0/147977920 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa8740b3c30 0x7fa87415d830 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:29.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.927+0000 7fa879cf2640 1 -- 172.21.15.1:0/147977920 >> 172.21.15.1:0/147977920 conn(0x7fa8740cb190 msgr2=0x7fa8740cb5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:29.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.927+0000 7fa879cf2640 1 -- 172.21.15.1:0/147977920 shutdown_connections 2024-05-04T02:20:29.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.927+0000 7fa879cf2640 1 -- 172.21.15.1:0/147977920 wait complete. 2024-05-04T02:20:29.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.927+0000 7f305effd640 1 -- 172.21.15.1:0/2539555487 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2238402623 0 0) 0x7f3048003520 con 0x7f30600c7da0 2024-05-04T02:20:29.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.927+0000 7f305effd640 1 -- 172.21.15.1:0/2539555487 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f306015cfb0 msgr2=0x7f3060167ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:29.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.927+0000 7f305effd640 1 --2- 172.21.15.1:0/2539555487 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f306015cfb0 0x7f3060167ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:29.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.927+0000 7f305effd640 1 -- 172.21.15.1:0/2539555487 >> v1:172.21.15.107:6789/0 conn(0x7f30600cde50 legacy=0x7f306006c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:29.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.927+0000 7f305effd640 1 -- 172.21.15.1:0/2539555487 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30600c72c0 con 0x7f30600c7da0 2024-05-04T02:20:29.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.927+0000 7f305effd640 1 -- 172.21.15.1:0/2539555487 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1418761865 0 0) 0x7f30540016f0 con 0x7f30600c7da0 2024-05-04T02:20:29.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.927+0000 7f305effd640 1 -- 172.21.15.1:0/2539555487 >> v1:172.21.15.1:6789/0 conn(0x7f30600c7da0 legacy=0x7f30600cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:29.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.927+0000 7f305effd640 1 --2- 172.21.15.1:0/2539555487 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3048003a30 0x7f3048003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:29.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.927+0000 7f305effd640 1 --2- 172.21.15.1:0/2539555487 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f306015cfb0 0x7f3048004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:29.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.927+0000 7f305effd640 1 --2- 172.21.15.1:0/2539555487 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3048004e60 0x7f30480052d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:29.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.927+0000 7f305effd640 1 -- 172.21.15.1:0/2539555487 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f30600c7070 con 0x7f3048004e60 2024-05-04T02:20:29.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.927+0000 7f305effd640 1 -- 172.21.15.1:0/2539555487 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f304800bcf0 con 0x7f3048003a30 2024-05-04T02:20:29.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.927+0000 7f305effd640 1 -- 172.21.15.1:0/2539555487 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f304800bef0 con 0x7f306015cfb0 2024-05-04T02:20:29.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.930+0000 7fa879cf2640 1 Processor -- start 2024-05-04T02:20:29.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.930+0000 7fa879cf2640 1 -- start start 2024-05-04T02:20:29.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.930+0000 7f3064bc8640 1 --2- 172.21.15.1:0/2539555487 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3048004e60 0x7f30480052d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:29.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.931+0000 7fa879cf2640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa874071bf0 0x7fa8741f4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:29.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.931+0000 7fa879cf2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa8740b3c30 0x7fa8740cdd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:29.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.931+0000 7fa879cf2640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa87415dd70 0x7fa87414efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:29.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.931+0000 7fa879cf2640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa8740b21b0 con 0x7fa8740b3c30 2024-05-04T02:20:29.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.932+0000 7fa879cf2640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa87415e6c0 con 0x7fa874071bf0 2024-05-04T02:20:29.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.932+0000 7fa879cf2640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa8740b2330 con 0x7fa87415dd70 2024-05-04T02:20:29.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.935+0000 7f3064bc8640 1 -- 172.21.15.1:0/2539555487 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f306015cfb0 msgr2=0x7f3048004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:29.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.935+0000 7f3064bc8640 1 --2- 172.21.15.1:0/2539555487 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f306015cfb0 0x7f3048004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:29.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.935+0000 7f3064bc8640 1 -- 172.21.15.1:0/2539555487 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3048003a30 msgr2=0x7f3048003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:29.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.935+0000 7f3064bc8640 1 --2- 172.21.15.1:0/2539555487 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f3048003a30 0x7f3048003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:29.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.935+0000 7f3064bc8640 1 -- 172.21.15.1:0/2539555487 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30600c72c0 con 0x7f3048004e60 2024-05-04T02:20:29.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.935+0000 7fa872ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa8740b3c30 0x7fa8740cdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:29.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.938+0000 7fa872ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa8740b3c30 0x7fa8740cdd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41752/0 (socket says 172.21.15.1:41752) 2024-05-04T02:20:29.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.938+0000 7fa872ffd640 1 -- 172.21.15.1:0/222547487 learned_addr learned my addr 172.21.15.1:0/222547487 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:29.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.939+0000 7f3064bc8640 1 --2- 172.21.15.1:0/2539555487 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3048004e60 0x7f30480052d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f30600b4c30 tx=0x7f3048005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a9422917c85e35 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:29.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.942+0000 7fa872ffd640 1 -- 172.21.15.1:0/222547487 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa87415dd70 msgr2=0x7fa87414efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:29.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.942+0000 7fa872ffd640 1 --2- 172.21.15.1:0/222547487 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa87415dd70 0x7fa87414efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:29.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.942+0000 7fa872ffd640 1 -- 172.21.15.1:0/222547487 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa874071bf0 msgr2=0x7fa8741f4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:29.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.942+0000 7fa872ffd640 1 --2- 172.21.15.1:0/222547487 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa874071bf0 0x7fa8741f4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:29.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.942+0000 7fa872ffd640 1 -- 172.21.15.1:0/222547487 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8741f4790 con 0x7fa8740b3c30 2024-05-04T02:20:29.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.946+0000 7fa872ffd640 1 --2- 172.21.15.1:0/222547487 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa8740b3c30 0x7fa8740cdd00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa86802a700 tx=0x7fa8680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:29.955 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.953+0000 7f305effd640 1 -- 172.21.15.1:0/2539555487 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3058034020 con 0x7f3048004e60 2024-05-04T02:20:29.955 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.953+0000 7f305effd640 1 -- 172.21.15.1:0/2539555487 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f305802c040 con 0x7f3048004e60 2024-05-04T02:20:29.955 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.953+0000 7f305effd640 1 -- 172.21.15.1:0/2539555487 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3058009a10 con 0x7f3048004e60 2024-05-04T02:20:29.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.954+0000 7f306662b640 1 -- 172.21.15.1:0/2539555487 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3048004e60 msgr2=0x7f30480052d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:29.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.954+0000 7f306662b640 1 --2- 172.21.15.1:0/2539555487 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f3048004e60 0x7f30480052d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f30600b4c30 tx=0x7f3048005830 comp rx=0 tx=0).stop 2024-05-04T02:20:29.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.954+0000 7f3064bc8640 1 -- 172.21.15.1:0/2539555487 reap_dead start 2024-05-04T02:20:29.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.954+0000 7f306662b640 1 -- 172.21.15.1:0/2539555487 shutdown_connections 2024-05-04T02:20:29.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.954+0000 7f306662b640 1 -- 172.21.15.1:0/2539555487 >> 172.21.15.1:0/2539555487 conn(0x7f30600d2590 msgr2=0x7f30600ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:29.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.954+0000 7f306662b640 1 -- 172.21.15.1:0/2539555487 shutdown_connections 2024-05-04T02:20:29.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.954+0000 7f306662b640 1 -- 172.21.15.1:0/2539555487 wait complete. 2024-05-04T02:20:29.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.955+0000 7fa85bfff640 1 -- 172.21.15.1:0/222547487 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa868042020 con 0x7fa8740b3c30 2024-05-04T02:20:29.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.955+0000 7fa85bfff640 1 -- 172.21.15.1:0/222547487 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8680308f0 con 0x7fa8740b3c30 2024-05-04T02:20:29.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.955+0000 7fa879cf2640 1 -- 172.21.15.1:0/222547487 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa87415c800 con 0x7fa8740b3c30 2024-05-04T02:20:29.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.955+0000 7fa85bfff640 1 -- 172.21.15.1:0/222547487 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa868037040 con 0x7fa8740b3c30 2024-05-04T02:20:29.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.955+0000 7fa879cf2640 1 -- 172.21.15.1:0/222547487 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa87415d4d0 con 0x7fa8740b3c30 2024-05-04T02:20:29.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.957+0000 7f306662b640 1 Processor -- start 2024-05-04T02:20:29.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.957+0000 7fa879cf2640 1 -- 172.21.15.1:0/222547487 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa874076740 con 0x7fa8740b3c30 2024-05-04T02:20:29.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.957+0000 7f306662b640 1 -- start start 2024-05-04T02:20:29.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.958+0000 7f306662b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f30600c91d0 0x7f3060159340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:29.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.958+0000 7f306662b640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3060159880 0x7f306015e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:29.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.958+0000 7f306662b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f306015e6d0 0x7f306015f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:29.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.958+0000 7f306662b640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f306015d3c0 con 0x7f306015e6d0 2024-05-04T02:20:29.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.958+0000 7f306662b640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f30600c7880 con 0x7f30600c91d0 2024-05-04T02:20:29.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.958+0000 7f306662b640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f3060156b40 con 0x7f3060159880 2024-05-04T02:20:29.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.967+0000 7f3064bc8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f306015e6d0 0x7f306015f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:29.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.984+0000 7fc7127fc640 1 -- 172.21.15.1:0/1953087197 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc70c047460 con 0x7fc71c0c8070 2024-05-04T02:20:29.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.985+0000 7fc7127fc640 1 --2- 172.21.15.1:0/1953087197 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fc700076350 0x7fc700078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:29.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.985+0000 7fc721d12640 1 --2- 172.21.15.1:0/1953087197 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fc700076350 0x7fc700078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:29.988 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.986+0000 7fc721d12640 1 --2- 172.21.15.1:0/1953087197 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fc700076350 0x7fc700078860 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc718005880 tx=0x7fc718007a20 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:29.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.988+0000 7fc7127fc640 1 -- 172.21.15.1:0/1953087197 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fc70c030d70 con 0x7fc71c0c8070 2024-05-04T02:20:29.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.993+0000 7fa85bfff640 1 -- 172.21.15.1:0/222547487 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa868045020 con 0x7fa8740b3c30 2024-05-04T02:20:29.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.993+0000 7fa85bfff640 1 --2- 172.21.15.1:0/222547487 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fa8600762d0 0x7fa8600787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:29.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.993+0000 7fa8737fe640 1 --2- 172.21.15.1:0/222547487 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fa8600762d0 0x7fa8600787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:29.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:29.994+0000 7fa8737fe640 1 --2- 172.21.15.1:0/222547487 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fa8600762d0 0x7fa8600787e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa864000f60 tx=0x7fa864007a80 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:30.002 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-04T02:20:30.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.000+0000 7fc7127fc640 1 -- 172.21.15.1:0/1953087197 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc70c032e20 con 0x7fc71c0c8070 2024-05-04T02:20:30.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.011+0000 7f305f7fe640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3060159880 0x7f306015e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:30.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.012+0000 7f305f7fe640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3060159880 0x7f306015e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.1:49988/0 (socket says 172.21.15.1:49988) 2024-05-04T02:20:30.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.012+0000 7f305f7fe640 1 -- 172.21.15.1:0/4218470135 learned_addr learned my addr 172.21.15.1:0/4218470135 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:30.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.012+0000 7fad9b7fe640 1 -- 172.21.15.1:0/3755642654 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fada4007070 con 0x7fad9c003a50 2024-05-04T02:20:30.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.013+0000 7fad9b7fe640 1 --2- 172.21.15.1:0/3755642654 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fada0076320 0x7fada0078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:30.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.013+0000 7fadb27fc640 1 --2- 172.21.15.1:0/3755642654 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fada0076320 0x7fada0078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:30.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.014+0000 7fadb27fc640 1 --2- 172.21.15.1:0/3755642654 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fada0076320 0x7fada0078830 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fadb415e220 tx=0x7fada8007990 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:30.020 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.018+0000 7fad9b7fe640 1 -- 172.21.15.1:0/3755642654 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fada407c1f0 con 0x7fad9c003a50 2024-05-04T02:20:30.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.018+0000 7f305f7fe640 1 -- 172.21.15.1:0/4218470135 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f30600c91d0 msgr2=0x7f3060159340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:30.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.018+0000 7f305f7fe640 1 --2- 172.21.15.1:0/4218470135 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f30600c91d0 0x7f3060159340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:30.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.018+0000 7f305f7fe640 1 -- 172.21.15.1:0/4218470135 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f306015e6d0 msgr2=0x7f306015f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:30.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.018+0000 7f305f7fe640 1 --2- 172.21.15.1:0/4218470135 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f306015e6d0 0x7f306015f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:30.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.018+0000 7f305f7fe640 1 -- 172.21.15.1:0/4218470135 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30600c95e0 con 0x7f3060159880 2024-05-04T02:20:30.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.021+0000 7f305f7fe640 1 --2- 172.21.15.1:0/4218470135 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3060159880 0x7f306015e190 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f305400caa0 tx=0x7f305400cf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:30.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.027+0000 7f305cff9640 1 -- 172.21.15.1:0/4218470135 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3054018070 con 0x7f3060159880 2024-05-04T02:20:30.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.027+0000 7f305cff9640 1 -- 172.21.15.1:0/4218470135 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3054004cb0 con 0x7f3060159880 2024-05-04T02:20:30.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.028+0000 7f306662b640 1 -- 172.21.15.1:0/4218470135 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f306015d6f0 con 0x7f3060159880 2024-05-04T02:20:30.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.028+0000 7f305cff9640 1 -- 172.21.15.1:0/4218470135 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3054004e60 con 0x7f3060159880 2024-05-04T02:20:30.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.028+0000 7f306662b640 1 -- 172.21.15.1:0/4218470135 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f30601f2db0 con 0x7f3060159880 2024-05-04T02:20:30.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.029+0000 7f306662b640 1 -- 172.21.15.1:0/4218470135 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3060069bc0 con 0x7f3060159880 2024-05-04T02:20:30.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.033+0000 7fad9b7fe640 1 -- 172.21.15.1:0/3755642654 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fada4080660 con 0x7fad9c003a50 2024-05-04T02:20:30.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.069+0000 7f2c8e59f640 1 Processor -- start 2024-05-04T02:20:30.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.069+0000 7f2c8e59f640 1 -- start start 2024-05-04T02:20:30.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.071+0000 7f2c8e59f640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f2c8815a1e0 0x7f2c8815df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:30.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.072+0000 7f2c8e59f640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f2c881545b0 0x7f2c880ca0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:30.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.072+0000 7f2c8e59f640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c880c5bd0 con 0x7f2c8815e480 2024-05-04T02:20:30.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.072+0000 7f2c8e59f640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f2c8815d7d0 con 0x7f2c881545b0 2024-05-04T02:20:30.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.072+0000 7f2c8e59f640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f2c880cb950 con 0x7f2c8815a1e0 2024-05-04T02:20:30.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.072+0000 7f2c8d59d640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f2c8815a1e0 0x7f2c8815df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:30.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.073+0000 7f2c8d59d640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f2c8815a1e0 0x7f2c8815df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.1:47386/0 (socket says 172.21.15.1:47386) 2024-05-04T02:20:30.075 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.073+0000 7f2c8d59d640 1 -- 172.21.15.1:0/1569576461 learned_addr learned my addr 172.21.15.1:0/1569576461 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:30.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.076+0000 7f2c8d59d640 1 -- 172.21.15.1:0/1569576461 >> v2:172.21.15.1:3300/0 conn(0x7f2c881545b0 msgr2=0x7f2c880ca0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:30.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.076+0000 7f2c8d59d640 1 --2- 172.21.15.1:0/1569576461 >> v2:172.21.15.1:3300/0 conn(0x7f2c881545b0 0x7f2c880ca0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:30.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.076+0000 7f2c8d59d640 1 -- 172.21.15.1:0/1569576461 >> v1:172.21.15.107:6789/0 conn(0x7f2c8815e480 legacy=0x7f2c880cae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:30.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.076+0000 7f2c8d59d640 1 -- 172.21.15.1:0/1569576461 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c8815a740 con 0x7f2c8815a1e0 2024-05-04T02:20:30.082 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.080+0000 7f2c8d59d640 1 --2- 172.21.15.1:0/1569576461 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c8815a1e0 0x7f2c8815df40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2c88071460 tx=0x7f2c8402a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a385a07ea5c7adc server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:30.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.084+0000 7f2c7ffff640 1 -- 172.21.15.1:0/1569576461 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c84037070 con 0x7f2c8815a1e0 2024-05-04T02:20:30.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.084+0000 7f2c7ffff640 1 -- 172.21.15.1:0/1569576461 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c84032440 con 0x7f2c8815a1e0 2024-05-04T02:20:30.086 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.084+0000 7f2c7ffff640 1 -- 172.21.15.1:0/1569576461 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c84032810 con 0x7f2c8815a1e0 2024-05-04T02:20:30.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.085+0000 7f2c8e59f640 1 -- 172.21.15.1:0/1569576461 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c8815a1e0 msgr2=0x7f2c8815df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:30.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.085+0000 7f2c8e59f640 1 --2- 172.21.15.1:0/1569576461 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c8815a1e0 0x7f2c8815df40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2c88071460 tx=0x7f2c8402a1e0 comp rx=0 tx=0).stop 2024-05-04T02:20:30.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.085+0000 7f2c8e59f640 1 -- 172.21.15.1:0/1569576461 shutdown_connections 2024-05-04T02:20:30.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.085+0000 7f2c8e59f640 1 --2- 172.21.15.1:0/1569576461 >> v2:172.21.15.1:3300/0 conn(0x7f2c881545b0 0x7f2c880ca0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:30.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.085+0000 7f2c8e59f640 1 --2- 172.21.15.1:0/1569576461 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c8815a1e0 0x7f2c8815df40 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:30.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.085+0000 7f2c8e59f640 1 -- 172.21.15.1:0/1569576461 >> 172.21.15.1:0/1569576461 conn(0x7f2c88071f20 msgr2=0x7f2c88073620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:30.088 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.086+0000 7f2c8e59f640 1 -- 172.21.15.1:0/1569576461 shutdown_connections 2024-05-04T02:20:30.089 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.086+0000 7f2c8e59f640 1 -- 172.21.15.1:0/1569576461 wait complete. 2024-05-04T02:20:30.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.089+0000 7f2c8e59f640 1 Processor -- start 2024-05-04T02:20:30.091 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.089+0000 7f2c8e59f640 1 -- start start 2024-05-04T02:20:30.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.092+0000 7f2c8e59f640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2c881545b0 0x7f2c880cd480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:30.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.092+0000 7f2c8e59f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2c8815a1e0 0x7f2c881f0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:30.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.092+0000 7f2c8e59f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c8815e480 0x7f2c8814f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:30.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.092+0000 7f2c8e59f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f2c8815afe0 con 0x7f2c8815a1e0 2024-05-04T02:20:30.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.092+0000 7f2c8e59f640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f2c8815ad00 con 0x7f2c8815e480 2024-05-04T02:20:30.094 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.092+0000 7f2c8e59f640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f2c8815da20 con 0x7f2c881545b0 2024-05-04T02:20:30.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.093+0000 7f2c8dd9e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c8815e480 0x7f2c8814f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:30.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.093+0000 7f2c8dd9e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c8815e480 0x7f2c8814f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.1:47390/0 (socket says 172.21.15.1:47390) 2024-05-04T02:20:30.095 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.093+0000 7f2c8dd9e640 1 -- 172.21.15.1:0/2520501039 learned_addr learned my addr 172.21.15.1:0/2520501039 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:30.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.097+0000 7f2c8dd9e640 1 -- 172.21.15.1:0/2520501039 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2c881545b0 msgr2=0x7f2c880cd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:30.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.097+0000 7f2c8dd9e640 1 --2- 172.21.15.1:0/2520501039 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2c881545b0 0x7f2c880cd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:30.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.097+0000 7f2c8dd9e640 1 -- 172.21.15.1:0/2520501039 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2c8815a1e0 msgr2=0x7f2c881f0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:30.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.097+0000 7f2c8dd9e640 1 --2- 172.21.15.1:0/2520501039 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2c8815a1e0 0x7f2c881f0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:30.099 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.097+0000 7f2c8dd9e640 1 -- 172.21.15.1:0/2520501039 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c881541a0 con 0x7f2c8815e480 2024-05-04T02:20:30.101 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.099+0000 7f2c8dd9e640 1 --2- 172.21.15.1:0/2520501039 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c8815e480 0x7f2c8814f040 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2c8000b970 tx=0x7f2c8000be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:30.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.103+0000 7f2c7dffb640 1 -- 172.21.15.1:0/2520501039 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c80019070 con 0x7f2c8815e480 2024-05-04T02:20:30.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.103+0000 7f2c7dffb640 1 -- 172.21.15.1:0/2520501039 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c8000cb60 con 0x7f2c8815e480 2024-05-04T02:20:30.105 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.103+0000 7f2c8e59f640 1 -- 172.21.15.1:0/2520501039 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c880cec80 con 0x7f2c8815e480 2024-05-04T02:20:30.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.104+0000 7f2c8e59f640 1 -- 172.21.15.1:0/2520501039 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c880cf240 con 0x7f2c8815e480 2024-05-04T02:20:30.106 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.104+0000 7f2c7dffb640 1 -- 172.21.15.1:0/2520501039 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c80014440 con 0x7f2c8815e480 2024-05-04T02:20:30.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.105+0000 7f2c8e59f640 1 -- 172.21.15.1:0/2520501039 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c880b2f90 con 0x7f2c8815e480 2024-05-04T02:20:30.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.121+0000 7f241b242640 1 Processor -- start 2024-05-04T02:20:30.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.121+0000 7f241b242640 1 -- start start 2024-05-04T02:20:30.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.122+0000 7f241b242640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f24140cab70 0x7f24141422c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:30.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.122+0000 7f241b242640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f24140ce590 0x7f24140ce9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:30.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.122+0000 7f241b242640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f241415c9e0 0x7f241415cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:30.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.123+0000 7f241b242640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f24140c3830 con 0x7f24140ce590 2024-05-04T02:20:30.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.123+0000 7f241b242640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f24140c3b10 con 0x7f24140cab70 2024-05-04T02:20:30.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.123+0000 7f241b242640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f24140c3df0 con 0x7f241415c9e0 2024-05-04T02:20:30.125 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.123+0000 7f7734b34640 1 -- 172.21.15.1:0/422206552 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f77301f29b0 con 0x7f77300c7e70 2024-05-04T02:20:30.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.127+0000 7f2c7dffb640 1 -- 172.21.15.1:0/2520501039 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2c8001c070 con 0x7f2c8815e480 2024-05-04T02:20:30.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.128+0000 7f2c7dffb640 1 --2- 172.21.15.1:0/2520501039 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f2c6c0762d0 0x7f2c6c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:30.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.128+0000 7f2c8d59d640 1 --2- 172.21.15.1:0/2520501039 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f2c6c0762d0 0x7f2c6c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:30.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.129+0000 7f2c8d59d640 1 --2- 172.21.15.1:0/2520501039 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f2c6c0762d0 0x7f2c6c0787e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2c84034000 tx=0x7f2c8402c000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:30.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.131+0000 7f2c7dffb640 1 -- 172.21.15.1:0/2520501039 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f2c8005cc70 con 0x7f2c8815e480 2024-05-04T02:20:30.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.132+0000 7f2418fde640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f24140cab70 0x7f24141422c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:30.140 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-04T02:20:30.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.252+0000 7fcf42f38640 1 Processor -- start 2024-05-04T02:20:30.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.252+0000 7fcf42f38640 1 -- start start 2024-05-04T02:20:30.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.253+0000 7fcf42f38640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcf3c0b3840 0x7fcf3c1565c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:30.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.253+0000 7fcf42f38640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fcf3c15c5a0 0x7fcf3c15c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:30.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.253+0000 7fcf42f38640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf3c0b0fa0 con 0x7fcf3c0ca980 2024-05-04T02:20:30.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.253+0000 7fcf42f38640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7fcf3c0b1fa0 con 0x7fcf3c15c5a0 2024-05-04T02:20:30.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.253+0000 7fcf42f38640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fcf3c0b1560 con 0x7fcf3c0b3840 2024-05-04T02:20:30.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.292+0000 7fc723f76640 1 -- 172.21.15.1:0/1953087197 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fc71c076740 con 0x7fc71c0c8070 2024-05-04T02:20:30.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.302+0000 7fa85bfff640 1 -- 172.21.15.1:0/222547487 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fa868030ce0 con 0x7fa8740b3c30 2024-05-04T02:20:30.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.303+0000 7fa85bfff640 1 -- 172.21.15.1:0/222547487 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa868082210 con 0x7fa8740b3c30 2024-05-04T02:20:30.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.313+0000 7fcf414d5640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fcf3c15c5a0 0x7fcf3c15c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:30.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.314+0000 7f305cff9640 1 -- 172.21.15.1:0/4218470135 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f305401b070 con 0x7f3060159880 2024-05-04T02:20:30.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.314+0000 7f305cff9640 1 --2- 172.21.15.1:0/4218470135 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f304c0762d0 0x7f304c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:30.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.315+0000 7f305ffff640 1 --2- 172.21.15.1:0/4218470135 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f304c0762d0 0x7f304c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:30.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.315+0000 7f305ffff640 1 --2- 172.21.15.1:0/4218470135 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f304c0762d0 0x7f304c0787e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f306015a6a0 tx=0x7f3050007990 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:30.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.318+0000 7f305cff9640 1 -- 172.21.15.1:0/4218470135 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f305405c690 con 0x7f3060159880 2024-05-04T02:20:30.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.320+0000 7fadb96fa640 1 -- 172.21.15.1:0/3755642654 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fadb41f6230 con 0x7fad9c003a50 2024-05-04T02:20:30.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.321+0000 7fcf414d5640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fcf3c15c5a0 0x7fcf3c15c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41802/0 (socket says 172.21.15.1:41802) 2024-05-04T02:20:30.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.321+0000 7fcf414d5640 1 -- 172.21.15.1:0/3620944110 learned_addr learned my addr 172.21.15.1:0/3620944110 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:30.330 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.328+0000 7f305cff9640 1 -- 172.21.15.1:0/4218470135 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f3054022020 con 0x7f3060159880 2024-05-04T02:20:30.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.330+0000 7f24197df640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f241415c9e0 0x7f241415cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:30.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.331+0000 7fcf414d5640 1 -- 172.21.15.1:0/3620944110 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcf3c0b3840 msgr2=0x7fcf3c1565c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:30.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.331+0000 7fcf414d5640 1 --2- 172.21.15.1:0/3620944110 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcf3c0b3840 0x7fcf3c1565c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:30.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.331+0000 7fcf414d5640 1 -- 172.21.15.1:0/3620944110 >> v1:172.21.15.107:6789/0 conn(0x7fcf3c0ca980 legacy=0x7fcf3c0cb200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:30.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.331+0000 7fcf414d5640 1 -- 172.21.15.1:0/3620944110 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf3c0b1280 con 0x7fcf3c15c5a0 2024-05-04T02:20:30.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.332+0000 7f24197df640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f241415c9e0 0x7f241415cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.1:50002/0 (socket says 172.21.15.1:50002) 2024-05-04T02:20:30.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.332+0000 7f24197df640 1 -- 172.21.15.1:0/1038911480 learned_addr learned my addr 172.21.15.1:0/1038911480 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:30.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.332+0000 7f2413fff640 1 --2- 172.21.15.1:0/1038911480 >> v2:172.21.15.1:3300/0 conn(0x7f24140ce590 0x7f24140ce9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:30.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.336+0000 7fcf414d5640 1 --2- 172.21.15.1:0/3620944110 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcf3c15c5a0 0x7fcf3c15c9b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcf34009e50 tx=0x7fcf3402a670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6347909151abaafe server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:30.340 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.339+0000 7fc7127fc640 1 -- 172.21.15.1:0/1953087197 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc70c0826b0 con 0x7fc71c0c8070 2024-05-04T02:20:30.341 INFO:teuthology.orchestra.run.smithi001.stdout:64424509448 2024-05-04T02:20:30.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.342+0000 7fc723f76640 1 -- 172.21.15.1:0/1953087197 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fc700076350 msgr2=0x7fc700078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:30.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.342+0000 7fc723f76640 1 --2- 172.21.15.1:0/1953087197 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fc700076350 0x7fc700078860 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc718005880 tx=0x7fc718007a20 comp rx=0 tx=0).stop 2024-05-04T02:20:30.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.342+0000 7fc723f76640 1 -- 172.21.15.1:0/1953087197 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc71c0c8070 msgr2=0x7fc71c15b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:30.344 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.342+0000 7fc723f76640 1 --2- 172.21.15.1:0/1953087197 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc71c0c8070 0x7fc71c15b860 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc70c009890 tx=0x7fc70c0046c0 comp rx=0 tx=0).stop 2024-05-04T02:20:30.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.342+0000 7fc723f76640 1 -- 172.21.15.1:0/1953087197 shutdown_connections 2024-05-04T02:20:30.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.342+0000 7fc723f76640 1 --2- 172.21.15.1:0/1953087197 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fc700076350 0x7fc700078860 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:30.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.342+0000 7fc723f76640 1 --2- 172.21.15.1:0/1953087197 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fc71c15d900 0x7fc71c1528c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:30.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.342+0000 7fc723f76640 1 --2- 172.21.15.1:0/1953087197 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fc71c0c8070 0x7fc71c15b860 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:30.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.342+0000 7fc723f76640 1 --2- 172.21.15.1:0/1953087197 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fc71c06c7f0 0x7fc71c1effe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:30.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.342+0000 7fc723f76640 1 -- 172.21.15.1:0/1953087197 >> 172.21.15.1:0/1953087197 conn(0x7fc71c071b90 msgr2=0x7fc71c0cd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:30.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.342+0000 7fc723f76640 1 -- 172.21.15.1:0/1953087197 shutdown_connections 2024-05-04T02:20:30.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.342+0000 7fc723f76640 1 -- 172.21.15.1:0/1953087197 wait complete. 2024-05-04T02:20:30.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.351+0000 7f24197df640 1 -- 172.21.15.1:0/1038911480 >> v2:172.21.15.107:3300/0 conn(0x7f24140cab70 msgr2=0x7f24141422c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:30.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.351+0000 7f24197df640 1 --2- 172.21.15.1:0/1038911480 >> v2:172.21.15.107:3300/0 conn(0x7f24140cab70 0x7f24141422c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:30.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.351+0000 7f24197df640 1 -- 172.21.15.1:0/1038911480 >> v2:172.21.15.1:3300/0 conn(0x7f24140ce590 msgr2=0x7f24140ce9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:30.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.351+0000 7f24197df640 1 --2- 172.21.15.1:0/1038911480 >> v2:172.21.15.1:3300/0 conn(0x7f24140ce590 0x7f24140ce9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:30.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.351+0000 7f24197df640 1 -- 172.21.15.1:0/1038911480 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24140c40d0 con 0x7f241415c9e0 2024-05-04T02:20:30.361 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.1 2024-05-04T02:20:30.414 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.412+0000 7f2c7dffb640 1 -- 172.21.15.1:0/2520501039 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2c880b2f90 con 0x7f2c8815e480 2024-05-04T02:20:30.418 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.416+0000 7fad9b7fe640 1 -- 172.21.15.1:0/3755642654 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fada407ff60 con 0x7fad9c003a50 2024-05-04T02:20:30.418 INFO:teuthology.orchestra.run.smithi001.stdout:64424509449 2024-05-04T02:20:30.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.419+0000 7fadb96fa640 1 -- 172.21.15.1:0/3755642654 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fada0076320 msgr2=0x7fada0078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:30.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.419+0000 7fadb96fa640 1 --2- 172.21.15.1:0/3755642654 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fada0076320 0x7fada0078830 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fadb415e220 tx=0x7fada8007990 comp rx=0 tx=0).stop 2024-05-04T02:20:30.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.419+0000 7fadb96fa640 1 -- 172.21.15.1:0/3755642654 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fad9c003a50 msgr2=0x7fadb41f5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:30.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.419+0000 7fadb96fa640 1 --2- 172.21.15.1:0/3755642654 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fad9c003a50 0x7fadb41f5cf0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fada402acf0 tx=0x7fada8000fb0 comp rx=0 tx=0).stop 2024-05-04T02:20:30.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.419+0000 7fadb96fa640 1 -- 172.21.15.1:0/3755642654 shutdown_connections 2024-05-04T02:20:30.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.419+0000 7fadb96fa640 1 --2- 172.21.15.1:0/3755642654 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fada0076320 0x7fada0078830 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:30.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.419+0000 7fadb96fa640 1 --2- 172.21.15.1:0/3755642654 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fadb415d770 0x7fadb414ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:30.422 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.419+0000 7fadb96fa640 1 --2- 172.21.15.1:0/3755642654 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fadb415f4b0 0x7fadb40cd160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:30.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.419+0000 7fadb96fa640 1 --2- 172.21.15.1:0/3755642654 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fad9c003a50 0x7fadb41f5cf0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:30.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.419+0000 7fadb96fa640 1 -- 172.21.15.1:0/3755642654 >> 172.21.15.1:0/3755642654 conn(0x7fadb40ce980 msgr2=0x7fadb4154bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:30.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.419+0000 7fadb96fa640 1 -- 172.21.15.1:0/3755642654 shutdown_connections 2024-05-04T02:20:30.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.419+0000 7fadb96fa640 1 -- 172.21.15.1:0/3755642654 wait complete. 2024-05-04T02:20:30.423 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.421+0000 7f24197df640 1 --2- 172.21.15.1:0/1038911480 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f241415c9e0 0x7f241415cdf0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f24140cf330 tx=0x7f240c02a610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c8d076b0b919d85 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:30.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.426+0000 7f7726ffd640 1 -- 172.21.15.1:0/422206552 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7720085540 con 0x7f77300c7e70 2024-05-04T02:20:30.429 INFO:teuthology.orchestra.run.smithi001.stdout:64424509449 2024-05-04T02:20:30.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.429+0000 7f7734b34640 1 -- 172.21.15.1:0/422206552 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f7710076300 msgr2=0x7f7710078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:30.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.429+0000 7f7734b34640 1 --2- 172.21.15.1:0/422206552 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f7710076300 0x7f7710078810 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7730071360 tx=0x7f7718007cd0 comp rx=0 tx=0).stop 2024-05-04T02:20:30.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.429+0000 7f7734b34640 1 -- 172.21.15.1:0/422206552 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77300c7e70 msgr2=0x7f77301f33c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:30.432 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.429+0000 7f7734b34640 1 --2- 172.21.15.1:0/422206552 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77300c7e70 0x7f77301f33c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7720009890 tx=0x7f77200046c0 comp rx=0 tx=0).stop 2024-05-04T02:20:30.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.429+0000 7f7734b34640 1 -- 172.21.15.1:0/422206552 shutdown_connections 2024-05-04T02:20:30.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.429+0000 7f7734b34640 1 --2- 172.21.15.1:0/422206552 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f7710076300 0x7f7710078810 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:30.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.429+0000 7f7734b34640 1 --2- 172.21.15.1:0/422206552 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f77300c8740 0x7f7730152e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:30.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.429+0000 7f7734b34640 1 --2- 172.21.15.1:0/422206552 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f77300c8330 0x7f77300c9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:30.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.429+0000 7f7734b34640 1 --2- 172.21.15.1:0/422206552 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f77300c7e70 0x7f77301f33c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:30.433 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.429+0000 7f7734b34640 1 -- 172.21.15.1:0/422206552 >> 172.21.15.1:0/422206552 conn(0x7f77300cf6e0 msgr2=0x7f77300c8b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:30.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.429+0000 7f7734b34640 1 -- 172.21.15.1:0/422206552 shutdown_connections 2024-05-04T02:20:30.434 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.429+0000 7f7734b34640 1 -- 172.21.15.1:0/422206552 wait complete. 2024-05-04T02:20:30.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.434+0000 7fcf3b7fe640 1 -- 172.21.15.1:0/3620944110 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf34036070 con 0x7fcf3c15c5a0 2024-05-04T02:20:30.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.436+0000 7f24137fe640 1 -- 172.21.15.1:0/1038911480 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f240c036070 con 0x7f241415c9e0 2024-05-04T02:20:30.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.436+0000 7f24137fe640 1 -- 172.21.15.1:0/1038911480 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f240c031600 con 0x7f241415c9e0 2024-05-04T02:20:30.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.436+0000 7f24137fe640 1 -- 172.21.15.1:0/1038911480 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f240c0319d0 con 0x7f241415c9e0 2024-05-04T02:20:30.440 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.2 2024-05-04T02:20:30.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.438+0000 7f241b242640 1 -- 172.21.15.1:0/1038911480 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f241415c9e0 msgr2=0x7f241415cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:30.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.438+0000 7f241b242640 1 --2- 172.21.15.1:0/1038911480 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f241415c9e0 0x7f241415cdf0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f24140cf330 tx=0x7f240c02a610 comp rx=0 tx=0).stop 2024-05-04T02:20:30.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.438+0000 7f241b242640 1 -- 172.21.15.1:0/1038911480 shutdown_connections 2024-05-04T02:20:30.440 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.438+0000 7f241b242640 1 --2- 172.21.15.1:0/1038911480 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f241415c9e0 0x7f241415cdf0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:30.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.438+0000 7f241b242640 1 --2- 172.21.15.1:0/1038911480 >> v2:172.21.15.1:3300/0 conn(0x7f24140ce590 0x7f24140ce9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:30.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.438+0000 7f241b242640 1 --2- 172.21.15.1:0/1038911480 >> v2:172.21.15.107:3300/0 conn(0x7f24140cab70 0x7f24141422c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:30.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.438+0000 7f241b242640 1 -- 172.21.15.1:0/1038911480 >> 172.21.15.1:0/1038911480 conn(0x7f24140725c0 msgr2=0x7f24140729d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:30.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.438+0000 7f241b242640 1 -- 172.21.15.1:0/1038911480 shutdown_connections 2024-05-04T02:20:30.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.438+0000 7f241b242640 1 -- 172.21.15.1:0/1038911480 wait complete. 2024-05-04T02:20:30.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.441+0000 7f241b242640 1 Processor -- start 2024-05-04T02:20:30.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.441+0000 7f241b242640 1 -- start start 2024-05-04T02:20:30.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.443+0000 7f241b242640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24140cab70 0x7f24141f61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:30.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.443+0000 7f241b242640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f24140ce590 0x7f2414157af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:30.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.444+0000 7f241b242640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f241415c9e0 0x7f241413af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:30.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.444+0000 7f241b242640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f241406f1b0 con 0x7f241415c9e0 2024-05-04T02:20:30.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.444+0000 7f241b242640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f241406f030 con 0x7f24140cab70 2024-05-04T02:20:30.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.444+0000 7f241b242640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f241406f330 con 0x7f24140ce590 2024-05-04T02:20:30.449 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.6 2024-05-04T02:20:30.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.444+0000 7f2413fff640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f24140ce590 0x7f2414157af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:30.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.445+0000 7f2413fff640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f24140ce590 0x7f2414157af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.1:50020/0 (socket says 172.21.15.1:50020) 2024-05-04T02:20:30.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.445+0000 7f2413fff640 1 -- 172.21.15.1:0/4292914968 learned_addr learned my addr 172.21.15.1:0/4292914968 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:30.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.448+0000 7f2413fff640 1 -- 172.21.15.1:0/4292914968 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24140cab70 msgr2=0x7f24141f61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:30.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.448+0000 7f2413fff640 1 --2- 172.21.15.1:0/4292914968 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24140cab70 0x7f24141f61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:30.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.448+0000 7f2413fff640 1 -- 172.21.15.1:0/4292914968 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f241415c9e0 msgr2=0x7f241413af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:30.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.448+0000 7f2413fff640 1 --2- 172.21.15.1:0/4292914968 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f241415c9e0 0x7f241413af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:30.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.448+0000 7f2413fff640 1 -- 172.21.15.1:0/4292914968 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2414160500 con 0x7f24140ce590 2024-05-04T02:20:30.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.451+0000 7f2413fff640 1 --2- 172.21.15.1:0/4292914968 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f24140ce590 0x7f2414157af0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f240000e840 tx=0x7f240000ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:30.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.451+0000 7fcf3b7fe640 1 -- 172.21.15.1:0/3620944110 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf34031600 con 0x7fcf3c15c5a0 2024-05-04T02:20:30.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.451+0000 7fcf3b7fe640 1 -- 172.21.15.1:0/3620944110 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf340319d0 con 0x7fcf3c15c5a0 2024-05-04T02:20:30.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.453+0000 7fcf42f38640 1 -- 172.21.15.1:0/3620944110 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcf3c15c5a0 msgr2=0x7fcf3c15c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:30.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.453+0000 7fcf42f38640 1 --2- 172.21.15.1:0/3620944110 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcf3c15c5a0 0x7fcf3c15c9b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcf34009e50 tx=0x7fcf3402a670 comp rx=0 tx=0).stop 2024-05-04T02:20:30.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.453+0000 7fcf42f38640 1 -- 172.21.15.1:0/3620944110 shutdown_connections 2024-05-04T02:20:30.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.453+0000 7fcf42f38640 1 --2- 172.21.15.1:0/3620944110 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcf3c15c5a0 0x7fcf3c15c9b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:30.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.453+0000 7fcf42f38640 1 --2- 172.21.15.1:0/3620944110 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcf3c0b3840 0x7fcf3c1565c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:30.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.453+0000 7fcf42f38640 1 -- 172.21.15.1:0/3620944110 >> 172.21.15.1:0/3620944110 conn(0x7fcf3c0731f0 msgr2=0x7fcf3c0706c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:30.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.453+0000 7fcf42f38640 1 -- 172.21.15.1:0/3620944110 shutdown_connections 2024-05-04T02:20:30.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.453+0000 7fcf42f38640 1 -- 172.21.15.1:0/3620944110 wait complete. 2024-05-04T02:20:30.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.455+0000 7fcf42f38640 1 Processor -- start 2024-05-04T02:20:30.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.455+0000 7fcf42f38640 1 -- start start 2024-05-04T02:20:30.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.455+0000 7f24117fa640 1 -- 172.21.15.1:0/4292914968 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2400017070 con 0x7f24140ce590 2024-05-04T02:20:30.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.455+0000 7f24117fa640 1 -- 172.21.15.1:0/4292914968 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f240000c940 con 0x7f24140ce590 2024-05-04T02:20:30.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.455+0000 7f241b242640 1 -- 172.21.15.1:0/4292914968 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24141607e0 con 0x7f24140ce590 2024-05-04T02:20:30.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.455+0000 7f24117fa640 1 -- 172.21.15.1:0/4292914968 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f240000cd10 con 0x7f24140ce590 2024-05-04T02:20:30.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.455+0000 7f241b242640 1 -- 172.21.15.1:0/4292914968 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f24141f59b0 con 0x7f24140ce590 2024-05-04T02:20:30.458 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.457+0000 7fcf42f38640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcf3c0b3840 0x7fcf3c150c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:30.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.457+0000 7f241b242640 1 -- 172.21.15.1:0/4292914968 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2414076740 con 0x7f24140ce590 2024-05-04T02:20:30.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.457+0000 7fcf42f38640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcf3c0ca980 0x7fcf3c1f2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:30.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.457+0000 7fcf42f38640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcf3c15c5a0 0x7fcf3c1e6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:30.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.457+0000 7fcf42f38640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fcf3c0b33b0 con 0x7fcf3c0b3840 2024-05-04T02:20:30.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.457+0000 7fcf42f38640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fcf3c0b1c30 con 0x7fcf3c15c5a0 2024-05-04T02:20:30.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.457+0000 7fcf42f38640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fcf3c15cef0 con 0x7fcf3c0ca980 2024-05-04T02:20:30.460 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.458+0000 7fcf40cd4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcf3c0b3840 0x7fcf3c150c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:30.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.459+0000 7fcf40cd4640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcf3c0b3840 0x7fcf3c150c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41826/0 (socket says 172.21.15.1:41826) 2024-05-04T02:20:30.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.459+0000 7fcf40cd4640 1 -- 172.21.15.1:0/3235599899 learned_addr learned my addr 172.21.15.1:0/3235599899 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:30.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.465+0000 7fcf40cd4640 1 -- 172.21.15.1:0/3235599899 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcf3c0ca980 msgr2=0x7fcf3c1f2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:30.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.465+0000 7fcf40cd4640 1 --2- 172.21.15.1:0/3235599899 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcf3c0ca980 0x7fcf3c1f2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:30.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.465+0000 7fcf40cd4640 1 -- 172.21.15.1:0/3235599899 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcf3c15c5a0 msgr2=0x7fcf3c1e6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:30.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.465+0000 7fcf40cd4640 1 --2- 172.21.15.1:0/3235599899 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcf3c15c5a0 0x7fcf3c1e6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:30.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.465+0000 7fcf40cd4640 1 -- 172.21.15.1:0/3235599899 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf3c0afa30 con 0x7fcf3c0b3840 2024-05-04T02:20:30.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.469+0000 7fcf40cd4640 1 --2- 172.21.15.1:0/3235599899 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcf3c0b3840 0x7fcf3c150c90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcf3000b410 tx=0x7fcf3000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:30.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.475+0000 7fcf397fa640 1 -- 172.21.15.1:0/3235599899 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf30015020 con 0x7fcf3c0b3840 2024-05-04T02:20:30.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.475+0000 7fcf397fa640 1 -- 172.21.15.1:0/3235599899 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf30011830 con 0x7fcf3c0b3840 2024-05-04T02:20:30.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.475+0000 7fcf42f38640 1 -- 172.21.15.1:0/3235599899 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf3c1f30c0 con 0x7fcf3c0b3840 2024-05-04T02:20:30.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.475+0000 7fcf397fa640 1 -- 172.21.15.1:0/3235599899 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf30011c20 con 0x7fcf3c0b3840 2024-05-04T02:20:30.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.476+0000 7fcf42f38640 1 -- 172.21.15.1:0/3235599899 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf3c0aff80 con 0x7fcf3c0b3840 2024-05-04T02:20:30.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.477+0000 7fcf42f38640 1 -- 172.21.15.1:0/3235599899 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf3c076740 con 0x7fcf3c0b3840 2024-05-04T02:20:30.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.506+0000 7fcf397fa640 1 -- 172.21.15.1:0/3235599899 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fcf30018020 con 0x7fcf3c0b3840 2024-05-04T02:20:30.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.507+0000 7fcf397fa640 1 --2- 172.21.15.1:0/3235599899 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fcf200762d0 0x7fcf200787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:30.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.507+0000 7fcf3bfff640 1 --2- 172.21.15.1:0/3235599899 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fcf200762d0 0x7fcf200787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:30.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.508+0000 7fcf3bfff640 1 --2- 172.21.15.1:0/3235599899 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fcf200762d0 0x7fcf200787e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c0c5400 tx=0x7fcf28006ba0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:30.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.514+0000 7fa879cf2640 1 -- 172.21.15.1:0/222547487 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fa8740b1f90 con 0x7fa8740b3c30 2024-05-04T02:20:30.566 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.564+0000 7f306662b640 1 -- 172.21.15.1:0/4218470135 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f3060156920 con 0x7f3060159880 2024-05-04T02:20:30.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.624+0000 7f2c8e59f640 1 -- 172.21.15.1:0/2520501039 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f2c880762f0 con 0x7f2c8815e480 2024-05-04T02:20:30.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.628+0000 7f2c7dffb640 1 -- 172.21.15.1:0/2520501039 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2c80023020 con 0x7f2c8815e480 2024-05-04T02:20:30.631 INFO:teuthology.orchestra.run.smithi001.stdout:55834574856 2024-05-04T02:20:30.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.631+0000 7f2c8e59f640 1 -- 172.21.15.1:0/2520501039 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f2c6c0762d0 msgr2=0x7f2c6c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:30.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.631+0000 7f2c8e59f640 1 --2- 172.21.15.1:0/2520501039 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f2c6c0762d0 0x7f2c6c0787e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2c84034000 tx=0x7f2c8402c000 comp rx=0 tx=0).stop 2024-05-04T02:20:30.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.631+0000 7f2c8e59f640 1 -- 172.21.15.1:0/2520501039 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c8815e480 msgr2=0x7f2c8814f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:30.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.631+0000 7f2c8e59f640 1 --2- 172.21.15.1:0/2520501039 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c8815e480 0x7f2c8814f040 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2c8000b970 tx=0x7f2c8000be30 comp rx=0 tx=0).stop 2024-05-04T02:20:30.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.631+0000 7f2c8e59f640 1 -- 172.21.15.1:0/2520501039 shutdown_connections 2024-05-04T02:20:30.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.631+0000 7f2c8e59f640 1 --2- 172.21.15.1:0/2520501039 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f2c6c0762d0 0x7f2c6c0787e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:30.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.631+0000 7f2c8e59f640 1 --2- 172.21.15.1:0/2520501039 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f2c8815e480 0x7f2c8814f040 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:30.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.631+0000 7f2c8e59f640 1 --2- 172.21.15.1:0/2520501039 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f2c8815a1e0 0x7f2c881f0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:30.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.631+0000 7f2c8e59f640 1 --2- 172.21.15.1:0/2520501039 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f2c881545b0 0x7f2c880cd480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:30.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.631+0000 7f2c8e59f640 1 -- 172.21.15.1:0/2520501039 >> 172.21.15.1:0/2520501039 conn(0x7f2c88071f20 msgr2=0x7f2c88073620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:30.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.631+0000 7f2c8e59f640 1 -- 172.21.15.1:0/2520501039 shutdown_connections 2024-05-04T02:20:30.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.631+0000 7f2c8e59f640 1 -- 172.21.15.1:0/2520501039 wait complete. 2024-05-04T02:20:30.644 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.0 2024-05-04T02:20:30.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.740+0000 7f24117fa640 1 -- 172.21.15.1:0/4292914968 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f240001a070 con 0x7f24140ce590 2024-05-04T02:20:30.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.740+0000 7f24117fa640 1 --2- 172.21.15.1:0/4292914968 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f23f80762d0 0x7f23f80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:30.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.741+0000 7f24117fa640 1 -- 172.21.15.1:0/4292914968 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f2400097cd0 con 0x7f24140ce590 2024-05-04T02:20:30.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.741+0000 7f2418fde640 1 --2- 172.21.15.1:0/4292914968 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f23f80762d0 0x7f23f80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:30.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.741+0000 7f2418fde640 1 --2- 172.21.15.1:0/4292914968 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f23f80762d0 0x7f23f80787e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f240800a770 tx=0x7f2408008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:30.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.751+0000 7f24117fa640 1 -- 172.21.15.1:0/4292914968 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2400061680 con 0x7f24140ce590 2024-05-04T02:20:30.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.757+0000 7f305cff9640 1 -- 172.21.15.1:0/4218470135 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3054060b00 con 0x7f3060159880 2024-05-04T02:20:30.759 INFO:teuthology.orchestra.run.smithi001.stdout:64424509449 2024-05-04T02:20:30.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.759+0000 7f306662b640 1 -- 172.21.15.1:0/4218470135 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f304c0762d0 msgr2=0x7f304c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:30.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.759+0000 7f306662b640 1 --2- 172.21.15.1:0/4218470135 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f304c0762d0 0x7f304c0787e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f306015a6a0 tx=0x7f3050007990 comp rx=0 tx=0).stop 2024-05-04T02:20:30.761 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.759+0000 7f306662b640 1 -- 172.21.15.1:0/4218470135 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3060159880 msgr2=0x7f306015e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:30.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.759+0000 7f306662b640 1 --2- 172.21.15.1:0/4218470135 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3060159880 0x7f306015e190 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f305400caa0 tx=0x7f305400cf60 comp rx=0 tx=0).stop 2024-05-04T02:20:30.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.759+0000 7f306662b640 1 -- 172.21.15.1:0/4218470135 shutdown_connections 2024-05-04T02:20:30.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.759+0000 7f306662b640 1 --2- 172.21.15.1:0/4218470135 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f304c0762d0 0x7f304c0787e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:30.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.759+0000 7f306662b640 1 --2- 172.21.15.1:0/4218470135 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f306015e6d0 0x7f306015f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:30.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.759+0000 7f306662b640 1 --2- 172.21.15.1:0/4218470135 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f3060159880 0x7f306015e190 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:30.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.759+0000 7f306662b640 1 --2- 172.21.15.1:0/4218470135 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f30600c91d0 0x7f3060159340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:30.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.759+0000 7f306662b640 1 -- 172.21.15.1:0/4218470135 >> 172.21.15.1:0/4218470135 conn(0x7f30600d2590 msgr2=0x7f306015ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:30.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.759+0000 7f306662b640 1 -- 172.21.15.1:0/4218470135 shutdown_connections 2024-05-04T02:20:30.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.759+0000 7f306662b640 1 -- 172.21.15.1:0/4218470135 wait complete. 2024-05-04T02:20:30.773 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.7 2024-05-04T02:20:30.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.834+0000 7fa85bfff640 1 -- 172.21.15.1:0/222547487 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa868081b10 con 0x7fa8740b3c30 2024-05-04T02:20:30.836 INFO:teuthology.orchestra.run.smithi001.stdout:64424509449 2024-05-04T02:20:30.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.836+0000 7fa879cf2640 1 -- 172.21.15.1:0/222547487 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fa8600762d0 msgr2=0x7fa8600787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:30.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.836+0000 7fa879cf2640 1 --2- 172.21.15.1:0/222547487 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fa8600762d0 0x7fa8600787e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa864000f60 tx=0x7fa864007a80 comp rx=0 tx=0).stop 2024-05-04T02:20:30.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.836+0000 7fa879cf2640 1 -- 172.21.15.1:0/222547487 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa8740b3c30 msgr2=0x7fa8740cdd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:30.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.836+0000 7fa879cf2640 1 --2- 172.21.15.1:0/222547487 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa8740b3c30 0x7fa8740cdd00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa86802a700 tx=0x7fa8680046c0 comp rx=0 tx=0).stop 2024-05-04T02:20:30.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.836+0000 7fa879cf2640 1 -- 172.21.15.1:0/222547487 shutdown_connections 2024-05-04T02:20:30.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.836+0000 7fa879cf2640 1 --2- 172.21.15.1:0/222547487 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fa8600762d0 0x7fa8600787e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:30.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.836+0000 7fa879cf2640 1 --2- 172.21.15.1:0/222547487 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa87415dd70 0x7fa87414efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:30.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.836+0000 7fa879cf2640 1 --2- 172.21.15.1:0/222547487 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa8740b3c30 0x7fa8740cdd00 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:30.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.836+0000 7fa879cf2640 1 --2- 172.21.15.1:0/222547487 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa874071bf0 0x7fa8741f4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:30.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.836+0000 7fa879cf2640 1 -- 172.21.15.1:0/222547487 >> 172.21.15.1:0/222547487 conn(0x7fa8740cb190 msgr2=0x7fa874150b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:30.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.836+0000 7fa879cf2640 1 -- 172.21.15.1:0/222547487 shutdown_connections 2024-05-04T02:20:30.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.836+0000 7fa879cf2640 1 -- 172.21.15.1:0/222547487 wait complete. 2024-05-04T02:20:30.850 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.5 2024-05-04T02:20:30.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.856+0000 7fcf397fa640 1 -- 172.21.15.1:0/3235599899 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fcf30011dc0 con 0x7fcf3c0b3840 2024-05-04T02:20:30.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.856+0000 7fcf397fa640 1 -- 172.21.15.1:0/3235599899 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fcf3001f020 con 0x7fcf3c0b3840 2024-05-04T02:20:30.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:30.968+0000 7f241b242640 1 -- 172.21.15.1:0/4292914968 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f2414072d50 con 0x7f24140ce590 2024-05-04T02:20:31.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.029+0000 7f24117fa640 1 -- 172.21.15.1:0/4292914968 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2400060f80 con 0x7f24140ce590 2024-05-04T02:20:31.032 INFO:teuthology.orchestra.run.smithi001.stdout:60129542154 2024-05-04T02:20:31.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.031+0000 7f241b242640 1 -- 172.21.15.1:0/4292914968 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f23f80762d0 msgr2=0x7f23f80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:31.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.031+0000 7f241b242640 1 --2- 172.21.15.1:0/4292914968 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f23f80762d0 0x7f23f80787e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f240800a770 tx=0x7f2408008040 comp rx=0 tx=0).stop 2024-05-04T02:20:31.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.031+0000 7f241b242640 1 -- 172.21.15.1:0/4292914968 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f24140ce590 msgr2=0x7f2414157af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:31.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.031+0000 7f241b242640 1 --2- 172.21.15.1:0/4292914968 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f24140ce590 0x7f2414157af0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f240000e840 tx=0x7f240000ed00 comp rx=0 tx=0).stop 2024-05-04T02:20:31.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.032+0000 7f241b242640 1 -- 172.21.15.1:0/4292914968 shutdown_connections 2024-05-04T02:20:31.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.032+0000 7f241b242640 1 --2- 172.21.15.1:0/4292914968 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f23f80762d0 0x7f23f80787e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:31.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.032+0000 7f241b242640 1 --2- 172.21.15.1:0/4292914968 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f241415c9e0 0x7f241413af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:31.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.032+0000 7f241b242640 1 --2- 172.21.15.1:0/4292914968 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f24140ce590 0x7f2414157af0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:31.036 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.032+0000 7f241b242640 1 --2- 172.21.15.1:0/4292914968 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f24140cab70 0x7f24141f61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:31.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.032+0000 7f241b242640 1 -- 172.21.15.1:0/4292914968 >> 172.21.15.1:0/4292914968 conn(0x7f24140725c0 msgr2=0x7f24140cb010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:31.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.032+0000 7f241b242640 1 -- 172.21.15.1:0/4292914968 shutdown_connections 2024-05-04T02:20:31.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.032+0000 7f241b242640 1 -- 172.21.15.1:0/4292914968 wait complete. 2024-05-04T02:20:31.046 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.4 2024-05-04T02:20:31.046 DEBUG:teuthology.parallel:result is None 2024-05-04T02:20:31.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.062+0000 7fcf42f38640 1 -- 172.21.15.1:0/3235599899 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fcf3c0b3d20 con 0x7fcf3c0b3840 2024-05-04T02:20:31.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.072+0000 7fcf397fa640 1 -- 172.21.15.1:0/3235599899 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fcf30061510 con 0x7fcf3c0b3840 2024-05-04T02:20:31.074 INFO:teuthology.orchestra.run.smithi001.stdout:64424509450 2024-05-04T02:20:31.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.074+0000 7fcf42f38640 1 -- 172.21.15.1:0/3235599899 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fcf200762d0 msgr2=0x7fcf200787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:31.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.074+0000 7fcf42f38640 1 --2- 172.21.15.1:0/3235599899 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fcf200762d0 0x7fcf200787e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c0c5400 tx=0x7fcf28006ba0 comp rx=0 tx=0).stop 2024-05-04T02:20:31.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.075+0000 7fcf42f38640 1 -- 172.21.15.1:0/3235599899 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcf3c0b3840 msgr2=0x7fcf3c150c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:31.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.075+0000 7fcf42f38640 1 --2- 172.21.15.1:0/3235599899 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcf3c0b3840 0x7fcf3c150c90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcf3000b410 tx=0x7fcf3000b8d0 comp rx=0 tx=0).stop 2024-05-04T02:20:31.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.075+0000 7fcf42f38640 1 -- 172.21.15.1:0/3235599899 shutdown_connections 2024-05-04T02:20:31.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.075+0000 7fcf42f38640 1 --2- 172.21.15.1:0/3235599899 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fcf200762d0 0x7fcf200787e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:31.077 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.075+0000 7fcf42f38640 1 --2- 172.21.15.1:0/3235599899 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcf3c15c5a0 0x7fcf3c1e6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:31.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.075+0000 7fcf42f38640 1 --2- 172.21.15.1:0/3235599899 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcf3c0ca980 0x7fcf3c1f2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:31.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.075+0000 7fcf42f38640 1 --2- 172.21.15.1:0/3235599899 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcf3c0b3840 0x7fcf3c150c90 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:31.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.075+0000 7fcf42f38640 1 -- 172.21.15.1:0/3235599899 >> 172.21.15.1:0/3235599899 conn(0x7fcf3c0731f0 msgr2=0x7fcf3c15a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:31.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.075+0000 7fcf42f38640 1 -- 172.21.15.1:0/3235599899 shutdown_connections 2024-05-04T02:20:31.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.075+0000 7fcf42f38640 1 -- 172.21.15.1:0/3235599899 wait complete. 2024-05-04T02:20:31.089 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.3 2024-05-04T02:20:31.089 DEBUG:teuthology.parallel:result is None 2024-05-04T02:20:31.362 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-04T02:20:31.441 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-04T02:20:31.450 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-04T02:20:31.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.476+0000 7f7028fea640 1 Processor -- start 2024-05-04T02:20:31.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.476+0000 7f7028fea640 1 -- start start 2024-05-04T02:20:31.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.478+0000 7f7028fea640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f70240c9c20 0x7f7024153500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:31.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.478+0000 7f7028fea640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70240cb380 con 0x7f70240c9170 2024-05-04T02:20:31.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.478+0000 7f7028fea640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70240cb660 con 0x7f7024159e10 2024-05-04T02:20:31.481 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.478+0000 7f7028fea640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f702415c980 con 0x7f70240c9c20 2024-05-04T02:20:31.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.479+0000 7f7022d9d640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f7024159e10 0x7f7024163d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.1:54856/0 (socket says 172.21.15.1:54856) 2024-05-04T02:20:31.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.479+0000 7f7022d9d640 1 -- 172.21.15.1:0/3677769308 learned_addr learned my addr 172.21.15.1:0/3677769308 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-05-04T02:20:31.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.479+0000 7f702259c640 1 --2- 172.21.15.1:0/3677769308 >> v2:172.21.15.1:3300/0 conn(0x7f70240c9c20 0x7f7024153500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:31.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.481+0000 7f702159a640 1 -- 172.21.15.1:0/3677769308 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4083185052 0 0) 0x7f70240cb660 con 0x7f7024159e10 2024-05-04T02:20:31.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.481+0000 7f702159a640 1 -- 172.21.15.1:0/3677769308 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7010005730 con 0x7f7024159e10 2024-05-04T02:20:31.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.482+0000 7f702259c640 1 -- 172.21.15.1:0/3677769308 >> v1:172.21.15.107:6789/0 conn(0x7f7024159e10 legacy=0x7f7024163d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:31.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.482+0000 7f702259c640 1 -- 172.21.15.1:0/3677769308 >> v1:172.21.15.1:6789/0 conn(0x7f70240c9170 legacy=0x7f70240c4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:31.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.482+0000 7f702259c640 1 -- 172.21.15.1:0/3677769308 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70240cb940 con 0x7f70240c9c20 2024-05-04T02:20:31.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.486+0000 7f702259c640 1 --2- 172.21.15.1:0/3677769308 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f70240c9c20 0x7f7024153500 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f70140097a0 tx=0x7f701402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abd8f551b243a3d server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:31.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.494+0000 7f702159a640 1 -- 172.21.15.1:0/3677769308 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7014037070 con 0x7f70240c9c20 2024-05-04T02:20:31.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.494+0000 7f702159a640 1 -- 172.21.15.1:0/3677769308 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7014032440 con 0x7f70240c9c20 2024-05-04T02:20:31.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.494+0000 7f702159a640 1 -- 172.21.15.1:0/3677769308 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7014032810 con 0x7f70240c9c20 2024-05-04T02:20:31.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.495+0000 7f7028fea640 1 -- 172.21.15.1:0/3677769308 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f70240c9c20 msgr2=0x7f7024153500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:31.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.495+0000 7f7028fea640 1 --2- 172.21.15.1:0/3677769308 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f70240c9c20 0x7f7024153500 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f70140097a0 tx=0x7f701402a1a0 comp rx=0 tx=0).stop 2024-05-04T02:20:31.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.495+0000 7f7028fea640 1 -- 172.21.15.1:0/3677769308 shutdown_connections 2024-05-04T02:20:31.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.495+0000 7f7028fea640 1 --2- 172.21.15.1:0/3677769308 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f70240c9c20 0x7f7024153500 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:31.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.495+0000 7f7028fea640 1 -- 172.21.15.1:0/3677769308 >> 172.21.15.1:0/3677769308 conn(0x7f7024073250 msgr2=0x7f70240706c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:31.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.495+0000 7f7028fea640 1 -- 172.21.15.1:0/3677769308 shutdown_connections 2024-05-04T02:20:31.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.495+0000 7f7028fea640 1 -- 172.21.15.1:0/3677769308 wait complete. 2024-05-04T02:20:31.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.497+0000 7f7028fea640 1 Processor -- start 2024-05-04T02:20:31.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.497+0000 7f7028fea640 1 -- start start 2024-05-04T02:20:31.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.499+0000 7f7028fea640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f70240c9170 0x7f70241eec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:31.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.499+0000 7f7028fea640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70240c9c20 0x7f70241542f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:31.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.499+0000 7f7028fea640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7024159e10 0x7f70240c61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:31.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.499+0000 7f7028fea640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f702415a220 con 0x7f7024159e10 2024-05-04T02:20:31.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.499+0000 7f7028fea640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f702415cf40 con 0x7f70240c9c20 2024-05-04T02:20:31.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.499+0000 7f7028fea640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f70240c96f0 con 0x7f70240c9170 2024-05-04T02:20:31.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.499+0000 7f7021d9b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70240c9c20 0x7f70241542f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:31.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.499+0000 7f7022d9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7024159e10 0x7f70240c61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:31.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.499+0000 7f702259c640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f70240c9170 0x7f70241eec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:31.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.500+0000 7f702259c640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f70240c9170 0x7f70241eec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.1:50034/0 (socket says 172.21.15.1:50034) 2024-05-04T02:20:31.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.500+0000 7f702259c640 1 -- 172.21.15.1:0/3584619352 learned_addr learned my addr 172.21.15.1:0/3584619352 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:31.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.504+0000 7f7021d9b640 1 -- 172.21.15.1:0/3584619352 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f70240c9170 msgr2=0x7f70241eec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:31.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.504+0000 7f7021d9b640 1 --2- 172.21.15.1:0/3584619352 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f70240c9170 0x7f70241eec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:31.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.504+0000 7f7021d9b640 1 -- 172.21.15.1:0/3584619352 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7024159e10 msgr2=0x7f70240c61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:31.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.504+0000 7f7021d9b640 1 --2- 172.21.15.1:0/3584619352 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7024159e10 0x7f70240c61a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:31.506 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.504+0000 7f7021d9b640 1 -- 172.21.15.1:0/3584619352 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70241ef150 con 0x7f70240c9c20 2024-05-04T02:20:31.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.506+0000 7f7021d9b640 1 --2- 172.21.15.1:0/3584619352 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70240c9c20 0x7f70241542f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f700c001720 tx=0x7f700c001be0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:31.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.510+0000 7f701affd640 1 -- 172.21.15.1:0/3584619352 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f700c001d10 con 0x7f70240c9c20 2024-05-04T02:20:31.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.510+0000 7f701affd640 1 -- 172.21.15.1:0/3584619352 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f700c0050d0 con 0x7f70240c9c20 2024-05-04T02:20:31.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.510+0000 7f701affd640 1 -- 172.21.15.1:0/3584619352 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f700c0054a0 con 0x7f70240c9c20 2024-05-04T02:20:31.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.510+0000 7f7028fea640 1 -- 172.21.15.1:0/3584619352 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70240c78f0 con 0x7f70240c9c20 2024-05-04T02:20:31.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.510+0000 7f7028fea640 1 -- 172.21.15.1:0/3584619352 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70241ee710 con 0x7f70240c9c20 2024-05-04T02:20:31.513 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.511+0000 7f7028fea640 1 -- 172.21.15.1:0/3584619352 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70241ee500 con 0x7f70240c9c20 2024-05-04T02:20:31.536 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.534+0000 7f701affd640 1 -- 172.21.15.1:0/3584619352 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f700c010630 con 0x7f70240c9c20 2024-05-04T02:20:31.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.534+0000 7f701affd640 1 --2- 172.21.15.1:0/3584619352 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f7004076470 0x7f7004078980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:31.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.535+0000 7f702259c640 1 --2- 172.21.15.1:0/3584619352 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f7004076470 0x7f7004078980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:31.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.535+0000 7f702259c640 1 --2- 172.21.15.1:0/3584619352 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f7004076470 0x7f7004078980 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7014009560 tx=0x7f701402e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:31.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.537+0000 7f701affd640 1 -- 172.21.15.1:0/3584619352 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f700c00e2e0 con 0x7f70240c9c20 2024-05-04T02:20:31.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.560+0000 7ff4fc172640 1 Processor -- start 2024-05-04T02:20:31.562 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.560+0000 7ff4fc172640 1 -- start start 2024-05-04T02:20:31.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.561+0000 7ff4fc172640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff4f40c7e70 0x7ff4f4159da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:31.563 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.561+0000 7ff4fc172640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff4f40c8740 0x7ff4f4160310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:31.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.561+0000 7ff4fc172640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4f408d6f0 con 0x7ff4f40c8330 2024-05-04T02:20:31.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.561+0000 7ff4fc172640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7ff4f40c59f0 con 0x7ff4f40c7e70 2024-05-04T02:20:31.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.561+0000 7ff4fc172640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7ff4f40c3650 con 0x7ff4f40c8740 2024-05-04T02:20:31.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.562+0000 7ff4f9f0e640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff4f40c7e70 0x7ff4f4159da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:31.564 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.562+0000 7ff4f9f0e640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7ff4f40c7e70 0x7ff4f4159da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41840/0 (socket says 172.21.15.1:41840) 2024-05-04T02:20:31.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.562+0000 7ff4f9f0e640 1 -- 172.21.15.1:0/2947909254 learned_addr learned my addr 172.21.15.1:0/2947909254 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:31.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.565+0000 7ff4f9f0e640 1 -- 172.21.15.1:0/2947909254 >> v2:172.21.15.107:3300/0 conn(0x7ff4f40c8740 msgr2=0x7ff4f4160310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:31.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.565+0000 7ff4f9f0e640 1 --2- 172.21.15.1:0/2947909254 >> v2:172.21.15.107:3300/0 conn(0x7ff4f40c8740 0x7ff4f4160310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:31.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.565+0000 7ff4f9f0e640 1 -- 172.21.15.1:0/2947909254 >> v1:172.21.15.107:6789/0 conn(0x7ff4f40c8330 legacy=0x7ff4f415fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:31.567 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.565+0000 7ff4f9f0e640 1 -- 172.21.15.1:0/2947909254 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4f40c4de0 con 0x7ff4f40c7e70 2024-05-04T02:20:31.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.567+0000 7ff4f9f0e640 1 --2- 172.21.15.1:0/2947909254 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff4f40c7e70 0x7ff4f4159da0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff4f40cbad0 tx=0x7ff4f002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6516ad53d3418492 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:31.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.572+0000 7ff4f8f0c640 1 -- 172.21.15.1:0/2947909254 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4f0037070 con 0x7ff4f40c7e70 2024-05-04T02:20:31.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.572+0000 7ff4f8f0c640 1 -- 172.21.15.1:0/2947909254 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4f0032440 con 0x7ff4f40c7e70 2024-05-04T02:20:31.574 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.572+0000 7ff4f8f0c640 1 -- 172.21.15.1:0/2947909254 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4f0032810 con 0x7ff4f40c7e70 2024-05-04T02:20:31.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.573+0000 7ff4fc172640 1 -- 172.21.15.1:0/2947909254 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff4f40c7e70 msgr2=0x7ff4f4159da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:31.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.573+0000 7ff4fc172640 1 --2- 172.21.15.1:0/2947909254 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff4f40c7e70 0x7ff4f4159da0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff4f40cbad0 tx=0x7ff4f002a270 comp rx=0 tx=0).stop 2024-05-04T02:20:31.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.573+0000 7ff4fc172640 1 -- 172.21.15.1:0/2947909254 shutdown_connections 2024-05-04T02:20:31.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.573+0000 7ff4fc172640 1 --2- 172.21.15.1:0/2947909254 >> v2:172.21.15.107:3300/0 conn(0x7ff4f40c8740 0x7ff4f4160310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:31.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.573+0000 7ff4fc172640 1 --2- 172.21.15.1:0/2947909254 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff4f40c7e70 0x7ff4f4159da0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:31.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.573+0000 7ff4fc172640 1 -- 172.21.15.1:0/2947909254 >> 172.21.15.1:0/2947909254 conn(0x7ff4f40cf6e0 msgr2=0x7ff4f40cfaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:31.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.573+0000 7ff4fc172640 1 -- 172.21.15.1:0/2947909254 shutdown_connections 2024-05-04T02:20:31.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.573+0000 7ff4fc172640 1 -- 172.21.15.1:0/2947909254 wait complete. 2024-05-04T02:20:31.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.575+0000 7ff4fc172640 1 Processor -- start 2024-05-04T02:20:31.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.575+0000 7ff4fc172640 1 -- start start 2024-05-04T02:20:31.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.577+0000 7ff4fc172640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff4f40c7e70 0x7ff4f406f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:31.579 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.577+0000 7ff4fc172640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff4f40c8330 0x7ff4f41e6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:31.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.577+0000 7ff4fc172640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff4f40c8740 0x7ff4f40ca1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:31.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.577+0000 7ff4fc172640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff4f40c5680 con 0x7ff4f40c8330 2024-05-04T02:20:31.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.577+0000 7ff4fc172640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff4f40c53a0 con 0x7ff4f40c7e70 2024-05-04T02:20:31.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.577+0000 7ff4fc172640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff4f415a2e0 con 0x7ff4f40c8740 2024-05-04T02:20:31.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.578+0000 7ff4fa70f640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff4f40c8740 0x7ff4f40ca1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:31.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.578+0000 7ff4fa70f640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff4f40c8740 0x7ff4f40ca1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.1:50040/0 (socket says 172.21.15.1:50040) 2024-05-04T02:20:31.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.578+0000 7ff4fa70f640 1 -- 172.21.15.1:0/2489318817 learned_addr learned my addr 172.21.15.1:0/2489318817 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:31.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.582+0000 7ff4fa70f640 1 -- 172.21.15.1:0/2489318817 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff4f40c7e70 msgr2=0x7ff4f406f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:31.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.582+0000 7ff4fa70f640 1 --2- 172.21.15.1:0/2489318817 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff4f40c7e70 0x7ff4f406f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:31.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.582+0000 7ff4fa70f640 1 -- 172.21.15.1:0/2489318817 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff4f40c8330 msgr2=0x7ff4f41e6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:31.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.582+0000 7ff4fa70f640 1 --2- 172.21.15.1:0/2489318817 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff4f40c8330 0x7ff4f41e6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:31.584 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.582+0000 7ff4fa70f640 1 -- 172.21.15.1:0/2489318817 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4f406e410 con 0x7ff4f40c8740 2024-05-04T02:20:31.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.585+0000 7ff4fa70f640 1 --2- 172.21.15.1:0/2489318817 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff4f40c8740 0x7ff4f40ca1b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec00b9e0 tx=0x7ff4ec00bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:31.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.589+0000 7ff4ea7fc640 1 -- 172.21.15.1:0/2489318817 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4ec019070 con 0x7ff4f40c8740 2024-05-04T02:20:31.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.589+0000 7ff4ea7fc640 1 -- 172.21.15.1:0/2489318817 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4ec00cb40 con 0x7ff4f40c8740 2024-05-04T02:20:31.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.589+0000 7ff4fc172640 1 -- 172.21.15.1:0/2489318817 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4f406e6f0 con 0x7ff4f40c8740 2024-05-04T02:20:31.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.589+0000 7ff4ea7fc640 1 -- 172.21.15.1:0/2489318817 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4ec014440 con 0x7ff4f40c8740 2024-05-04T02:20:31.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.589+0000 7ff4fc172640 1 -- 172.21.15.1:0/2489318817 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4f41e5d30 con 0x7ff4f40c8740 2024-05-04T02:20:31.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.590+0000 7ff4fc172640 1 -- 172.21.15.1:0/2489318817 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4f4076740 con 0x7ff4f40c8740 2024-05-04T02:20:31.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.596+0000 7f6b43b57640 1 Processor -- start 2024-05-04T02:20:31.598 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.596+0000 7f6b43b57640 1 -- start start 2024-05-04T02:20:31.599 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.597+0000 7f6b43b57640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f6b3c0caa30 0x7f6b3c1532d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:31.599 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.597+0000 7f6b43b57640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b3c0cae40 con 0x7f6b3c0c3f10 2024-05-04T02:20:31.599 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.597+0000 7f6b43b57640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b3c0c90a0 con 0x7f6b3c0c4320 2024-05-04T02:20:31.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.597+0000 7f6b43b57640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f6b3c0c9380 con 0x7f6b3c0caa30 2024-05-04T02:20:31.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.598+0000 7f6b410f2640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f6b3c0c3f10 0x7f6b3c0ce590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:56960/0 (socket says 172.21.15.1:56960) 2024-05-04T02:20:31.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.598+0000 7f6b410f2640 1 -- 172.21.15.1:0/744218665 learned_addr learned my addr 172.21.15.1:0/744218665 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-05-04T02:20:31.600 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.598+0000 7f6b418f3640 1 --2- 172.21.15.1:0/744218665 >> v2:172.21.15.1:3300/0 conn(0x7f6b3c0caa30 0x7f6b3c1532d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:31.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.602+0000 7f6b408f1640 1 -- 172.21.15.1:0/744218665 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4088458464 0 0) 0x7f6b3c0cae40 con 0x7f6b3c0c3f10 2024-05-04T02:20:31.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.602+0000 7f6b408f1640 1 -- 172.21.15.1:0/744218665 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6b28003520 con 0x7f6b3c0c3f10 2024-05-04T02:20:31.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.604+0000 7f6b418f3640 1 -- 172.21.15.1:0/744218665 >> v1:172.21.15.107:6789/0 conn(0x7f6b3c0c4320 legacy=0x7f6b3c159560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:31.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.604+0000 7f6b418f3640 1 -- 172.21.15.1:0/744218665 >> v1:172.21.15.1:6789/0 conn(0x7f6b3c0c3f10 legacy=0x7f6b3c0ce590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:31.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.604+0000 7f6b418f3640 1 -- 172.21.15.1:0/744218665 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b3c0c9660 con 0x7f6b3c0caa30 2024-05-04T02:20:31.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.608+0000 7f6b418f3640 1 --2- 172.21.15.1:0/744218665 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b3c0caa30 0x7f6b3c1532d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6b380097a0 tx=0x7f6b3802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b29e93bec774369f server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:31.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.612+0000 7f6b408f1640 1 -- 172.21.15.1:0/744218665 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b38037070 con 0x7f6b3c0caa30 2024-05-04T02:20:31.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.612+0000 7f6b408f1640 1 -- 172.21.15.1:0/744218665 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b38032440 con 0x7f6b3c0caa30 2024-05-04T02:20:31.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.612+0000 7f6b408f1640 1 -- 172.21.15.1:0/744218665 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b38032810 con 0x7f6b3c0caa30 2024-05-04T02:20:31.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.612+0000 7f6b43b57640 1 -- 172.21.15.1:0/744218665 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b3c0caa30 msgr2=0x7f6b3c1532d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:31.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.612+0000 7f6b43b57640 1 --2- 172.21.15.1:0/744218665 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b3c0caa30 0x7f6b3c1532d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6b380097a0 tx=0x7f6b3802a210 comp rx=0 tx=0).stop 2024-05-04T02:20:31.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.612+0000 7f6b43b57640 1 -- 172.21.15.1:0/744218665 shutdown_connections 2024-05-04T02:20:31.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.612+0000 7f6b43b57640 1 --2- 172.21.15.1:0/744218665 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b3c0caa30 0x7f6b3c1532d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:31.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.613+0000 7f6b43b57640 1 -- 172.21.15.1:0/744218665 >> 172.21.15.1:0/744218665 conn(0x7f6b3c0725c0 msgr2=0x7f6b3c0729d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:31.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.613+0000 7f6b43b57640 1 -- 172.21.15.1:0/744218665 shutdown_connections 2024-05-04T02:20:31.615 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.613+0000 7f6b43b57640 1 -- 172.21.15.1:0/744218665 wait complete. 2024-05-04T02:20:31.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.614+0000 7f6b43b57640 1 Processor -- start 2024-05-04T02:20:31.616 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.615+0000 7f6b43b57640 1 -- start start 2024-05-04T02:20:31.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.616+0000 7f6b43b57640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b3c0c3f10 0x7f6b3c1507f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:31.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.616+0000 7f6b43b57640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b3c0c4320 0x7f6b3c14d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:31.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.616+0000 7f6b43b57640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b3c0caa30 0x7f6b3c14d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:31.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.616+0000 7f6b43b57640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f6b3c0c4730 con 0x7f6b3c0c4320 2024-05-04T02:20:31.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.616+0000 7f6b43b57640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f6b3c0c9c20 con 0x7f6b3c0c3f10 2024-05-04T02:20:31.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.616+0000 7f6b43b57640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f6b3c153810 con 0x7f6b3c0caa30 2024-05-04T02:20:31.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.616+0000 7f6b410f2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b3c0c4320 0x7f6b3c14d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:31.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.616+0000 7ff4ea7fc640 1 -- 172.21.15.1:0/2489318817 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff4ec01c070 con 0x7ff4f40c8740 2024-05-04T02:20:31.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.617+0000 7f6b410f2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b3c0c4320 0x7f6b3c14d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41862/0 (socket says 172.21.15.1:41862) 2024-05-04T02:20:31.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.617+0000 7f6b410f2640 1 -- 172.21.15.1:0/1229236794 learned_addr learned my addr 172.21.15.1:0/1229236794 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:31.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.617+0000 7ff4ea7fc640 1 --2- 172.21.15.1:0/2489318817 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7ff4d8076300 0x7ff4d8078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:31.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.617+0000 7ff4ea7fc640 1 -- 172.21.15.1:0/2489318817 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7ff4ec097690 con 0x7ff4f40c8740 2024-05-04T02:20:31.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.617+0000 7ff4f9f0e640 1 --2- 172.21.15.1:0/2489318817 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7ff4d8076300 0x7ff4d8078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:31.620 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.618+0000 7ff4f9f0e640 1 --2- 172.21.15.1:0/2489318817 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7ff4d8076300 0x7ff4d8078810 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff4f0034000 tx=0x7ff4f002c000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:31.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.621+0000 7f6b410f2640 1 -- 172.21.15.1:0/1229236794 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b3c0caa30 msgr2=0x7f6b3c14d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:31.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.621+0000 7f6b410f2640 1 --2- 172.21.15.1:0/1229236794 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b3c0caa30 0x7f6b3c14d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:31.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.621+0000 7f6b410f2640 1 -- 172.21.15.1:0/1229236794 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b3c0c3f10 msgr2=0x7f6b3c1507f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:31.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.621+0000 7f6b410f2640 1 --2- 172.21.15.1:0/1229236794 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b3c0c3f10 0x7f6b3c1507f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:31.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.621+0000 7f6b410f2640 1 -- 172.21.15.1:0/1229236794 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b3c150d30 con 0x7f6b3c0c4320 2024-05-04T02:20:31.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.624+0000 7f6b410f2640 1 --2- 172.21.15.1:0/1229236794 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b3c0c4320 0x7f6b3c14d320 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c00c410 tx=0x7f6b2c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:31.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.628+0000 7f6b327fc640 1 -- 172.21.15.1:0/1229236794 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b2c017070 con 0x7f6b3c0c4320 2024-05-04T02:20:31.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.628+0000 7f6b327fc640 1 -- 172.21.15.1:0/1229236794 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b2c005ce0 con 0x7f6b3c0c4320 2024-05-04T02:20:31.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.628+0000 7f6b327fc640 1 -- 172.21.15.1:0/1229236794 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b2c0072d0 con 0x7f6b3c0c4320 2024-05-04T02:20:31.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.628+0000 7f6b43b57640 1 -- 172.21.15.1:0/1229236794 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b3c1567c0 con 0x7f6b3c0c4320 2024-05-04T02:20:31.630 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.628+0000 7f6b43b57640 1 -- 172.21.15.1:0/1229236794 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b3c14fd10 con 0x7f6b3c0c4320 2024-05-04T02:20:31.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.629+0000 7f6b43b57640 1 -- 172.21.15.1:0/1229236794 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b3c156530 con 0x7f6b3c0c4320 2024-05-04T02:20:31.645 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-04T02:20:31.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.756+0000 7f1a06c84640 1 Processor -- start 2024-05-04T02:20:31.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.756+0000 7f1a06c84640 1 -- start start 2024-05-04T02:20:31.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.757+0000 7f1a06c84640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f1a000cde50 0x7f1a0015cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:31.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.757+0000 7f1a06c84640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a000cd6c0 con 0x7f1a000cc590 2024-05-04T02:20:31.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.757+0000 7f1a06c84640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a000cd980 con 0x7f1a000c7da0 2024-05-04T02:20:31.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.757+0000 7f1a06c84640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f1a000c7070 con 0x7f1a000cde50 2024-05-04T02:20:31.774 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-04T02:20:31.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.812+0000 7f701affd640 1 -- 172.21.15.1:0/3584619352 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f700c0646c0 con 0x7f70240c9c20 2024-05-04T02:20:31.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.818+0000 7f19fffff640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f1a000c7da0 0x7f1a0006c6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.1:54890/0 (socket says 172.21.15.1:54890) 2024-05-04T02:20:31.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.818+0000 7f19fffff640 1 -- 172.21.15.1:0/1260884441 learned_addr learned my addr 172.21.15.1:0/1260884441 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-05-04T02:20:31.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.822+0000 7f19ff7fe640 1 -- 172.21.15.1:0/1260884441 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3390526033 0 0) 0x7f1a000cd980 con 0x7f1a000c7da0 2024-05-04T02:20:31.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.822+0000 7f19ff7fe640 1 -- 172.21.15.1:0/1260884441 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f19f0003520 con 0x7f1a000c7da0 2024-05-04T02:20:31.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.825+0000 7f19ff7fe640 1 -- 172.21.15.1:0/1260884441 <== mon.1 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2863940712 0 0) 0x7f19f0003520 con 0x7f1a000c7da0 2024-05-04T02:20:31.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.825+0000 7f19ff7fe640 1 -- 172.21.15.1:0/1260884441 >> v2:172.21.15.1:3300/0 conn(0x7f1a000cde50 msgr2=0x7f1a0015cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:31.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.825+0000 7f19ff7fe640 1 --2- 172.21.15.1:0/1260884441 >> v2:172.21.15.1:3300/0 conn(0x7f1a000cde50 0x7f1a0015cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:31.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.825+0000 7f19ff7fe640 1 -- 172.21.15.1:0/1260884441 >> v1:172.21.15.1:6789/0 conn(0x7f1a000cc590 legacy=0x7f1a00166eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:31.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.825+0000 7f19ff7fe640 1 -- 172.21.15.1:0/1260884441 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a000c72c0 con 0x7f1a000c7da0 2024-05-04T02:20:31.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.825+0000 7f19ff7fe640 1 -- 172.21.15.1:0/1260884441 <== mon.1 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1418761865 0 0) 0x7f19ec0016f0 con 0x7f1a000c7da0 2024-05-04T02:20:31.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.825+0000 7f19ff7fe640 1 -- 172.21.15.1:0/1260884441 >> v1:172.21.15.107:6789/0 conn(0x7f1a000c7da0 legacy=0x7f1a0006c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:31.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.825+0000 7f19ff7fe640 1 --2- 172.21.15.1:0/1260884441 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f19f0003a50 0x7f19f0003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:31.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.825+0000 7f19ff7fe640 1 --2- 172.21.15.1:0/1260884441 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f19f0004800 0x7f19f0004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:31.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.825+0000 7f19ff7fe640 1 --2- 172.21.15.1:0/1260884441 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f19f00053f0 0x7f19f000ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:31.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.825+0000 7f19ff7fe640 1 -- 172.21.15.1:0/1260884441 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1a000c7070 con 0x7f19f0004800 2024-05-04T02:20:31.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.825+0000 7f19ff7fe640 1 -- 172.21.15.1:0/1260884441 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f19f000c350 con 0x7f19f00053f0 2024-05-04T02:20:31.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.825+0000 7f19ff7fe640 1 -- 172.21.15.1:0/1260884441 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f19f000c550 con 0x7f19f0003a50 2024-05-04T02:20:31.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.828+0000 7f1a05221640 1 --2- 172.21.15.1:0/1260884441 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f19f00053f0 0x7f19f000ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:31.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.831+0000 7f1a05221640 1 -- 172.21.15.1:0/1260884441 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f19f0003a50 msgr2=0x7f19f0003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:31.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.831+0000 7f1a05221640 1 --2- 172.21.15.1:0/1260884441 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f19f0003a50 0x7f19f0003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:31.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.831+0000 7f1a05221640 1 -- 172.21.15.1:0/1260884441 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f19f0004800 msgr2=0x7f19f0004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:31.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.831+0000 7f1a05221640 1 --2- 172.21.15.1:0/1260884441 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f19f0004800 0x7f19f0004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:31.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.831+0000 7f1a05221640 1 -- 172.21.15.1:0/1260884441 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19f0003520 con 0x7f19f00053f0 2024-05-04T02:20:31.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.832+0000 7f1a05221640 1 -- 172.21.15.1:0/1260884441 reap_dead start 2024-05-04T02:20:31.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.833+0000 7f1a05221640 1 --2- 172.21.15.1:0/1260884441 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f19f00053f0 0x7f19f000ba80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f19f8001d50 tx=0x7f19f0005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d972672a65e00152 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:31.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.837+0000 7f19ff7fe640 1 -- 172.21.15.1:0/1260884441 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f8001920 con 0x7f19f00053f0 2024-05-04T02:20:31.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.837+0000 7f19ff7fe640 1 -- 172.21.15.1:0/1260884441 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19f802ad80 con 0x7f19f00053f0 2024-05-04T02:20:31.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.837+0000 7f19ff7fe640 1 -- 172.21.15.1:0/1260884441 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f8003bb0 con 0x7f19f00053f0 2024-05-04T02:20:31.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.838+0000 7f1a06c84640 1 -- 172.21.15.1:0/1260884441 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f19f00053f0 msgr2=0x7f19f000ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:31.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.838+0000 7f1a06c84640 1 --2- 172.21.15.1:0/1260884441 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f19f00053f0 0x7f19f000ba80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f19f8001d50 tx=0x7f19f0005830 comp rx=0 tx=0).stop 2024-05-04T02:20:31.840 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.838+0000 7f1a06c84640 1 -- 172.21.15.1:0/1260884441 shutdown_connections 2024-05-04T02:20:31.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.838+0000 7f1a06c84640 1 --2- 172.21.15.1:0/1260884441 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f19f00053f0 0x7f19f000ba80 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:31.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.838+0000 7f1a06c84640 1 -- 172.21.15.1:0/1260884441 >> 172.21.15.1:0/1260884441 conn(0x7f1a000d2590 msgr2=0x7f1a000ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:31.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.838+0000 7f1a06c84640 1 -- 172.21.15.1:0/1260884441 shutdown_connections 2024-05-04T02:20:31.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.838+0000 7f1a06c84640 1 -- 172.21.15.1:0/1260884441 wait complete. 2024-05-04T02:20:31.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.840+0000 7f1a06c84640 1 Processor -- start 2024-05-04T02:20:31.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.840+0000 7f1a06c84640 1 -- start start 2024-05-04T02:20:31.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.841+0000 7f1a06c84640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1a0015bb80 0x7f1a001f5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:31.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.841+0000 7f1a06c84640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a0015d6f0 0x7f1a0014d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:31.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.841+0000 7f1a06c84640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1a0015db00 0x7f1a0014b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:31.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.841+0000 7f1a06c84640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1a00156b40 con 0x7f1a0015db00 2024-05-04T02:20:31.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.841+0000 7f1a06c84640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1a000c7880 con 0x7f1a0015d6f0 2024-05-04T02:20:31.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.841+0000 7f1a06c84640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f1a000cd310 con 0x7f1a0015bb80 2024-05-04T02:20:31.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.842+0000 7f19fffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a0015d6f0 0x7f1a0014d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:31.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.842+0000 7f19fffff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a0015d6f0 0x7f1a0014d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.1:47480/0 (socket says 172.21.15.1:47480) 2024-05-04T02:20:31.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.842+0000 7f19fffff640 1 -- 172.21.15.1:0/1533378173 learned_addr learned my addr 172.21.15.1:0/1533378173 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:31.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.848+0000 7f19fffff640 1 -- 172.21.15.1:0/1533378173 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1a0015bb80 msgr2=0x7f1a001f5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:31.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.848+0000 7f19fffff640 1 --2- 172.21.15.1:0/1533378173 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1a0015bb80 0x7f1a001f5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:31.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.848+0000 7f19fffff640 1 -- 172.21.15.1:0/1533378173 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1a0015db00 msgr2=0x7f1a0014b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:31.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.848+0000 7f19fffff640 1 --2- 172.21.15.1:0/1533378173 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1a0015db00 0x7f1a0014b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:31.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.848+0000 7f19fffff640 1 -- 172.21.15.1:0/1533378173 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a0015f410 con 0x7f1a0015d6f0 2024-05-04T02:20:31.851 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-04T02:20:31.853 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.850+0000 7f19fffff640 1 --2- 172.21.15.1:0/1533378173 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a0015d6f0 0x7f1a0014d640 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f19ec00c730 tx=0x7f19ec00cbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:31.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.854+0000 7f19fd7fa640 1 -- 172.21.15.1:0/1533378173 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19ec0074e0 con 0x7f1a0015d6f0 2024-05-04T02:20:31.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.854+0000 7f19fd7fa640 1 -- 172.21.15.1:0/1533378173 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19ec00ce40 con 0x7f1a0015d6f0 2024-05-04T02:20:31.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.854+0000 7f1a06c84640 1 -- 172.21.15.1:0/1533378173 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a0015c150 con 0x7f1a0015d6f0 2024-05-04T02:20:31.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.854+0000 7f19fd7fa640 1 -- 172.21.15.1:0/1533378173 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19ec004a20 con 0x7f1a0015d6f0 2024-05-04T02:20:31.857 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.855+0000 7f1a06c84640 1 -- 172.21.15.1:0/1533378173 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a0015f960 con 0x7f1a0015d6f0 2024-05-04T02:20:31.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.856+0000 7f1a06c84640 1 -- 172.21.15.1:0/1533378173 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a00069bc0 con 0x7f1a0015d6f0 2024-05-04T02:20:31.881 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.877+0000 7f6b327fc640 1 -- 172.21.15.1:0/1229236794 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6b2c01a070 con 0x7f6b3c0c4320 2024-05-04T02:20:31.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.878+0000 7f6b327fc640 1 --2- 172.21.15.1:0/1229236794 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f6b200762d0 0x7f6b200787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:31.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.878+0000 7f6b418f3640 1 --2- 172.21.15.1:0/1229236794 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f6b200762d0 0x7f6b200787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:31.882 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.879+0000 7f6b418f3640 1 --2- 172.21.15.1:0/1229236794 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f6b200762d0 0x7f6b200787e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6b38034000 tx=0x7f6b3802c000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:31.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.883+0000 7f19fd7fa640 1 -- 172.21.15.1:0/1533378173 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f19ec011070 con 0x7f1a0015d6f0 2024-05-04T02:20:31.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.883+0000 7f19fd7fa640 1 --2- 172.21.15.1:0/1533378173 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f19e4076320 0x7f19e4078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:31.885 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.884+0000 7f1a04a20640 1 --2- 172.21.15.1:0/1533378173 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f19e4076320 0x7f19e4078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:31.886 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.884+0000 7f1a04a20640 1 --2- 172.21.15.1:0/1533378173 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f19e4076320 0x7f19e4078830 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1a00063a60 tx=0x7f19f4006d00 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:31.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.891+0000 7ff4ea7fc640 1 -- 172.21.15.1:0/2489318817 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff4ec023020 con 0x7ff4f40c8740 2024-05-04T02:20:31.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.925+0000 7fed0bef2640 1 Processor -- start 2024-05-04T02:20:31.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.925+0000 7fed0bef2640 1 -- start start 2024-05-04T02:20:31.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.926+0000 7fed0bef2640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fed040ca920 0x7fed040cc1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:31.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.926+0000 7fed0bef2640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fed040ca280 0x7fed040cc730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:31.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.927+0000 7fed0bef2640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed0408d7f0 con 0x7fed0415dc30 2024-05-04T02:20:31.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.927+0000 7fed0bef2640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7fed040c5150 con 0x7fed040ca920 2024-05-04T02:20:31.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.927+0000 7fed0bef2640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fed0415b240 con 0x7fed040ca280 2024-05-04T02:20:31.929 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.927+0000 7fed0948d640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fed040ca280 0x7fed040cc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:31.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.928+0000 7fed0948d640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fed040ca280 0x7fed040cc730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.1:50066/0 (socket says 172.21.15.1:50066) 2024-05-04T02:20:31.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.928+0000 7fed0948d640 1 -- 172.21.15.1:0/1845754092 learned_addr learned my addr 172.21.15.1:0/1845754092 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:31.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.930+0000 7fed0948d640 1 -- 172.21.15.1:0/1845754092 >> v2:172.21.15.1:3300/0 conn(0x7fed040ca920 msgr2=0x7fed040cc1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:31.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.930+0000 7fed0948d640 1 --2- 172.21.15.1:0/1845754092 >> v2:172.21.15.1:3300/0 conn(0x7fed040ca920 0x7fed040cc1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:31.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.930+0000 7fed0948d640 1 -- 172.21.15.1:0/1845754092 >> v1:172.21.15.1:6789/0 conn(0x7fed0415dc30 legacy=0x7fed0415e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:31.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.930+0000 7fed0948d640 1 -- 172.21.15.1:0/1845754092 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed040c5410 con 0x7fed040ca280 2024-05-04T02:20:31.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.933+0000 7fed0948d640 1 --2- 172.21.15.1:0/1845754092 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fed040ca280 0x7fed040cc730 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fed040746f0 tx=0x7fecf402a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab2a02d3f99a0a0b server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:31.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.935+0000 7fed08c8c640 1 -- 172.21.15.1:0/1845754092 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecf4037070 con 0x7fed040ca280 2024-05-04T02:20:31.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.937+0000 7fed08c8c640 1 -- 172.21.15.1:0/1845754092 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecf4032440 con 0x7fed040ca280 2024-05-04T02:20:31.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.937+0000 7fed08c8c640 1 -- 172.21.15.1:0/1845754092 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecf4032810 con 0x7fed040ca280 2024-05-04T02:20:31.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.938+0000 7fed0bef2640 1 -- 172.21.15.1:0/1845754092 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fed040ca280 msgr2=0x7fed040cc730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:31.940 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.938+0000 7fed0bef2640 1 --2- 172.21.15.1:0/1845754092 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fed040ca280 0x7fed040cc730 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fed040746f0 tx=0x7fecf402a1a0 comp rx=0 tx=0).stop 2024-05-04T02:20:31.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.938+0000 7fed0bef2640 1 -- 172.21.15.1:0/1845754092 shutdown_connections 2024-05-04T02:20:31.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.938+0000 7fed0bef2640 1 --2- 172.21.15.1:0/1845754092 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fed040ca280 0x7fed040cc730 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:31.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.938+0000 7fed0bef2640 1 --2- 172.21.15.1:0/1845754092 >> v2:172.21.15.1:3300/0 conn(0x7fed040ca920 0x7fed040cc1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:31.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.938+0000 7fed0bef2640 1 -- 172.21.15.1:0/1845754092 >> 172.21.15.1:0/1845754092 conn(0x7fed04072170 msgr2=0x7fed040736f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:31.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.938+0000 7fed0bef2640 1 -- 172.21.15.1:0/1845754092 shutdown_connections 2024-05-04T02:20:31.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.938+0000 7fed0bef2640 1 -- 172.21.15.1:0/1845754092 wait complete. 2024-05-04T02:20:31.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.940+0000 7fed0bef2640 1 Processor -- start 2024-05-04T02:20:31.942 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.940+0000 7fed0bef2640 1 -- start start 2024-05-04T02:20:31.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.942+0000 7fed0bef2640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fed040ca280 0x7fed04157410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:31.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.942+0000 7fed0bef2640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fed040ca920 0x7fed0414df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:31.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.942+0000 7fed0bef2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fed0415dc30 0x7fed0414e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:31.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.942+0000 7fed0bef2640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fed04154760 con 0x7fed0415dc30 2024-05-04T02:20:31.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.942+0000 7fed0bef2640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fed040c59d0 con 0x7fed040ca920 2024-05-04T02:20:31.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.942+0000 7fed0bef2640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fed041548e0 con 0x7fed040ca280 2024-05-04T02:20:31.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.942+0000 7fed09c8e640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fed040ca280 0x7fed04157410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:31.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.943+0000 7fed09c8e640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fed040ca280 0x7fed04157410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.1:50070/0 (socket says 172.21.15.1:50070) 2024-05-04T02:20:31.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.943+0000 7fed09c8e640 1 -- 172.21.15.1:0/2315643447 learned_addr learned my addr 172.21.15.1:0/2315643447 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:31.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.947+0000 7fed09c8e640 1 -- 172.21.15.1:0/2315643447 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fed040ca920 msgr2=0x7fed0414df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:31.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.947+0000 7fed09c8e640 1 --2- 172.21.15.1:0/2315643447 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fed040ca920 0x7fed0414df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:31.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.947+0000 7fed09c8e640 1 -- 172.21.15.1:0/2315643447 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fed0415dc30 msgr2=0x7fed0414e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:31.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.947+0000 7fed09c8e640 1 --2- 172.21.15.1:0/2315643447 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fed0415dc30 0x7fed0414e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:31.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.947+0000 7fed09c8e640 1 -- 172.21.15.1:0/2315643447 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed040cf530 con 0x7fed040ca280 2024-05-04T02:20:31.952 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.950+0000 7fed09c8e640 1 --2- 172.21.15.1:0/2315643447 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fed040ca280 0x7fed04157410 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fed0000b440 tx=0x7fed0000b900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:31.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.954+0000 7fecfa7fc640 1 -- 172.21.15.1:0/2315643447 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed00015020 con 0x7fed040ca280 2024-05-04T02:20:31.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.954+0000 7fecfa7fc640 1 -- 172.21.15.1:0/2315643447 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed00011890 con 0x7fed040ca280 2024-05-04T02:20:31.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.954+0000 7fecfa7fc640 1 -- 172.21.15.1:0/2315643447 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed00011c80 con 0x7fed040ca280 2024-05-04T02:20:31.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.954+0000 7fed0bef2640 1 -- 172.21.15.1:0/2315643447 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed040cd660 con 0x7fed040ca280 2024-05-04T02:20:31.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.955+0000 7fed0bef2640 1 -- 172.21.15.1:0/2315643447 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fed040cdc20 con 0x7fed040ca280 2024-05-04T02:20:31.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.956+0000 7fed0bef2640 1 -- 172.21.15.1:0/2315643447 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed04155ab0 con 0x7fed040ca280 2024-05-04T02:20:31.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.969+0000 7f6b327fc640 1 -- 172.21.15.1:0/1229236794 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f6b2c05c380 con 0x7f6b3c0c4320 2024-05-04T02:20:31.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:31.969+0000 7f6b327fc640 1 -- 172.21.15.1:0/1229236794 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6b2c0600f0 con 0x7f6b3c0c4320 2024-05-04T02:20:32.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.006+0000 7f924088b640 1 Processor -- start 2024-05-04T02:20:32.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.006+0000 7f924088b640 1 -- start start 2024-05-04T02:20:32.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.007+0000 7f924088b640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f923c0cab70 0x7f923c1422c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:32.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.007+0000 7f924088b640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f923c15d0f0 0x7f923c0ce9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:32.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.007+0000 7f924088b640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f923c0c3830 con 0x7f923c0ce590 2024-05-04T02:20:32.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.007+0000 7f924088b640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f923c0c3b10 con 0x7f923c0cab70 2024-05-04T02:20:32.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.007+0000 7f924088b640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f923c0c3df0 con 0x7f923c15d0f0 2024-05-04T02:20:32.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.008+0000 7f923a59c640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f923c0cab70 0x7f923c1422c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:32.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.009+0000 7f923a59c640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f923c0cab70 0x7f923c1422c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41922/0 (socket says 172.21.15.1:41922) 2024-05-04T02:20:32.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.009+0000 7f923a59c640 1 -- 172.21.15.1:0/2169744445 learned_addr learned my addr 172.21.15.1:0/2169744445 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:32.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.011+0000 7f923a59c640 1 -- 172.21.15.1:0/2169744445 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f923c15d0f0 msgr2=0x7f923c0ce9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:32.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.012+0000 7f923a59c640 1 --2- 172.21.15.1:0/2169744445 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f923c15d0f0 0x7f923c0ce9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:32.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.012+0000 7f923a59c640 1 -- 172.21.15.1:0/2169744445 >> v1:172.21.15.107:6789/0 conn(0x7f923c0ce590 legacy=0x7f923c15c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:32.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.012+0000 7f923a59c640 1 -- 172.21.15.1:0/2169744445 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f923c0c40d0 con 0x7f923c0cab70 2024-05-04T02:20:32.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.014+0000 7f923a59c640 1 --2- 172.21.15.1:0/2169744445 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f923c0cab70 0x7f923c1422c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f923c0cf330 tx=0x7f922c02a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac4695f4eb2675b9 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:32.021 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.019+0000 7f923959a640 1 -- 172.21.15.1:0/2169744445 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f922c037070 con 0x7f923c0cab70 2024-05-04T02:20:32.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.019+0000 7f923959a640 1 -- 172.21.15.1:0/2169744445 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f922c032440 con 0x7f923c0cab70 2024-05-04T02:20:32.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.019+0000 7f923959a640 1 -- 172.21.15.1:0/2169744445 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f922c032810 con 0x7f923c0cab70 2024-05-04T02:20:32.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.020+0000 7f924088b640 1 -- 172.21.15.1:0/2169744445 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f923c0cab70 msgr2=0x7f923c1422c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:32.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.020+0000 7f924088b640 1 --2- 172.21.15.1:0/2169744445 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f923c0cab70 0x7f923c1422c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f923c0cf330 tx=0x7f922c02a130 comp rx=0 tx=0).stop 2024-05-04T02:20:32.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.020+0000 7f924088b640 1 -- 172.21.15.1:0/2169744445 shutdown_connections 2024-05-04T02:20:32.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.020+0000 7f924088b640 1 --2- 172.21.15.1:0/2169744445 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f923c15d0f0 0x7f923c0ce9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:32.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.020+0000 7f924088b640 1 --2- 172.21.15.1:0/2169744445 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f923c0cab70 0x7f923c1422c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:32.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.020+0000 7f924088b640 1 -- 172.21.15.1:0/2169744445 >> 172.21.15.1:0/2169744445 conn(0x7f923c0725c0 msgr2=0x7f923c0729d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:32.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.021+0000 7f924088b640 1 -- 172.21.15.1:0/2169744445 shutdown_connections 2024-05-04T02:20:32.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.021+0000 7f924088b640 1 -- 172.21.15.1:0/2169744445 wait complete. 2024-05-04T02:20:32.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.023+0000 7f924088b640 1 Processor -- start 2024-05-04T02:20:32.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.023+0000 7f924088b640 1 -- start start 2024-05-04T02:20:32.027 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.024+0000 7f924088b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f923c0cab70 0x7f923c159df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:32.027 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.024+0000 7f924088b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f923c0ce590 0x7f923c0c9f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:32.027 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.024+0000 7f924088b640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f923c15d0f0 0x7f923c15b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:32.027 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.024+0000 7f924088b640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f923c06f3c0 con 0x7f923c0cab70 2024-05-04T02:20:32.027 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.024+0000 7f924088b640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f923c06f240 con 0x7f923c0ce590 2024-05-04T02:20:32.027 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.024+0000 7f924088b640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f923c06f540 con 0x7f923c15d0f0 2024-05-04T02:20:32.027 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.025+0000 7f923a59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f923c0cab70 0x7f923c159df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:32.027 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.025+0000 7f923a59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f923c0cab70 0x7f923c159df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41924/0 (socket says 172.21.15.1:41924) 2024-05-04T02:20:32.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.025+0000 7f923a59c640 1 -- 172.21.15.1:0/2385916018 learned_addr learned my addr 172.21.15.1:0/2385916018 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:32.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.030+0000 7f923a59c640 1 -- 172.21.15.1:0/2385916018 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f923c15d0f0 msgr2=0x7f923c15b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:32.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.030+0000 7f923a59c640 1 --2- 172.21.15.1:0/2385916018 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f923c15d0f0 0x7f923c15b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:32.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.030+0000 7f923a59c640 1 -- 172.21.15.1:0/2385916018 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f923c0ce590 msgr2=0x7f923c0c9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:32.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.030+0000 7f923a59c640 1 --2- 172.21.15.1:0/2385916018 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f923c0ce590 0x7f923c0c9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:32.032 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.030+0000 7f923a59c640 1 -- 172.21.15.1:0/2385916018 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f923c0ca440 con 0x7f923c0cab70 2024-05-04T02:20:32.034 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.033+0000 7f923a59c640 1 --2- 172.21.15.1:0/2385916018 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f923c0cab70 0x7f923c159df0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f922c009960 tx=0x7f922c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:32.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.039+0000 7f922affd640 1 -- 172.21.15.1:0/2385916018 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f922c041070 con 0x7f923c0cab70 2024-05-04T02:20:32.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.039+0000 7f922affd640 1 -- 172.21.15.1:0/2385916018 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f922c03c930 con 0x7f923c0cab70 2024-05-04T02:20:32.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.039+0000 7f922affd640 1 -- 172.21.15.1:0/2385916018 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f922c037040 con 0x7f923c0cab70 2024-05-04T02:20:32.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.039+0000 7f924088b640 1 -- 172.21.15.1:0/2385916018 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f923c13cd10 con 0x7f923c0cab70 2024-05-04T02:20:32.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.039+0000 7f924088b640 1 -- 172.21.15.1:0/2385916018 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f923c0c9700 con 0x7f923c0cab70 2024-05-04T02:20:32.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.040+0000 7f924088b640 1 -- 172.21.15.1:0/2385916018 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f923c076740 con 0x7f923c0cab70 2024-05-04T02:20:32.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.066+0000 7f922affd640 1 -- 172.21.15.1:0/2385916018 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f922c044070 con 0x7f923c0cab70 2024-05-04T02:20:32.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.067+0000 7f922affd640 1 --2- 172.21.15.1:0/2385916018 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f921c076320 0x7f921c078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:32.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.067+0000 7f9239d9b640 1 --2- 172.21.15.1:0/2385916018 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f921c076320 0x7f921c078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:32.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.068+0000 7f9239d9b640 1 --2- 172.21.15.1:0/2385916018 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f921c076320 0x7f921c078830 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f923c15c7e0 tx=0x7f9230006ba0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:32.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.072+0000 7f922affd640 1 -- 172.21.15.1:0/2385916018 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f922c07daa0 con 0x7f923c0cab70 2024-05-04T02:20:32.084 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.082+0000 7f7028fea640 1 -- 172.21.15.1:0/3584619352 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f7024076740 con 0x7f70240c9c20 2024-05-04T02:20:32.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.142+0000 7ff4fc172640 1 -- 172.21.15.1:0/2489318817 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7ff4f40c62f0 con 0x7ff4f40c8740 2024-05-04T02:20:32.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.145+0000 7f19fd7fa640 1 -- 172.21.15.1:0/1533378173 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f19ec05ce10 con 0x7f1a0015d6f0 2024-05-04T02:20:32.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.155+0000 7f19fd7fa640 1 -- 172.21.15.1:0/1533378173 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f19ec061280 con 0x7f1a0015d6f0 2024-05-04T02:20:32.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.163+0000 7f701affd640 1 -- 172.21.15.1:0/3584619352 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f700c0689c0 con 0x7f70240c9c20 2024-05-04T02:20:32.165 INFO:teuthology.orchestra.run.smithi001.stdout:64424509449 2024-05-04T02:20:32.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.165+0000 7f7028fea640 1 -- 172.21.15.1:0/3584619352 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f7004076470 msgr2=0x7f7004078980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:32.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.165+0000 7f7028fea640 1 --2- 172.21.15.1:0/3584619352 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f7004076470 0x7f7004078980 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7014009560 tx=0x7f701402e000 comp rx=0 tx=0).stop 2024-05-04T02:20:32.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.165+0000 7f7028fea640 1 -- 172.21.15.1:0/3584619352 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70240c9c20 msgr2=0x7f70241542f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:32.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.165+0000 7f7028fea640 1 --2- 172.21.15.1:0/3584619352 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70240c9c20 0x7f70241542f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f700c001720 tx=0x7f700c001be0 comp rx=0 tx=0).stop 2024-05-04T02:20:32.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.165+0000 7f7028fea640 1 -- 172.21.15.1:0/3584619352 shutdown_connections 2024-05-04T02:20:32.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.165+0000 7f7028fea640 1 --2- 172.21.15.1:0/3584619352 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f7004076470 0x7f7004078980 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:32.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.165+0000 7f7028fea640 1 --2- 172.21.15.1:0/3584619352 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7024159e10 0x7f70240c61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:32.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.165+0000 7f7028fea640 1 --2- 172.21.15.1:0/3584619352 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f70240c9c20 0x7f70241542f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:32.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.165+0000 7f7028fea640 1 --2- 172.21.15.1:0/3584619352 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f70240c9170 0x7f70241eec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:32.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.165+0000 7f7028fea640 1 -- 172.21.15.1:0/3584619352 >> 172.21.15.1:0/3584619352 conn(0x7f7024073250 msgr2=0x7f70240b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:32.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.165+0000 7f7028fea640 1 -- 172.21.15.1:0/3584619352 shutdown_connections 2024-05-04T02:20:32.168 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.165+0000 7f7028fea640 1 -- 172.21.15.1:0/3584619352 wait complete. 2024-05-04T02:20:32.179 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.1 2024-05-04T02:20:32.179 DEBUG:teuthology.parallel:result is None 2024-05-04T02:20:32.202 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.200+0000 7f6b43b57640 1 -- 172.21.15.1:0/1229236794 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f6b3c0ca650 con 0x7f6b3c0c4320 2024-05-04T02:20:32.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.240+0000 7fecfa7fc640 1 -- 172.21.15.1:0/2315643447 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fed00018020 con 0x7fed040ca280 2024-05-04T02:20:32.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.240+0000 7fecfa7fc640 1 --2- 172.21.15.1:0/2315643447 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fece8076320 0x7fece8078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:32.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.240+0000 7fed0948d640 1 --2- 172.21.15.1:0/2315643447 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fece8076320 0x7fece8078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:32.243 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.241+0000 7fed0948d640 1 --2- 172.21.15.1:0/2315643447 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fece8076320 0x7fece8078830 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fecf4034000 tx=0x7fecf402c000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:32.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.243+0000 7fecfa7fc640 1 -- 172.21.15.1:0/2315643447 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fed0005d1d0 con 0x7fed040ca280 2024-05-04T02:20:32.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.254+0000 7fecfa7fc640 1 -- 172.21.15.1:0/2315643447 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fed04155ab0 con 0x7fed040ca280 2024-05-04T02:20:32.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.269+0000 7ff4ea7fc640 1 -- 172.21.15.1:0/2489318817 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff4ec0610d0 con 0x7ff4f40c8740 2024-05-04T02:20:32.271 INFO:teuthology.orchestra.run.smithi001.stdout:64424509450 2024-05-04T02:20:32.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.271+0000 7ff4fc172640 1 -- 172.21.15.1:0/2489318817 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7ff4d8076300 msgr2=0x7ff4d8078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:32.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.271+0000 7ff4fc172640 1 --2- 172.21.15.1:0/2489318817 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7ff4d8076300 0x7ff4d8078810 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff4f0034000 tx=0x7ff4f002c000 comp rx=0 tx=0).stop 2024-05-04T02:20:32.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.271+0000 7ff4fc172640 1 -- 172.21.15.1:0/2489318817 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff4f40c8740 msgr2=0x7ff4f40ca1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:32.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.271+0000 7ff4fc172640 1 --2- 172.21.15.1:0/2489318817 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff4f40c8740 0x7ff4f40ca1b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec00b9e0 tx=0x7ff4ec00bea0 comp rx=0 tx=0).stop 2024-05-04T02:20:32.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.271+0000 7ff4fc172640 1 -- 172.21.15.1:0/2489318817 shutdown_connections 2024-05-04T02:20:32.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.271+0000 7ff4fc172640 1 --2- 172.21.15.1:0/2489318817 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7ff4d8076300 0x7ff4d8078810 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:32.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.271+0000 7ff4fc172640 1 --2- 172.21.15.1:0/2489318817 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff4f40c8740 0x7ff4f40ca1b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:32.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.271+0000 7ff4fc172640 1 --2- 172.21.15.1:0/2489318817 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff4f40c8330 0x7ff4f41e6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:32.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.271+0000 7ff4fc172640 1 --2- 172.21.15.1:0/2489318817 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff4f40c7e70 0x7ff4f406f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:32.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.271+0000 7ff4fc172640 1 -- 172.21.15.1:0/2489318817 >> 172.21.15.1:0/2489318817 conn(0x7ff4f40cf6e0 msgr2=0x7ff4f415ad10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:32.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.271+0000 7ff4fc172640 1 -- 172.21.15.1:0/2489318817 shutdown_connections 2024-05-04T02:20:32.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.271+0000 7ff4fc172640 1 -- 172.21.15.1:0/2489318817 wait complete. 2024-05-04T02:20:32.290 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.2 2024-05-04T02:20:32.291 DEBUG:teuthology.parallel:result is None 2024-05-04T02:20:32.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.357+0000 7f1a06c84640 1 -- 172.21.15.1:0/1533378173 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f1a000c6c40 con 0x7f1a0015d6f0 2024-05-04T02:20:32.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.361+0000 7f19fd7fa640 1 -- 172.21.15.1:0/1533378173 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f19ec069270 con 0x7f1a0015d6f0 2024-05-04T02:20:32.363 INFO:teuthology.orchestra.run.smithi001.stdout:55834574858 2024-05-04T02:20:32.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.363+0000 7f1a06c84640 1 -- 172.21.15.1:0/1533378173 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f19e4076320 msgr2=0x7f19e4078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:32.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.363+0000 7f1a06c84640 1 --2- 172.21.15.1:0/1533378173 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f19e4076320 0x7f19e4078830 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1a00063a60 tx=0x7f19f4006d00 comp rx=0 tx=0).stop 2024-05-04T02:20:32.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.363+0000 7f1a06c84640 1 -- 172.21.15.1:0/1533378173 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a0015d6f0 msgr2=0x7f1a0014d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:32.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.363+0000 7f1a06c84640 1 --2- 172.21.15.1:0/1533378173 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a0015d6f0 0x7f1a0014d640 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f19ec00c730 tx=0x7f19ec00cbf0 comp rx=0 tx=0).stop 2024-05-04T02:20:32.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.363+0000 7f1a06c84640 1 -- 172.21.15.1:0/1533378173 shutdown_connections 2024-05-04T02:20:32.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.363+0000 7f1a06c84640 1 --2- 172.21.15.1:0/1533378173 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f19e4076320 0x7f19e4078830 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:32.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.363+0000 7f1a06c84640 1 --2- 172.21.15.1:0/1533378173 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1a0015db00 0x7f1a0014b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:32.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.363+0000 7f1a06c84640 1 --2- 172.21.15.1:0/1533378173 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a0015d6f0 0x7f1a0014d640 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:32.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.363+0000 7f1a06c84640 1 --2- 172.21.15.1:0/1533378173 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1a0015bb80 0x7f1a001f5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:32.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.363+0000 7f1a06c84640 1 -- 172.21.15.1:0/1533378173 >> 172.21.15.1:0/1533378173 conn(0x7f1a000d2590 msgr2=0x7f1a000cfee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:32.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.363+0000 7f1a06c84640 1 -- 172.21.15.1:0/1533378173 shutdown_connections 2024-05-04T02:20:32.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.363+0000 7f1a06c84640 1 -- 172.21.15.1:0/1533378173 wait complete. 2024-05-04T02:20:32.377 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574858 for osd.0 2024-05-04T02:20:32.377 DEBUG:teuthology.parallel:result is None 2024-05-04T02:20:32.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.380+0000 7f922affd640 1 -- 172.21.15.1:0/2385916018 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f922c081f10 con 0x7f923c0cab70 2024-05-04T02:20:32.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.403+0000 7f6b327fc640 1 -- 172.21.15.1:0/1229236794 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6b3c0ca650 con 0x7f6b3c0c4320 2024-05-04T02:20:32.405 INFO:teuthology.orchestra.run.smithi001.stdout:64424509450 2024-05-04T02:20:32.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.405+0000 7f6b43b57640 1 -- 172.21.15.1:0/1229236794 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f6b200762d0 msgr2=0x7f6b200787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:32.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.405+0000 7f6b43b57640 1 --2- 172.21.15.1:0/1229236794 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f6b200762d0 0x7f6b200787e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6b38034000 tx=0x7f6b3802c000 comp rx=0 tx=0).stop 2024-05-04T02:20:32.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.405+0000 7f6b43b57640 1 -- 172.21.15.1:0/1229236794 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b3c0c4320 msgr2=0x7f6b3c14d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:32.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.405+0000 7f6b43b57640 1 --2- 172.21.15.1:0/1229236794 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b3c0c4320 0x7f6b3c14d320 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c00c410 tx=0x7f6b2c00c8d0 comp rx=0 tx=0).stop 2024-05-04T02:20:32.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.405+0000 7f6b43b57640 1 -- 172.21.15.1:0/1229236794 shutdown_connections 2024-05-04T02:20:32.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.405+0000 7f6b43b57640 1 --2- 172.21.15.1:0/1229236794 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f6b200762d0 0x7f6b200787e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:32.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.405+0000 7f6b43b57640 1 --2- 172.21.15.1:0/1229236794 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f6b3c0caa30 0x7f6b3c14d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:32.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.405+0000 7f6b43b57640 1 --2- 172.21.15.1:0/1229236794 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f6b3c0c4320 0x7f6b3c14d320 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:32.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.405+0000 7f6b43b57640 1 --2- 172.21.15.1:0/1229236794 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f6b3c0c3f10 0x7f6b3c1507f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:32.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.405+0000 7f6b43b57640 1 -- 172.21.15.1:0/1229236794 >> 172.21.15.1:0/1229236794 conn(0x7f6b3c0725c0 msgr2=0x7f6b3c1585c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:32.408 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.405+0000 7f6b43b57640 1 -- 172.21.15.1:0/1229236794 shutdown_connections 2024-05-04T02:20:32.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.405+0000 7f6b43b57640 1 -- 172.21.15.1:0/1229236794 wait complete. 2024-05-04T02:20:32.420 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.6 2024-05-04T02:20:32.420 DEBUG:teuthology.parallel:result is None 2024-05-04T02:20:32.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.451+0000 7fed0bef2640 1 -- 172.21.15.1:0/2315643447 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fed04076740 con 0x7fed040ca280 2024-05-04T02:20:32.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.455+0000 7fecfa7fc640 1 -- 172.21.15.1:0/2315643447 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fed0001f020 con 0x7fed040ca280 2024-05-04T02:20:32.458 INFO:teuthology.orchestra.run.smithi001.stdout:64424509450 2024-05-04T02:20:32.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.459+0000 7fed0bef2640 1 -- 172.21.15.1:0/2315643447 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fece8076320 msgr2=0x7fece8078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:32.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.459+0000 7fed0bef2640 1 --2- 172.21.15.1:0/2315643447 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fece8076320 0x7fece8078830 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fecf4034000 tx=0x7fecf402c000 comp rx=0 tx=0).stop 2024-05-04T02:20:32.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.459+0000 7fed0bef2640 1 -- 172.21.15.1:0/2315643447 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fed040ca280 msgr2=0x7fed04157410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:32.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.459+0000 7fed0bef2640 1 --2- 172.21.15.1:0/2315643447 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fed040ca280 0x7fed04157410 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fed0000b440 tx=0x7fed0000b900 comp rx=0 tx=0).stop 2024-05-04T02:20:32.461 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.459+0000 7fed0bef2640 1 -- 172.21.15.1:0/2315643447 shutdown_connections 2024-05-04T02:20:32.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.459+0000 7fed0bef2640 1 --2- 172.21.15.1:0/2315643447 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fece8076320 0x7fece8078830 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:32.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.459+0000 7fed0bef2640 1 --2- 172.21.15.1:0/2315643447 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fed0415dc30 0x7fed0414e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:32.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.459+0000 7fed0bef2640 1 --2- 172.21.15.1:0/2315643447 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fed040ca920 0x7fed0414df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:32.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.459+0000 7fed0bef2640 1 --2- 172.21.15.1:0/2315643447 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fed040ca280 0x7fed04157410 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:32.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.459+0000 7fed0bef2640 1 -- 172.21.15.1:0/2315643447 >> 172.21.15.1:0/2315643447 conn(0x7fed04072170 msgr2=0x7fed040cf7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:32.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.459+0000 7fed0bef2640 1 -- 172.21.15.1:0/2315643447 shutdown_connections 2024-05-04T02:20:32.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.459+0000 7fed0bef2640 1 -- 172.21.15.1:0/2315643447 wait complete. 2024-05-04T02:20:32.477 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.7 2024-05-04T02:20:32.477 DEBUG:teuthology.parallel:result is None 2024-05-04T02:20:32.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.586+0000 7f924088b640 1 -- 172.21.15.1:0/2385916018 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f923c0c53d0 con 0x7f923c0cab70 2024-05-04T02:20:32.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.663+0000 7f922affd640 1 -- 172.21.15.1:0/2385916018 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f922c0880e0 con 0x7f923c0cab70 2024-05-04T02:20:32.666 INFO:teuthology.orchestra.run.smithi001.stdout:64424509450 2024-05-04T02:20:32.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.666+0000 7f924088b640 1 -- 172.21.15.1:0/2385916018 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f921c076320 msgr2=0x7f921c078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:32.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.666+0000 7f924088b640 1 --2- 172.21.15.1:0/2385916018 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f921c076320 0x7f921c078830 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f923c15c7e0 tx=0x7f9230006ba0 comp rx=0 tx=0).stop 2024-05-04T02:20:32.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.666+0000 7f924088b640 1 -- 172.21.15.1:0/2385916018 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f923c0cab70 msgr2=0x7f923c159df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:32.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.666+0000 7f924088b640 1 --2- 172.21.15.1:0/2385916018 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f923c0cab70 0x7f923c159df0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f922c009960 tx=0x7f922c0046c0 comp rx=0 tx=0).stop 2024-05-04T02:20:32.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.666+0000 7f924088b640 1 -- 172.21.15.1:0/2385916018 shutdown_connections 2024-05-04T02:20:32.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.666+0000 7f924088b640 1 --2- 172.21.15.1:0/2385916018 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f921c076320 0x7f921c078830 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:32.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.666+0000 7f924088b640 1 --2- 172.21.15.1:0/2385916018 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f923c15d0f0 0x7f923c15b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:32.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.666+0000 7f924088b640 1 --2- 172.21.15.1:0/2385916018 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f923c0ce590 0x7f923c0c9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:32.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.666+0000 7f924088b640 1 --2- 172.21.15.1:0/2385916018 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f923c0cab70 0x7f923c159df0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:32.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.666+0000 7f924088b640 1 -- 172.21.15.1:0/2385916018 >> 172.21.15.1:0/2385916018 conn(0x7f923c0725c0 msgr2=0x7f923c13f470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:32.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.666+0000 7f924088b640 1 -- 172.21.15.1:0/2385916018 shutdown_connections 2024-05-04T02:20:32.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.666+0000 7f924088b640 1 -- 172.21.15.1:0/2385916018 wait complete. 2024-05-04T02:20:32.679 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.5 2024-05-04T02:20:32.679 DEBUG:teuthology.parallel:result is None 2024-05-04T02:20:32.679 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-04T02:20:32.680 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-04T02:20:32.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.789+0000 7f1dd5734640 1 Processor -- start 2024-05-04T02:20:32.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.789+0000 7f1dd5734640 1 -- start start 2024-05-04T02:20:32.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.791+0000 7f1dd5734640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1dd00c7da0 0x7f1dd015cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:32.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.791+0000 7f1dd5734640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f1dd00cc590 0x7f1dd00cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:32.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.791+0000 7f1dd5734640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1dd00cd6c0 con 0x7f1dd00cde50 2024-05-04T02:20:32.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.791+0000 7f1dd5734640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f1dd00c7070 con 0x7f1dd00cc590 2024-05-04T02:20:32.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.791+0000 7f1dd5734640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f1dd00cd980 con 0x7f1dd00c7da0 2024-05-04T02:20:32.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.792+0000 7f1dc67fc640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1dd00c7da0 0x7f1dd015cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:32.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.793+0000 7f1dc67fc640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1dd00c7da0 0x7f1dd015cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.1:40130/0 (socket says 172.21.15.1:40130) 2024-05-04T02:20:32.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.793+0000 7f1dc67fc640 1 -- 172.21.15.1:0/1663167789 learned_addr learned my addr 172.21.15.1:0/1663167789 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:32.795 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.793+0000 7f1dcf7fe640 1 --2- 172.21.15.1:0/1663167789 >> v2:172.21.15.107:3300/0 conn(0x7f1dd00cc590 0x7f1dd00cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:32.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.795+0000 7f1dc67fc640 1 -- 172.21.15.1:0/1663167789 >> v2:172.21.15.107:3300/0 conn(0x7f1dd00cc590 msgr2=0x7f1dd00cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:32.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.795+0000 7f1dc67fc640 1 --2- 172.21.15.1:0/1663167789 >> v2:172.21.15.107:3300/0 conn(0x7f1dd00cc590 0x7f1dd00cc9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:32.797 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.795+0000 7f1dc67fc640 1 -- 172.21.15.1:0/1663167789 >> v1:172.21.15.1:6789/0 conn(0x7f1dd00cde50 legacy=0x7f1dd006c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:32.798 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.795+0000 7f1dc67fc640 1 -- 172.21.15.1:0/1663167789 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dd00c72c0 con 0x7f1dd00c7da0 2024-05-04T02:20:32.799 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.797+0000 7f1dc67fc640 1 --2- 172.21.15.1:0/1663167789 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1dd00c7da0 0x7f1dd015cfb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1db8009870 tx=0x7f1db802a300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb35737c978f786b server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:32.801 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.799+0000 7f1dce7fc640 1 -- 172.21.15.1:0/1663167789 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db8037070 con 0x7f1dd00c7da0 2024-05-04T02:20:32.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.801+0000 7f1dce7fc640 1 -- 172.21.15.1:0/1663167789 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1db802ae50 con 0x7f1dd00c7da0 2024-05-04T02:20:32.803 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.801+0000 7f1dce7fc640 1 -- 172.21.15.1:0/1663167789 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db8032860 con 0x7f1dd00c7da0 2024-05-04T02:20:32.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.802+0000 7f1dd5734640 1 -- 172.21.15.1:0/1663167789 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1dd00c7da0 msgr2=0x7f1dd015cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:32.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.802+0000 7f1dd5734640 1 --2- 172.21.15.1:0/1663167789 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1dd00c7da0 0x7f1dd015cfb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1db8009870 tx=0x7f1db802a300 comp rx=0 tx=0).stop 2024-05-04T02:20:32.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.802+0000 7f1dd5734640 1 -- 172.21.15.1:0/1663167789 shutdown_connections 2024-05-04T02:20:32.804 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.802+0000 7f1dd5734640 1 --2- 172.21.15.1:0/1663167789 >> v2:172.21.15.107:3300/0 conn(0x7f1dd00cc590 0x7f1dd00cc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:32.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.802+0000 7f1dd5734640 1 --2- 172.21.15.1:0/1663167789 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1dd00c7da0 0x7f1dd015cfb0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:32.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.802+0000 7f1dd5734640 1 -- 172.21.15.1:0/1663167789 >> 172.21.15.1:0/1663167789 conn(0x7f1dd00d2590 msgr2=0x7f1dd00ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:32.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.802+0000 7f1dd5734640 1 -- 172.21.15.1:0/1663167789 shutdown_connections 2024-05-04T02:20:32.805 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.802+0000 7f1dd5734640 1 -- 172.21.15.1:0/1663167789 wait complete. 2024-05-04T02:20:32.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.804+0000 7f1dd5734640 1 Processor -- start 2024-05-04T02:20:32.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.804+0000 7f1dd5734640 1 -- start start 2024-05-04T02:20:32.807 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.805+0000 7f1dd5734640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1dd00c7da0 0x7f1dd015ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:32.807 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.805+0000 7f1dd5734640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1dd00cc590 0x7f1dd01e6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:32.808 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.805+0000 7f1dd5734640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1dd00ca270 0x7f1dd015e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:32.808 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.805+0000 7f1dd5734640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1dd0156b40 con 0x7f1dd00ca270 2024-05-04T02:20:32.808 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.805+0000 7f1dd5734640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1dd00c7880 con 0x7f1dd00c7da0 2024-05-04T02:20:32.808 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.805+0000 7f1dd5734640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f1dd00cd310 con 0x7f1dd00cc590 2024-05-04T02:20:32.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.806+0000 7f1dc67fc640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1dd00cc590 0x7f1dd01e6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:32.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.806+0000 7f1dceffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1dd00c7da0 0x7f1dd015ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:32.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.806+0000 7f1dcf7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1dd00ca270 0x7f1dd015e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:32.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.806+0000 7f1dc67fc640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1dd00cc590 0x7f1dd01e6ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.1:40136/0 (socket says 172.21.15.1:40136) 2024-05-04T02:20:32.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.806+0000 7f1dc67fc640 1 -- 172.21.15.1:0/1203740595 learned_addr learned my addr 172.21.15.1:0/1203740595 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:32.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.810+0000 7f1dcf7fe640 1 -- 172.21.15.1:0/1203740595 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1dd00cc590 msgr2=0x7f1dd01e6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:32.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.810+0000 7f1dcf7fe640 1 --2- 172.21.15.1:0/1203740595 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1dd00cc590 0x7f1dd01e6ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:32.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.810+0000 7f1dcf7fe640 1 -- 172.21.15.1:0/1203740595 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1dd00c7da0 msgr2=0x7f1dd015ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:32.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.810+0000 7f1dcf7fe640 1 --2- 172.21.15.1:0/1203740595 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1dd00c7da0 0x7f1dd015ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:32.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.810+0000 7f1dcf7fe640 1 -- 172.21.15.1:0/1203740595 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dd01f32b0 con 0x7f1dd00ca270 2024-05-04T02:20:32.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.813+0000 7f1dcf7fe640 1 --2- 172.21.15.1:0/1203740595 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1dd00ca270 0x7f1dd015e700 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1dc800eba0 tx=0x7f1dc800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:32.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.817+0000 7f1dc7fff640 1 -- 172.21.15.1:0/1203740595 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc8018020 con 0x7f1dd00ca270 2024-05-04T02:20:32.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.817+0000 7f1dc7fff640 1 -- 172.21.15.1:0/1203740595 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1dc800ccc0 con 0x7f1dd00ca270 2024-05-04T02:20:32.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.817+0000 7f1dc7fff640 1 -- 172.21.15.1:0/1203740595 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc80146c0 con 0x7f1dd00ca270 2024-05-04T02:20:32.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.817+0000 7f1dd5734640 1 -- 172.21.15.1:0/1203740595 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dd00c8dd0 con 0x7f1dd00ca270 2024-05-04T02:20:32.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.817+0000 7f1dd5734640 1 -- 172.21.15.1:0/1203740595 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dd00c9390 con 0x7f1dd00ca270 2024-05-04T02:20:32.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.818+0000 7f1dd5734640 1 -- 172.21.15.1:0/1203740595 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1dd0069bc0 con 0x7f1dd00ca270 2024-05-04T02:20:32.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.841+0000 7f1dc7fff640 1 -- 172.21.15.1:0/1203740595 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1dc8005d10 con 0x7f1dd00ca270 2024-05-04T02:20:32.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.841+0000 7f1dc7fff640 1 --2- 172.21.15.1:0/1203740595 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f1db0076350 0x7f1db0078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:32.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.842+0000 7f1dceffd640 1 --2- 172.21.15.1:0/1203740595 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f1db0076350 0x7f1db0078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:32.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.842+0000 7f1dceffd640 1 --2- 172.21.15.1:0/1203740595 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f1db0076350 0x7f1db0078860 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1dd006e200 tx=0x7f1dc0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:32.847 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:32.845+0000 7f1dc7fff640 1 -- 172.21.15.1:0/1203740595 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f1dc805dca0 con 0x7f1dd00ca270 2024-05-04T02:20:33.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:33.131+0000 7f1dc7fff640 1 -- 172.21.15.1:0/1203740595 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1dc8022030 con 0x7f1dd00ca270 2024-05-04T02:20:33.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:33.320+0000 7f1dd5734640 1 -- 172.21.15.1:0/1203740595 --> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1dd006a5f0 con 0x7f1db0076350 2024-05-04T02:20:33.328 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:33.326+0000 7f1dc7fff640 1 -- 172.21.15.1:0/1203740595 <== mgr.4108 v2:172.21.15.107:6800/3809222574 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251902 (secure 0 0 0) 0x7f1dc0001cd0 con 0x7f1db0076350 2024-05-04T02:20:33.331 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:20:33.332 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-05-04T02:20:33.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:33.329+0000 7f1dd5734640 1 -- 172.21.15.1:0/1203740595 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f1db0076350 msgr2=0x7f1db0078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:33.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:33.329+0000 7f1dd5734640 1 --2- 172.21.15.1:0/1203740595 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f1db0076350 0x7f1db0078860 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1dd006e200 tx=0x7f1dc0009040 comp rx=0 tx=0).stop 2024-05-04T02:20:33.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:33.329+0000 7f1dd5734640 1 -- 172.21.15.1:0/1203740595 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1dd00ca270 msgr2=0x7f1dd015e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:33.334 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:33.329+0000 7f1dd5734640 1 --2- 172.21.15.1:0/1203740595 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1dd00ca270 0x7f1dd015e700 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1dc800eba0 tx=0x7f1dc800c490 comp rx=0 tx=0).stop 2024-05-04T02:20:33.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:33.329+0000 7f1dd5734640 1 -- 172.21.15.1:0/1203740595 shutdown_connections 2024-05-04T02:20:33.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:33.329+0000 7f1dd5734640 1 --2- 172.21.15.1:0/1203740595 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f1db0076350 0x7f1db0078860 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:33.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:33.329+0000 7f1dd5734640 1 --2- 172.21.15.1:0/1203740595 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1dd00ca270 0x7f1dd015e700 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:33.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:33.329+0000 7f1dd5734640 1 --2- 172.21.15.1:0/1203740595 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1dd00cc590 0x7f1dd01e6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:33.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:33.329+0000 7f1dd5734640 1 --2- 172.21.15.1:0/1203740595 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1dd00c7da0 0x7f1dd015ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:33.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:33.329+0000 7f1dd5734640 1 -- 172.21.15.1:0/1203740595 >> 172.21.15.1:0/1203740595 conn(0x7f1dd00d2590 msgr2=0x7f1dd006c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:33.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:33.329+0000 7f1dd5734640 1 -- 172.21.15.1:0/1203740595 shutdown_connections 2024-05-04T02:20:33.335 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:33.329+0000 7f1dd5734640 1 -- 172.21.15.1:0/1203740595 wait complete. 2024-05-04T02:20:33.343 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-05-04T02:20:33.126582+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":234852,"kb_used_data":2016,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739868,"statfs":{"total":773094113280,"available":772853624832,"internally_reserved":0,"allocated":2064384,"data_stored":1861780,"data_compressed":65100,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1612,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002883"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.547287+0000","last_change":"2024-05-04T02:20:15.298728+0000","last_active":"2024-05-04T02:20:18.547287+0000","last_peered":"2024-05-04T02:20:18.547287+0000","last_clean":"2024-05-04T02:20:18.547287+0000","last_became_active":"2024-05-04T02:20:15.298265+0000","last_became_peered":"2024-05-04T02:20:15.298265+0000","last_unstale":"2024-05-04T02:20:18.547287+0000","last_undegraded":"2024-05-04T02:20:18.547287+0000","last_fullsized":"2024-05-04T02:20:18.547287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:57:21.783118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.023924+0000","last_change":"2024-05-04T02:20:15.299265+0000","last_active":"2024-05-04T02:20:18.023924+0000","last_peered":"2024-05-04T02:20:18.023924+0000","last_clean":"2024-05-04T02:20:18.023924+0000","last_became_active":"2024-05-04T02:20:15.298956+0000","last_became_peered":"2024-05-04T02:20:15.298956+0000","last_unstale":"2024-05-04T02:20:18.023924+0000","last_undegraded":"2024-05-04T02:20:18.023924+0000","last_fullsized":"2024-05-04T02:20:18.023924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:23:25.157473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546733+0000","last_change":"2024-05-04T02:20:15.297447+0000","last_active":"2024-05-04T02:20:18.546733+0000","last_peered":"2024-05-04T02:20:18.546733+0000","last_clean":"2024-05-04T02:20:18.546733+0000","last_became_active":"2024-05-04T02:20:15.297150+0000","last_became_peered":"2024-05-04T02:20:15.297150+0000","last_unstale":"2024-05-04T02:20:18.546733+0000","last_undegraded":"2024-05-04T02:20:18.546733+0000","last_fullsized":"2024-05-04T02:20:18.546733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:10:27.059401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546433+0000","last_change":"2024-05-04T02:20:15.301427+0000","last_active":"2024-05-04T02:20:18.546433+0000","last_peered":"2024-05-04T02:20:18.546433+0000","last_clean":"2024-05-04T02:20:18.546433+0000","last_became_active":"2024-05-04T02:20:15.301113+0000","last_became_peered":"2024-05-04T02:20:15.301113+0000","last_unstale":"2024-05-04T02:20:18.546433+0000","last_undegraded":"2024-05-04T02:20:18.546433+0000","last_fullsized":"2024-05-04T02:20:18.546433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:06:48.185771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.547075+0000","last_change":"2024-05-04T02:20:15.297817+0000","last_active":"2024-05-04T02:20:18.547075+0000","last_peered":"2024-05-04T02:20:18.547075+0000","last_clean":"2024-05-04T02:20:18.547075+0000","last_became_active":"2024-05-04T02:20:15.297511+0000","last_became_peered":"2024-05-04T02:20:15.297511+0000","last_unstale":"2024-05-04T02:20:18.547075+0000","last_undegraded":"2024-05-04T02:20:18.547075+0000","last_fullsized":"2024-05-04T02:20:18.547075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:33:31.416768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546640+0000","last_change":"2024-05-04T02:20:15.306853+0000","last_active":"2024-05-04T02:20:18.546640+0000","last_peered":"2024-05-04T02:20:18.546640+0000","last_clean":"2024-05-04T02:20:18.546640+0000","last_became_active":"2024-05-04T02:20:15.306537+0000","last_became_peered":"2024-05-04T02:20:15.306537+0000","last_unstale":"2024-05-04T02:20:18.546640+0000","last_undegraded":"2024-05-04T02:20:18.546640+0000","last_fullsized":"2024-05-04T02:20:18.546640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:35:15.732585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546478+0000","last_change":"2024-05-04T02:20:15.299499+0000","last_active":"2024-05-04T02:20:18.546478+0000","last_peered":"2024-05-04T02:20:18.546478+0000","last_clean":"2024-05-04T02:20:18.546478+0000","last_became_active":"2024-05-04T02:20:15.299177+0000","last_became_peered":"2024-05-04T02:20:15.299177+0000","last_unstale":"2024-05-04T02:20:18.546478+0000","last_undegraded":"2024-05-04T02:20:18.546478+0000","last_fullsized":"2024-05-04T02:20:18.546478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:13:25.600467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.963063+0000","last_change":"2024-05-04T02:20:15.306964+0000","last_active":"2024-05-04T02:20:17.963063+0000","last_peered":"2024-05-04T02:20:17.963063+0000","last_clean":"2024-05-04T02:20:17.963063+0000","last_became_active":"2024-05-04T02:20:15.306663+0000","last_became_peered":"2024-05-04T02:20:15.306663+0000","last_unstale":"2024-05-04T02:20:17.963063+0000","last_undegraded":"2024-05-04T02:20:17.963063+0000","last_fullsized":"2024-05-04T02:20:17.963063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:52:22.299082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.547373+0000","last_change":"2024-05-04T02:20:15.303354+0000","last_active":"2024-05-04T02:20:18.547373+0000","last_peered":"2024-05-04T02:20:18.547373+0000","last_clean":"2024-05-04T02:20:18.547373+0000","last_became_active":"2024-05-04T02:20:15.303055+0000","last_became_peered":"2024-05-04T02:20:15.303055+0000","last_unstale":"2024-05-04T02:20:18.547373+0000","last_undegraded":"2024-05-04T02:20:18.547373+0000","last_fullsized":"2024-05-04T02:20:18.547373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:22:30.839899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.975983+0000","last_change":"2024-05-04T02:20:15.307433+0000","last_active":"2024-05-04T02:20:17.975983+0000","last_peered":"2024-05-04T02:20:17.975983+0000","last_clean":"2024-05-04T02:20:17.975983+0000","last_became_active":"2024-05-04T02:20:15.307124+0000","last_became_peered":"2024-05-04T02:20:15.307124+0000","last_unstale":"2024-05-04T02:20:17.975983+0000","last_undegraded":"2024-05-04T02:20:17.975983+0000","last_fullsized":"2024-05-04T02:20:17.975983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:22:04.903746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.975729+0000","last_change":"2024-05-04T02:20:15.306714+0000","last_active":"2024-05-04T02:20:17.975729+0000","last_peered":"2024-05-04T02:20:17.975729+0000","last_clean":"2024-05-04T02:20:17.975729+0000","last_became_active":"2024-05-04T02:20:15.306409+0000","last_became_peered":"2024-05-04T02:20:15.306409+0000","last_unstale":"2024-05-04T02:20:17.975729+0000","last_undegraded":"2024-05-04T02:20:17.975729+0000","last_fullsized":"2024-05-04T02:20:17.975729+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:51:58.828664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.964671+0000","last_change":"2024-05-04T02:20:15.296940+0000","last_active":"2024-05-04T02:20:17.964671+0000","last_peered":"2024-05-04T02:20:17.964671+0000","last_clean":"2024-05-04T02:20:17.964671+0000","last_became_active":"2024-05-04T02:20:15.296640+0000","last_became_peered":"2024-05-04T02:20:15.296640+0000","last_unstale":"2024-05-04T02:20:17.964671+0000","last_undegraded":"2024-05-04T02:20:17.964671+0000","last_fullsized":"2024-05-04T02:20:17.964671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:25:44.598454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.963262+0000","last_change":"2024-05-04T02:20:15.294287+0000","last_active":"2024-05-04T02:20:17.963262+0000","last_peered":"2024-05-04T02:20:17.963262+0000","last_clean":"2024-05-04T02:20:17.963262+0000","last_became_active":"2024-05-04T02:20:15.293909+0000","last_became_peered":"2024-05-04T02:20:15.293909+0000","last_unstale":"2024-05-04T02:20:17.963262+0000","last_undegraded":"2024-05-04T02:20:17.963262+0000","last_fullsized":"2024-05-04T02:20:17.963262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:31:26.635672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546404+0000","last_change":"2024-05-04T02:20:15.293837+0000","last_active":"2024-05-04T02:20:18.546404+0000","last_peered":"2024-05-04T02:20:18.546404+0000","last_clean":"2024-05-04T02:20:18.546404+0000","last_became_active":"2024-05-04T02:20:15.293550+0000","last_became_peered":"2024-05-04T02:20:15.293550+0000","last_unstale":"2024-05-04T02:20:18.546404+0000","last_undegraded":"2024-05-04T02:20:18.546404+0000","last_fullsized":"2024-05-04T02:20:18.546404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:55:35.975972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.023439+0000","last_change":"2024-05-04T02:20:15.306005+0000","last_active":"2024-05-04T02:20:18.023439+0000","last_peered":"2024-05-04T02:20:18.023439+0000","last_clean":"2024-05-04T02:20:18.023439+0000","last_became_active":"2024-05-04T02:20:15.305549+0000","last_became_peered":"2024-05-04T02:20:15.305549+0000","last_unstale":"2024-05-04T02:20:18.023439+0000","last_undegraded":"2024-05-04T02:20:18.023439+0000","last_fullsized":"2024-05-04T02:20:18.023439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:58:55.400048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546265+0000","last_change":"2024-05-04T02:20:15.305322+0000","last_active":"2024-05-04T02:20:18.546265+0000","last_peered":"2024-05-04T02:20:18.546265+0000","last_clean":"2024-05-04T02:20:18.546265+0000","last_became_active":"2024-05-04T02:20:15.301515+0000","last_became_peered":"2024-05-04T02:20:15.301515+0000","last_unstale":"2024-05-04T02:20:18.546265+0000","last_undegraded":"2024-05-04T02:20:18.546265+0000","last_fullsized":"2024-05-04T02:20:18.546265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:10:21.048301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546917+0000","last_change":"2024-05-04T02:20:15.301042+0000","last_active":"2024-05-04T02:20:18.546917+0000","last_peered":"2024-05-04T02:20:18.546917+0000","last_clean":"2024-05-04T02:20:18.546917+0000","last_became_active":"2024-05-04T02:20:15.300707+0000","last_became_peered":"2024-05-04T02:20:15.300707+0000","last_unstale":"2024-05-04T02:20:18.546917+0000","last_undegraded":"2024-05-04T02:20:18.546917+0000","last_fullsized":"2024-05-04T02:20:18.546917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:36:19.111702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546693+0000","last_change":"2024-05-04T02:20:15.292059+0000","last_active":"2024-05-04T02:20:18.546693+0000","last_peered":"2024-05-04T02:20:18.546693+0000","last_clean":"2024-05-04T02:20:18.546693+0000","last_became_active":"2024-05-04T02:20:15.291766+0000","last_became_peered":"2024-05-04T02:20:15.291766+0000","last_unstale":"2024-05-04T02:20:18.546693+0000","last_undegraded":"2024-05-04T02:20:18.546693+0000","last_fullsized":"2024-05-04T02:20:18.546693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:49:41.728826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.547413+0000","last_change":"2024-05-04T02:20:15.297861+0000","last_active":"2024-05-04T02:20:18.547413+0000","last_peered":"2024-05-04T02:20:18.547413+0000","last_clean":"2024-05-04T02:20:18.547413+0000","last_became_active":"2024-05-04T02:20:15.297568+0000","last_became_peered":"2024-05-04T02:20:15.297568+0000","last_unstale":"2024-05-04T02:20:18.547413+0000","last_undegraded":"2024-05-04T02:20:18.547413+0000","last_fullsized":"2024-05-04T02:20:18.547413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:52:52.278453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.975867+0000","last_change":"2024-05-04T02:20:15.303036+0000","last_active":"2024-05-04T02:20:17.975867+0000","last_peered":"2024-05-04T02:20:17.975867+0000","last_clean":"2024-05-04T02:20:17.975867+0000","last_became_active":"2024-05-04T02:20:15.302743+0000","last_became_peered":"2024-05-04T02:20:15.302743+0000","last_unstale":"2024-05-04T02:20:17.975867+0000","last_undegraded":"2024-05-04T02:20:17.975867+0000","last_fullsized":"2024-05-04T02:20:17.975867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:58:55.400048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546536+0000","last_change":"2024-05-04T02:20:15.300987+0000","last_active":"2024-05-04T02:20:18.546536+0000","last_peered":"2024-05-04T02:20:18.546536+0000","last_clean":"2024-05-04T02:20:18.546536+0000","last_became_active":"2024-05-04T02:20:15.300709+0000","last_became_peered":"2024-05-04T02:20:15.300709+0000","last_unstale":"2024-05-04T02:20:18.546536+0000","last_undegraded":"2024-05-04T02:20:18.546536+0000","last_fullsized":"2024-05-04T02:20:18.546536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:15:46.319755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546742+0000","last_change":"2024-05-04T02:20:15.301545+0000","last_active":"2024-05-04T02:20:18.546742+0000","last_peered":"2024-05-04T02:20:18.546742+0000","last_clean":"2024-05-04T02:20:18.546742+0000","last_became_active":"2024-05-04T02:20:15.300848+0000","last_became_peered":"2024-05-04T02:20:15.300848+0000","last_unstale":"2024-05-04T02:20:18.546742+0000","last_undegraded":"2024-05-04T02:20:18.546742+0000","last_fullsized":"2024-05-04T02:20:18.546742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:26:17.650165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.963300+0000","last_change":"2024-05-04T02:20:15.302188+0000","last_active":"2024-05-04T02:20:17.963300+0000","last_peered":"2024-05-04T02:20:17.963300+0000","last_clean":"2024-05-04T02:20:17.963300+0000","last_became_active":"2024-05-04T02:20:15.301879+0000","last_became_peered":"2024-05-04T02:20:15.301879+0000","last_unstale":"2024-05-04T02:20:17.963300+0000","last_undegraded":"2024-05-04T02:20:17.963300+0000","last_fullsized":"2024-05-04T02:20:17.963300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:51:58.828664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546335+0000","last_change":"2024-05-04T02:20:15.305583+0000","last_active":"2024-05-04T02:20:18.546335+0000","last_peered":"2024-05-04T02:20:18.546335+0000","last_clean":"2024-05-04T02:20:18.546335+0000","last_became_active":"2024-05-04T02:20:15.302385+0000","last_became_peered":"2024-05-04T02:20:15.302385+0000","last_unstale":"2024-05-04T02:20:18.546335+0000","last_undegraded":"2024-05-04T02:20:18.546335+0000","last_fullsized":"2024-05-04T02:20:18.546335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:15:56.592451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.963538+0000","last_change":"2024-05-04T02:20:15.301659+0000","last_active":"2024-05-04T02:20:17.963538+0000","last_peered":"2024-05-04T02:20:17.963538+0000","last_clean":"2024-05-04T02:20:17.963538+0000","last_became_active":"2024-05-04T02:20:15.301363+0000","last_became_peered":"2024-05-04T02:20:15.301363+0000","last_unstale":"2024-05-04T02:20:17.963538+0000","last_undegraded":"2024-05-04T02:20:17.963538+0000","last_fullsized":"2024-05-04T02:20:17.963538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:23:25.157473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.976005+0000","last_change":"2024-05-04T02:20:15.295843+0000","last_active":"2024-05-04T02:20:17.976005+0000","last_peered":"2024-05-04T02:20:17.976005+0000","last_clean":"2024-05-04T02:20:17.976005+0000","last_became_active":"2024-05-04T02:20:15.295577+0000","last_became_peered":"2024-05-04T02:20:15.295577+0000","last_unstale":"2024-05-04T02:20:17.976005+0000","last_undegraded":"2024-05-04T02:20:17.976005+0000","last_fullsized":"2024-05-04T02:20:17.976005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:23:25.157473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.023622+0000","last_change":"2024-05-04T02:20:15.299661+0000","last_active":"2024-05-04T02:20:18.023622+0000","last_peered":"2024-05-04T02:20:18.023622+0000","last_clean":"2024-05-04T02:20:18.023622+0000","last_became_active":"2024-05-04T02:20:15.299230+0000","last_became_peered":"2024-05-04T02:20:15.299230+0000","last_unstale":"2024-05-04T02:20:18.023622+0000","last_undegraded":"2024-05-04T02:20:18.023622+0000","last_fullsized":"2024-05-04T02:20:18.023622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:51:58.828664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.963907+0000","last_change":"2024-05-04T02:20:15.302719+0000","last_active":"2024-05-04T02:20:17.963907+0000","last_peered":"2024-05-04T02:20:17.963907+0000","last_clean":"2024-05-04T02:20:17.963907+0000","last_became_active":"2024-05-04T02:20:15.302456+0000","last_became_peered":"2024-05-04T02:20:15.302456+0000","last_unstale":"2024-05-04T02:20:17.963907+0000","last_undegraded":"2024-05-04T02:20:17.963907+0000","last_fullsized":"2024-05-04T02:20:17.963907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:06:48.185771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546634+0000","last_change":"2024-05-04T02:20:15.296567+0000","last_active":"2024-05-04T02:20:18.546634+0000","last_peered":"2024-05-04T02:20:18.546634+0000","last_clean":"2024-05-04T02:20:18.546634+0000","last_became_active":"2024-05-04T02:20:15.296235+0000","last_became_peered":"2024-05-04T02:20:15.296235+0000","last_unstale":"2024-05-04T02:20:18.546634+0000","last_undegraded":"2024-05-04T02:20:18.546634+0000","last_fullsized":"2024-05-04T02:20:18.546634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:32:20.652776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546840+0000","last_change":"2024-05-04T02:20:15.302190+0000","last_active":"2024-05-04T02:20:18.546840+0000","last_peered":"2024-05-04T02:20:18.546840+0000","last_clean":"2024-05-04T02:20:18.546840+0000","last_became_active":"2024-05-04T02:20:15.301184+0000","last_became_peered":"2024-05-04T02:20:15.301184+0000","last_unstale":"2024-05-04T02:20:18.546840+0000","last_undegraded":"2024-05-04T02:20:18.546840+0000","last_fullsized":"2024-05-04T02:20:18.546840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:52:52.278453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546581+0000","last_change":"2024-05-04T02:20:15.301739+0000","last_active":"2024-05-04T02:20:18.546581+0000","last_peered":"2024-05-04T02:20:18.546581+0000","last_clean":"2024-05-04T02:20:18.546581+0000","last_became_active":"2024-05-04T02:20:15.301424+0000","last_became_peered":"2024-05-04T02:20:15.301424+0000","last_unstale":"2024-05-04T02:20:18.546581+0000","last_undegraded":"2024-05-04T02:20:18.546581+0000","last_fullsized":"2024-05-04T02:20:18.546581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:40:19.927293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.975804+0000","last_change":"2024-05-04T02:20:15.293189+0000","last_active":"2024-05-04T02:20:17.975804+0000","last_peered":"2024-05-04T02:20:17.975804+0000","last_clean":"2024-05-04T02:20:17.975804+0000","last_became_active":"2024-05-04T02:20:15.292840+0000","last_became_peered":"2024-05-04T02:20:15.292840+0000","last_unstale":"2024-05-04T02:20:17.975804+0000","last_undegraded":"2024-05-04T02:20:17.975804+0000","last_fullsized":"2024-05-04T02:20:17.975804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:01:57.617230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.964296+0000","last_change":"2024-05-04T02:20:15.297718+0000","last_active":"2024-05-04T02:20:17.964296+0000","last_peered":"2024-05-04T02:20:17.964296+0000","last_clean":"2024-05-04T02:20:17.964296+0000","last_became_active":"2024-05-04T02:20:15.297415+0000","last_became_peered":"2024-05-04T02:20:15.297415+0000","last_unstale":"2024-05-04T02:20:17.964296+0000","last_undegraded":"2024-05-04T02:20:17.964296+0000","last_fullsized":"2024-05-04T02:20:17.964296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:03:46.054307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.963488+0000","last_change":"2024-05-04T02:20:14.290469+0000","last_active":"2024-05-04T02:20:17.963488+0000","last_peered":"2024-05-04T02:20:17.963488+0000","last_clean":"2024-05-04T02:20:17.963488+0000","last_became_active":"2024-05-04T02:20:14.289651+0000","last_became_peered":"2024-05-04T02:20:14.289651+0000","last_unstale":"2024-05-04T02:20:17.963488+0000","last_undegraded":"2024-05-04T02:20:17.963488+0000","last_fullsized":"2024-05-04T02:20:17.963488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:57:10.542857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546730+0000","last_change":"2024-05-04T02:20:15.305933+0000","last_active":"2024-05-04T02:20:18.546730+0000","last_peered":"2024-05-04T02:20:18.546730+0000","last_clean":"2024-05-04T02:20:18.546730+0000","last_became_active":"2024-05-04T02:20:15.305597+0000","last_became_peered":"2024-05-04T02:20:15.305597+0000","last_unstale":"2024-05-04T02:20:18.546730+0000","last_undegraded":"2024-05-04T02:20:18.546730+0000","last_fullsized":"2024-05-04T02:20:18.546730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:50:29.983685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.975696+0000","last_change":"2024-05-04T02:20:14.359094+0000","last_active":"2024-05-04T02:20:17.975696+0000","last_peered":"2024-05-04T02:20:17.975696+0000","last_clean":"2024-05-04T02:20:17.975696+0000","last_became_active":"2024-05-04T02:20:14.358394+0000","last_became_peered":"2024-05-04T02:20:14.358394+0000","last_unstale":"2024-05-04T02:20:17.975696+0000","last_undegraded":"2024-05-04T02:20:17.975696+0000","last_fullsized":"2024-05-04T02:20:17.975696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:57:26.889464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.963182+0000","last_change":"2024-05-04T02:20:14.356259+0000","last_active":"2024-05-04T02:20:17.963182+0000","last_peered":"2024-05-04T02:20:17.963182+0000","last_clean":"2024-05-04T02:20:17.963182+0000","last_became_active":"2024-05-04T02:20:14.355988+0000","last_became_peered":"2024-05-04T02:20:14.355988+0000","last_unstale":"2024-05-04T02:20:17.963182+0000","last_undegraded":"2024-05-04T02:20:17.963182+0000","last_fullsized":"2024-05-04T02:20:17.963182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:40:36.439339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.963128+0000","last_change":"2024-05-04T02:20:15.295517+0000","last_active":"2024-05-04T02:20:17.963128+0000","last_peered":"2024-05-04T02:20:17.963128+0000","last_clean":"2024-05-04T02:20:17.963128+0000","last_became_active":"2024-05-04T02:20:15.295222+0000","last_became_peered":"2024-05-04T02:20:15.295222+0000","last_unstale":"2024-05-04T02:20:17.963128+0000","last_undegraded":"2024-05-04T02:20:17.963128+0000","last_fullsized":"2024-05-04T02:20:17.963128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:58:55.400048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546388+0000","last_change":"2024-05-04T02:20:14.291543+0000","last_active":"2024-05-04T02:20:18.546388+0000","last_peered":"2024-05-04T02:20:18.546388+0000","last_clean":"2024-05-04T02:20:18.546388+0000","last_became_active":"2024-05-04T02:20:14.290893+0000","last_became_peered":"2024-05-04T02:20:14.290893+0000","last_unstale":"2024-05-04T02:20:18.546388+0000","last_undegraded":"2024-05-04T02:20:18.546388+0000","last_fullsized":"2024-05-04T02:20:18.546388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:57:10.542857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.023655+0000","last_change":"2024-05-04T02:20:15.291991+0000","last_active":"2024-05-04T02:20:18.023655+0000","last_peered":"2024-05-04T02:20:18.023655+0000","last_clean":"2024-05-04T02:20:18.023655+0000","last_became_active":"2024-05-04T02:20:15.291704+0000","last_became_peered":"2024-05-04T02:20:15.291704+0000","last_unstale":"2024-05-04T02:20:18.023655+0000","last_undegraded":"2024-05-04T02:20:18.023655+0000","last_fullsized":"2024-05-04T02:20:18.023655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:52:22.299082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.976029+0000","last_change":"2024-05-04T02:20:14.359336+0000","last_active":"2024-05-04T02:20:17.976029+0000","last_peered":"2024-05-04T02:20:17.976029+0000","last_clean":"2024-05-04T02:20:17.976029+0000","last_became_active":"2024-05-04T02:20:14.357940+0000","last_became_peered":"2024-05-04T02:20:14.357940+0000","last_unstale":"2024-05-04T02:20:17.976029+0000","last_undegraded":"2024-05-04T02:20:17.976029+0000","last_fullsized":"2024-05-04T02:20:17.976029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:48:24.055870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546559+0000","last_change":"2024-05-04T02:20:15.301852+0000","last_active":"2024-05-04T02:20:18.546559+0000","last_peered":"2024-05-04T02:20:18.546559+0000","last_clean":"2024-05-04T02:20:18.546559+0000","last_became_active":"2024-05-04T02:20:15.300374+0000","last_became_peered":"2024-05-04T02:20:15.300374+0000","last_unstale":"2024-05-04T02:20:18.546559+0000","last_undegraded":"2024-05-04T02:20:18.546559+0000","last_fullsized":"2024-05-04T02:20:18.546559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:16:20.585860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546660+0000","last_change":"2024-05-04T02:20:14.358952+0000","last_active":"2024-05-04T02:20:18.546660+0000","last_peered":"2024-05-04T02:20:18.546660+0000","last_clean":"2024-05-04T02:20:18.546660+0000","last_became_active":"2024-05-04T02:20:14.358625+0000","last_became_peered":"2024-05-04T02:20:14.358625+0000","last_unstale":"2024-05-04T02:20:18.546660+0000","last_undegraded":"2024-05-04T02:20:18.546660+0000","last_fullsized":"2024-05-04T02:20:18.546660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:52:21.185127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.547067+0000","last_change":"2024-05-04T02:20:15.307242+0000","last_active":"2024-05-04T02:20:18.547067+0000","last_peered":"2024-05-04T02:20:18.547067+0000","last_clean":"2024-05-04T02:20:18.547067+0000","last_became_active":"2024-05-04T02:20:15.306572+0000","last_became_peered":"2024-05-04T02:20:15.306572+0000","last_unstale":"2024-05-04T02:20:18.547067+0000","last_undegraded":"2024-05-04T02:20:18.547067+0000","last_fullsized":"2024-05-04T02:20:18.547067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:31:36.578679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.023779+0000","last_change":"2024-05-04T02:20:14.292979+0000","last_active":"2024-05-04T02:20:18.023779+0000","last_peered":"2024-05-04T02:20:18.023779+0000","last_clean":"2024-05-04T02:20:18.023779+0000","last_became_active":"2024-05-04T02:20:14.292564+0000","last_became_peered":"2024-05-04T02:20:14.292564+0000","last_unstale":"2024-05-04T02:20:18.023779+0000","last_undegraded":"2024-05-04T02:20:18.023779+0000","last_fullsized":"2024-05-04T02:20:18.023779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:34:37.703735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.964726+0000","last_change":"2024-05-04T02:20:15.298392+0000","last_active":"2024-05-04T02:20:17.964726+0000","last_peered":"2024-05-04T02:20:17.964726+0000","last_clean":"2024-05-04T02:20:17.964726+0000","last_became_active":"2024-05-04T02:20:15.298018+0000","last_became_peered":"2024-05-04T02:20:15.298018+0000","last_unstale":"2024-05-04T02:20:17.964726+0000","last_undegraded":"2024-05-04T02:20:17.964726+0000","last_fullsized":"2024-05-04T02:20:17.964726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:42:57.398678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.975964+0000","last_change":"2024-05-04T02:20:14.360237+0000","last_active":"2024-05-04T02:20:17.975964+0000","last_peered":"2024-05-04T02:20:17.975964+0000","last_clean":"2024-05-04T02:20:17.975964+0000","last_became_active":"2024-05-04T02:20:14.359886+0000","last_became_peered":"2024-05-04T02:20:14.359886+0000","last_unstale":"2024-05-04T02:20:17.975964+0000","last_undegraded":"2024-05-04T02:20:17.975964+0000","last_fullsized":"2024-05-04T02:20:17.975964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:34:37.703735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.547226+0000","last_change":"2024-05-04T02:20:15.299908+0000","last_active":"2024-05-04T02:20:18.547226+0000","last_peered":"2024-05-04T02:20:18.547226+0000","last_clean":"2024-05-04T02:20:18.547226+0000","last_became_active":"2024-05-04T02:20:15.299336+0000","last_became_peered":"2024-05-04T02:20:15.299336+0000","last_unstale":"2024-05-04T02:20:18.547226+0000","last_undegraded":"2024-05-04T02:20:18.547226+0000","last_fullsized":"2024-05-04T02:20:18.547226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:36:19.111702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546789+0000","last_change":"2024-05-04T02:20:14.274932+0000","last_active":"2024-05-04T02:20:18.546789+0000","last_peered":"2024-05-04T02:20:18.546789+0000","last_clean":"2024-05-04T02:20:18.546789+0000","last_became_active":"2024-05-04T02:20:14.274604+0000","last_became_peered":"2024-05-04T02:20:14.274604+0000","last_unstale":"2024-05-04T02:20:18.546789+0000","last_undegraded":"2024-05-04T02:20:18.546789+0000","last_fullsized":"2024-05-04T02:20:18.546789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:35:43.182599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546447+0000","last_change":"2024-05-04T02:20:15.300355+0000","last_active":"2024-05-04T02:20:18.546447+0000","last_peered":"2024-05-04T02:20:18.546447+0000","last_clean":"2024-05-04T02:20:18.546447+0000","last_became_active":"2024-05-04T02:20:15.300052+0000","last_became_peered":"2024-05-04T02:20:15.300052+0000","last_unstale":"2024-05-04T02:20:18.546447+0000","last_undegraded":"2024-05-04T02:20:18.546447+0000","last_fullsized":"2024-05-04T02:20:18.546447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:06:27.072275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546935+0000","last_change":"2024-05-04T02:20:14.290125+0000","last_active":"2024-05-04T02:20:18.546935+0000","last_peered":"2024-05-04T02:20:18.546935+0000","last_clean":"2024-05-04T02:20:18.546935+0000","last_became_active":"2024-05-04T02:20:14.289826+0000","last_became_peered":"2024-05-04T02:20:14.289826+0000","last_unstale":"2024-05-04T02:20:18.546935+0000","last_undegraded":"2024-05-04T02:20:18.546935+0000","last_fullsized":"2024-05-04T02:20:18.546935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:39:23.112031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.547089+0000","last_change":"2024-05-04T02:20:15.303257+0000","last_active":"2024-05-04T02:20:18.547089+0000","last_peered":"2024-05-04T02:20:18.547089+0000","last_clean":"2024-05-04T02:20:18.547089+0000","last_became_active":"2024-05-04T02:20:15.302963+0000","last_became_peered":"2024-05-04T02:20:15.302963+0000","last_unstale":"2024-05-04T02:20:18.547089+0000","last_undegraded":"2024-05-04T02:20:18.547089+0000","last_fullsized":"2024-05-04T02:20:18.547089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:05:46.729556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.975686+0000","last_change":"2024-05-04T02:20:14.359226+0000","last_active":"2024-05-04T02:20:17.975686+0000","last_peered":"2024-05-04T02:20:17.975686+0000","last_clean":"2024-05-04T02:20:17.975686+0000","last_became_active":"2024-05-04T02:20:14.358494+0000","last_became_peered":"2024-05-04T02:20:14.358494+0000","last_unstale":"2024-05-04T02:20:17.975686+0000","last_undegraded":"2024-05-04T02:20:17.975686+0000","last_fullsized":"2024-05-04T02:20:17.975686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:43:19.283728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.975673+0000","last_change":"2024-05-04T02:20:15.294689+0000","last_active":"2024-05-04T02:20:17.975673+0000","last_peered":"2024-05-04T02:20:17.975673+0000","last_clean":"2024-05-04T02:20:17.975673+0000","last_became_active":"2024-05-04T02:20:15.294400+0000","last_became_peered":"2024-05-04T02:20:15.294400+0000","last_unstale":"2024-05-04T02:20:17.975673+0000","last_undegraded":"2024-05-04T02:20:17.975673+0000","last_fullsized":"2024-05-04T02:20:17.975673+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:22:33.019301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546431+0000","last_change":"2024-05-04T02:20:14.269539+0000","last_active":"2024-05-04T02:20:18.546431+0000","last_peered":"2024-05-04T02:20:18.546431+0000","last_clean":"2024-05-04T02:20:18.546431+0000","last_became_active":"2024-05-04T02:20:14.269238+0000","last_became_peered":"2024-05-04T02:20:14.269238+0000","last_unstale":"2024-05-04T02:20:18.546431+0000","last_undegraded":"2024-05-04T02:20:18.546431+0000","last_fullsized":"2024-05-04T02:20:18.546431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:19:48.082162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546599+0000","last_change":"2024-05-04T02:20:15.304355+0000","last_active":"2024-05-04T02:20:18.546599+0000","last_peered":"2024-05-04T02:20:18.546599+0000","last_clean":"2024-05-04T02:20:18.546599+0000","last_became_active":"2024-05-04T02:20:15.302736+0000","last_became_peered":"2024-05-04T02:20:15.302736+0000","last_unstale":"2024-05-04T02:20:18.546599+0000","last_undegraded":"2024-05-04T02:20:18.546599+0000","last_fullsized":"2024-05-04T02:20:18.546599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:35:15.732585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.964800+0000","last_change":"2024-05-04T02:20:14.272218+0000","last_active":"2024-05-04T02:20:17.964800+0000","last_peered":"2024-05-04T02:20:17.964800+0000","last_clean":"2024-05-04T02:20:17.964800+0000","last_became_active":"2024-05-04T02:20:14.271883+0000","last_became_peered":"2024-05-04T02:20:14.271883+0000","last_unstale":"2024-05-04T02:20:17.964800+0000","last_undegraded":"2024-05-04T02:20:17.964800+0000","last_fullsized":"2024-05-04T02:20:17.964800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:32:55.463882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.547349+0000","last_change":"2024-05-04T02:20:15.302202+0000","last_active":"2024-05-04T02:20:18.547349+0000","last_peered":"2024-05-04T02:20:18.547349+0000","last_clean":"2024-05-04T02:20:18.547349+0000","last_became_active":"2024-05-04T02:20:15.301880+0000","last_became_peered":"2024-05-04T02:20:15.301880+0000","last_unstale":"2024-05-04T02:20:18.547349+0000","last_undegraded":"2024-05-04T02:20:18.547349+0000","last_fullsized":"2024-05-04T02:20:18.547349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:32:43.559282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546821+0000","last_change":"2024-05-04T02:20:14.292107+0000","last_active":"2024-05-04T02:20:18.546821+0000","last_peered":"2024-05-04T02:20:18.546821+0000","last_clean":"2024-05-04T02:20:18.546821+0000","last_became_active":"2024-05-04T02:20:14.290132+0000","last_became_peered":"2024-05-04T02:20:14.290132+0000","last_unstale":"2024-05-04T02:20:18.546821+0000","last_undegraded":"2024-05-04T02:20:18.546821+0000","last_fullsized":"2024-05-04T02:20:18.546821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:40:35.516308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.547411+0000","last_change":"2024-05-04T02:20:15.302140+0000","last_active":"2024-05-04T02:20:18.547411+0000","last_peered":"2024-05-04T02:20:18.547411+0000","last_clean":"2024-05-04T02:20:18.547411+0000","last_became_active":"2024-05-04T02:20:15.301798+0000","last_became_peered":"2024-05-04T02:20:15.301798+0000","last_unstale":"2024-05-04T02:20:18.547411+0000","last_undegraded":"2024-05-04T02:20:18.547411+0000","last_fullsized":"2024-05-04T02:20:18.547411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:20:28.069809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.023816+0000","last_change":"2024-05-04T02:20:14.274965+0000","last_active":"2024-05-04T02:20:18.023816+0000","last_peered":"2024-05-04T02:20:18.023816+0000","last_clean":"2024-05-04T02:20:18.023816+0000","last_became_active":"2024-05-04T02:20:14.274609+0000","last_became_peered":"2024-05-04T02:20:14.274609+0000","last_unstale":"2024-05-04T02:20:18.023816+0000","last_undegraded":"2024-05-04T02:20:18.023816+0000","last_fullsized":"2024-05-04T02:20:18.023816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:43:19.283728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546618+0000","last_change":"2024-05-04T02:20:15.305486+0000","last_active":"2024-05-04T02:20:18.546618+0000","last_peered":"2024-05-04T02:20:18.546618+0000","last_clean":"2024-05-04T02:20:18.546618+0000","last_became_active":"2024-05-04T02:20:15.301880+0000","last_became_peered":"2024-05-04T02:20:15.301880+0000","last_unstale":"2024-05-04T02:20:18.546618+0000","last_undegraded":"2024-05-04T02:20:18.546618+0000","last_fullsized":"2024-05-04T02:20:18.546618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:13:25.600467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546688+0000","last_change":"2024-05-04T02:20:14.288834+0000","last_active":"2024-05-04T02:20:18.546688+0000","last_peered":"2024-05-04T02:20:18.546688+0000","last_clean":"2024-05-04T02:20:18.546688+0000","last_became_active":"2024-05-04T02:20:14.287992+0000","last_became_peered":"2024-05-04T02:20:14.287992+0000","last_unstale":"2024-05-04T02:20:18.546688+0000","last_undegraded":"2024-05-04T02:20:18.546688+0000","last_fullsized":"2024-05-04T02:20:18.546688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:39:08.143762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.547284+0000","last_change":"2024-05-04T02:20:15.303880+0000","last_active":"2024-05-04T02:20:18.547284+0000","last_peered":"2024-05-04T02:20:18.547284+0000","last_clean":"2024-05-04T02:20:18.547284+0000","last_became_active":"2024-05-04T02:20:15.303601+0000","last_became_peered":"2024-05-04T02:20:15.303601+0000","last_unstale":"2024-05-04T02:20:18.547284+0000","last_undegraded":"2024-05-04T02:20:18.547284+0000","last_fullsized":"2024-05-04T02:20:18.547284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:26:17.650165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":114,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546844+0000","last_change":"2024-05-04T02:20:02.920020+0000","last_active":"2024-05-04T02:20:18.546844+0000","last_peered":"2024-05-04T02:20:18.546844+0000","last_clean":"2024-05-04T02:20:18.546844+0000","last_became_active":"2024-05-04T02:20:02.918859+0000","last_became_peered":"2024-05-04T02:20:02.918859+0000","last_unstale":"2024-05-04T02:20:18.546844+0000","last_undegraded":"2024-05-04T02:20:18.546844+0000","last_fullsized":"2024-05-04T02:20:18.546844+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:00.162760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:00.162760+0000","last_clean_scrub_stamp":"2024-05-04T02:20:00.162760+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:25:04.934922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546389+0000","last_change":"2024-05-04T02:20:14.290136+0000","last_active":"2024-05-04T02:20:18.546389+0000","last_peered":"2024-05-04T02:20:18.546389+0000","last_clean":"2024-05-04T02:20:18.546389+0000","last_became_active":"2024-05-04T02:20:14.289597+0000","last_became_peered":"2024-05-04T02:20:14.289597+0000","last_unstale":"2024-05-04T02:20:18.546389+0000","last_undegraded":"2024-05-04T02:20:18.546389+0000","last_fullsized":"2024-05-04T02:20:18.546389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:43:19.283728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.963442+0000","last_change":"2024-05-04T02:20:15.306971+0000","last_active":"2024-05-04T02:20:17.963442+0000","last_peered":"2024-05-04T02:20:17.963442+0000","last_clean":"2024-05-04T02:20:17.963442+0000","last_became_active":"2024-05-04T02:20:15.306640+0000","last_became_peered":"2024-05-04T02:20:15.306640+0000","last_unstale":"2024-05-04T02:20:17.963442+0000","last_undegraded":"2024-05-04T02:20:17.963442+0000","last_fullsized":"2024-05-04T02:20:17.963442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:22:04.903746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546739+0000","last_change":"2024-05-04T02:20:14.291379+0000","last_active":"2024-05-04T02:20:18.546739+0000","last_peered":"2024-05-04T02:20:18.546739+0000","last_clean":"2024-05-04T02:20:18.546739+0000","last_became_active":"2024-05-04T02:20:14.291044+0000","last_became_peered":"2024-05-04T02:20:14.291044+0000","last_unstale":"2024-05-04T02:20:18.546739+0000","last_undegraded":"2024-05-04T02:20:18.546739+0000","last_fullsized":"2024-05-04T02:20:18.546739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:58:54.286093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546344+0000","last_change":"2024-05-04T02:20:15.305870+0000","last_active":"2024-05-04T02:20:18.546344+0000","last_peered":"2024-05-04T02:20:18.546344+0000","last_clean":"2024-05-04T02:20:18.546344+0000","last_became_active":"2024-05-04T02:20:15.305512+0000","last_became_peered":"2024-05-04T02:20:15.305512+0000","last_unstale":"2024-05-04T02:20:18.546344+0000","last_undegraded":"2024-05-04T02:20:18.546344+0000","last_fullsized":"2024-05-04T02:20:18.546344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:11:17.529449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546641+0000","last_change":"2024-05-04T02:20:14.287676+0000","last_active":"2024-05-04T02:20:18.546641+0000","last_peered":"2024-05-04T02:20:18.546641+0000","last_clean":"2024-05-04T02:20:18.546641+0000","last_became_active":"2024-05-04T02:20:14.287335+0000","last_became_peered":"2024-05-04T02:20:14.287335+0000","last_unstale":"2024-05-04T02:20:18.546641+0000","last_undegraded":"2024-05-04T02:20:18.546641+0000","last_fullsized":"2024-05-04T02:20:18.546641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:54:20.482900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.023390+0000","last_change":"2024-05-04T02:20:15.297316+0000","last_active":"2024-05-04T02:20:18.023390+0000","last_peered":"2024-05-04T02:20:18.023390+0000","last_clean":"2024-05-04T02:20:18.023390+0000","last_became_active":"2024-05-04T02:20:15.297010+0000","last_became_peered":"2024-05-04T02:20:15.297010+0000","last_unstale":"2024-05-04T02:20:18.023390+0000","last_undegraded":"2024-05-04T02:20:18.023390+0000","last_fullsized":"2024-05-04T02:20:18.023390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:22:33.019301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.547029+0000","last_change":"2024-05-04T02:20:14.292802+0000","last_active":"2024-05-04T02:20:18.547029+0000","last_peered":"2024-05-04T02:20:18.547029+0000","last_clean":"2024-05-04T02:20:18.547029+0000","last_became_active":"2024-05-04T02:20:14.292595+0000","last_became_peered":"2024-05-04T02:20:14.292595+0000","last_unstale":"2024-05-04T02:20:18.547029+0000","last_undegraded":"2024-05-04T02:20:18.547029+0000","last_fullsized":"2024-05-04T02:20:18.547029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:31:25.521717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.964423+0000","last_change":"2024-05-04T02:20:15.296358+0000","last_active":"2024-05-04T02:20:17.964423+0000","last_peered":"2024-05-04T02:20:17.964423+0000","last_clean":"2024-05-04T02:20:17.964423+0000","last_became_active":"2024-05-04T02:20:15.296075+0000","last_became_peered":"2024-05-04T02:20:15.296075+0000","last_unstale":"2024-05-04T02:20:17.964423+0000","last_undegraded":"2024-05-04T02:20:17.964423+0000","last_fullsized":"2024-05-04T02:20:17.964423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:30:50.014584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.023655+0000","last_change":"2024-05-04T02:20:14.253846+0000","last_active":"2024-05-04T02:20:18.023655+0000","last_peered":"2024-05-04T02:20:18.023655+0000","last_clean":"2024-05-04T02:20:18.023655+0000","last_became_active":"2024-05-04T02:20:14.253513+0000","last_became_peered":"2024-05-04T02:20:14.253513+0000","last_unstale":"2024-05-04T02:20:18.023655+0000","last_undegraded":"2024-05-04T02:20:18.023655+0000","last_fullsized":"2024-05-04T02:20:18.023655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:40:36.439339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546859+0000","last_change":"2024-05-04T02:20:15.300702+0000","last_active":"2024-05-04T02:20:18.546859+0000","last_peered":"2024-05-04T02:20:18.546859+0000","last_clean":"2024-05-04T02:20:18.546859+0000","last_became_active":"2024-05-04T02:20:15.300251+0000","last_became_peered":"2024-05-04T02:20:15.300251+0000","last_unstale":"2024-05-04T02:20:18.546859+0000","last_undegraded":"2024-05-04T02:20:18.546859+0000","last_fullsized":"2024-05-04T02:20:18.546859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:05:46.729556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.547456+0000","last_change":"2024-05-04T02:20:14.291304+0000","last_active":"2024-05-04T02:20:18.547456+0000","last_peered":"2024-05-04T02:20:18.547456+0000","last_clean":"2024-05-04T02:20:18.547456+0000","last_became_active":"2024-05-04T02:20:14.290952+0000","last_became_peered":"2024-05-04T02:20:14.290952+0000","last_unstale":"2024-05-04T02:20:18.547456+0000","last_undegraded":"2024-05-04T02:20:18.547456+0000","last_fullsized":"2024-05-04T02:20:18.547456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:15:55.478496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.023562+0000","last_change":"2024-05-04T02:20:15.296895+0000","last_active":"2024-05-04T02:20:18.023562+0000","last_peered":"2024-05-04T02:20:18.023562+0000","last_clean":"2024-05-04T02:20:18.023562+0000","last_became_active":"2024-05-04T02:20:15.296562+0000","last_became_peered":"2024-05-04T02:20:15.296562+0000","last_unstale":"2024-05-04T02:20:18.023562+0000","last_undegraded":"2024-05-04T02:20:18.023562+0000","last_fullsized":"2024-05-04T02:20:18.023562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:22:04.903746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.024002+0000","last_change":"2024-05-04T02:20:14.358920+0000","last_active":"2024-05-04T02:20:18.024002+0000","last_peered":"2024-05-04T02:20:18.024002+0000","last_clean":"2024-05-04T02:20:18.024002+0000","last_became_active":"2024-05-04T02:20:14.358621+0000","last_became_peered":"2024-05-04T02:20:14.358621+0000","last_unstale":"2024-05-04T02:20:18.024002+0000","last_undegraded":"2024-05-04T02:20:18.024002+0000","last_fullsized":"2024-05-04T02:20:18.024002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:57:10.542857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.963661+0000","last_change":"2024-05-04T02:20:15.299992+0000","last_active":"2024-05-04T02:20:17.963661+0000","last_peered":"2024-05-04T02:20:17.963661+0000","last_clean":"2024-05-04T02:20:17.963661+0000","last_became_active":"2024-05-04T02:20:15.299678+0000","last_became_peered":"2024-05-04T02:20:15.299678+0000","last_unstale":"2024-05-04T02:20:17.963661+0000","last_undegraded":"2024-05-04T02:20:17.963661+0000","last_fullsized":"2024-05-04T02:20:17.963661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:39:43.029499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.976082+0000","last_change":"2024-05-04T02:20:14.359479+0000","last_active":"2024-05-04T02:20:17.976082+0000","last_peered":"2024-05-04T02:20:17.976082+0000","last_clean":"2024-05-04T02:20:17.976082+0000","last_became_active":"2024-05-04T02:20:14.358524+0000","last_became_peered":"2024-05-04T02:20:14.358524+0000","last_unstale":"2024-05-04T02:20:17.976082+0000","last_undegraded":"2024-05-04T02:20:17.976082+0000","last_fullsized":"2024-05-04T02:20:17.976082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:40:36.439339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.547004+0000","last_change":"2024-05-04T02:20:15.293908+0000","last_active":"2024-05-04T02:20:18.547004+0000","last_peered":"2024-05-04T02:20:18.547004+0000","last_clean":"2024-05-04T02:20:18.547004+0000","last_became_active":"2024-05-04T02:20:15.293602+0000","last_became_peered":"2024-05-04T02:20:15.293602+0000","last_unstale":"2024-05-04T02:20:18.547004+0000","last_undegraded":"2024-05-04T02:20:18.547004+0000","last_fullsized":"2024-05-04T02:20:18.547004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:18:03.065030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546622+0000","last_change":"2024-05-04T02:20:14.291515+0000","last_active":"2024-05-04T02:20:18.546622+0000","last_peered":"2024-05-04T02:20:18.546622+0000","last_clean":"2024-05-04T02:20:18.546622+0000","last_became_active":"2024-05-04T02:20:14.291068+0000","last_became_peered":"2024-05-04T02:20:14.291068+0000","last_unstale":"2024-05-04T02:20:18.546622+0000","last_undegraded":"2024-05-04T02:20:18.546622+0000","last_fullsized":"2024-05-04T02:20:18.546622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:57:10.542857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.964360+0000","last_change":"2024-05-04T02:20:15.247885+0000","last_active":"2024-05-04T02:20:17.964360+0000","last_peered":"2024-05-04T02:20:17.964360+0000","last_clean":"2024-05-04T02:20:17.964360+0000","last_became_active":"2024-05-04T02:20:15.247583+0000","last_became_peered":"2024-05-04T02:20:15.247583+0000","last_unstale":"2024-05-04T02:20:17.964360+0000","last_undegraded":"2024-05-04T02:20:17.964360+0000","last_fullsized":"2024-05-04T02:20:17.964360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:39:16.967443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.023555+0000","last_change":"2024-05-04T02:20:14.289690+0000","last_active":"2024-05-04T02:20:18.023555+0000","last_peered":"2024-05-04T02:20:18.023555+0000","last_clean":"2024-05-04T02:20:18.023555+0000","last_became_active":"2024-05-04T02:20:14.289360+0000","last_became_peered":"2024-05-04T02:20:14.289360+0000","last_unstale":"2024-05-04T02:20:18.023555+0000","last_undegraded":"2024-05-04T02:20:18.023555+0000","last_fullsized":"2024-05-04T02:20:18.023555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:57:26.889464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.963256+0000","last_change":"2024-05-04T02:20:15.296623+0000","last_active":"2024-05-04T02:20:17.963256+0000","last_peered":"2024-05-04T02:20:17.963256+0000","last_clean":"2024-05-04T02:20:17.963256+0000","last_became_active":"2024-05-04T02:20:15.296330+0000","last_became_peered":"2024-05-04T02:20:15.296330+0000","last_unstale":"2024-05-04T02:20:17.963256+0000","last_undegraded":"2024-05-04T02:20:17.963256+0000","last_fullsized":"2024-05-04T02:20:17.963256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:39:18.114604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.023764+0000","last_change":"2024-05-04T02:20:14.289113+0000","last_active":"2024-05-04T02:20:18.023764+0000","last_peered":"2024-05-04T02:20:18.023764+0000","last_clean":"2024-05-04T02:20:18.023764+0000","last_became_active":"2024-05-04T02:20:14.288769+0000","last_became_peered":"2024-05-04T02:20:14.288769+0000","last_unstale":"2024-05-04T02:20:18.023764+0000","last_undegraded":"2024-05-04T02:20:18.023764+0000","last_fullsized":"2024-05-04T02:20:18.023764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:48:24.055870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.963379+0000","last_change":"2024-05-04T02:20:15.295428+0000","last_active":"2024-05-04T02:20:17.963379+0000","last_peered":"2024-05-04T02:20:17.963379+0000","last_clean":"2024-05-04T02:20:17.963379+0000","last_became_active":"2024-05-04T02:20:15.295128+0000","last_became_peered":"2024-05-04T02:20:15.295128+0000","last_unstale":"2024-05-04T02:20:17.963379+0000","last_undegraded":"2024-05-04T02:20:17.963379+0000","last_fullsized":"2024-05-04T02:20:17.963379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:10:21.048301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.547224+0000","last_change":"2024-05-04T02:20:14.294321+0000","last_active":"2024-05-04T02:20:18.547224+0000","last_peered":"2024-05-04T02:20:18.547224+0000","last_clean":"2024-05-04T02:20:18.547224+0000","last_became_active":"2024-05-04T02:20:14.293862+0000","last_became_peered":"2024-05-04T02:20:14.293862+0000","last_unstale":"2024-05-04T02:20:18.547224+0000","last_undegraded":"2024-05-04T02:20:18.547224+0000","last_fullsized":"2024-05-04T02:20:18.547224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:39:17.000649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.975812+0000","last_change":"2024-05-04T02:20:15.296883+0000","last_active":"2024-05-04T02:20:17.975812+0000","last_peered":"2024-05-04T02:20:17.975812+0000","last_clean":"2024-05-04T02:20:17.975812+0000","last_became_active":"2024-05-04T02:20:15.296544+0000","last_became_peered":"2024-05-04T02:20:15.296544+0000","last_unstale":"2024-05-04T02:20:17.975812+0000","last_undegraded":"2024-05-04T02:20:17.975812+0000","last_fullsized":"2024-05-04T02:20:17.975812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:52:22.299082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546509+0000","last_change":"2024-05-04T02:20:15.306263+0000","last_active":"2024-05-04T02:20:18.546509+0000","last_peered":"2024-05-04T02:20:18.546509+0000","last_clean":"2024-05-04T02:20:18.546509+0000","last_became_active":"2024-05-04T02:20:15.305941+0000","last_became_peered":"2024-05-04T02:20:15.305941+0000","last_unstale":"2024-05-04T02:20:18.546509+0000","last_undegraded":"2024-05-04T02:20:18.546509+0000","last_fullsized":"2024-05-04T02:20:18.546509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:33:31.416768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.547164+0000","last_change":"2024-05-04T02:20:14.294204+0000","last_active":"2024-05-04T02:20:18.547164+0000","last_peered":"2024-05-04T02:20:18.547164+0000","last_clean":"2024-05-04T02:20:18.547164+0000","last_became_active":"2024-05-04T02:20:14.293788+0000","last_became_peered":"2024-05-04T02:20:14.293788+0000","last_unstale":"2024-05-04T02:20:18.547164+0000","last_undegraded":"2024-05-04T02:20:18.547164+0000","last_fullsized":"2024-05-04T02:20:18.547164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:52:21.185127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546530+0000","last_change":"2024-05-04T02:20:15.306357+0000","last_active":"2024-05-04T02:20:18.546530+0000","last_peered":"2024-05-04T02:20:18.546530+0000","last_clean":"2024-05-04T02:20:18.546530+0000","last_became_active":"2024-05-04T02:20:15.306050+0000","last_became_peered":"2024-05-04T02:20:15.306050+0000","last_unstale":"2024-05-04T02:20:18.546530+0000","last_undegraded":"2024-05-04T02:20:18.546530+0000","last_fullsized":"2024-05-04T02:20:18.546530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:39:18.114604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.547329+0000","last_change":"2024-05-04T02:20:14.357677+0000","last_active":"2024-05-04T02:20:18.547329+0000","last_peered":"2024-05-04T02:20:18.547329+0000","last_clean":"2024-05-04T02:20:18.547329+0000","last_became_active":"2024-05-04T02:20:14.357368+0000","last_became_peered":"2024-05-04T02:20:14.357368+0000","last_unstale":"2024-05-04T02:20:18.547329+0000","last_undegraded":"2024-05-04T02:20:18.547329+0000","last_fullsized":"2024-05-04T02:20:18.547329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:10:19.934346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546966+0000","last_change":"2024-05-04T02:20:15.307496+0000","last_active":"2024-05-04T02:20:18.546966+0000","last_peered":"2024-05-04T02:20:18.546966+0000","last_clean":"2024-05-04T02:20:18.546966+0000","last_became_active":"2024-05-04T02:20:15.306956+0000","last_became_peered":"2024-05-04T02:20:15.306956+0000","last_unstale":"2024-05-04T02:20:18.546966+0000","last_undegraded":"2024-05-04T02:20:18.546966+0000","last_fullsized":"2024-05-04T02:20:18.546966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:19:48.110866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.963458+0000","last_change":"2024-05-04T02:20:14.291632+0000","last_active":"2024-05-04T02:20:17.963458+0000","last_peered":"2024-05-04T02:20:17.963458+0000","last_clean":"2024-05-04T02:20:17.963458+0000","last_became_active":"2024-05-04T02:20:14.291331+0000","last_became_peered":"2024-05-04T02:20:14.291331+0000","last_unstale":"2024-05-04T02:20:17.963458+0000","last_undegraded":"2024-05-04T02:20:17.963458+0000","last_fullsized":"2024-05-04T02:20:17.963458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:22:31.905346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.963350+0000","last_change":"2024-05-04T02:20:15.294309+0000","last_active":"2024-05-04T02:20:17.963350+0000","last_peered":"2024-05-04T02:20:17.963350+0000","last_clean":"2024-05-04T02:20:17.963350+0000","last_became_active":"2024-05-04T02:20:15.294026+0000","last_became_peered":"2024-05-04T02:20:15.294026+0000","last_unstale":"2024-05-04T02:20:17.963350+0000","last_undegraded":"2024-05-04T02:20:17.963350+0000","last_fullsized":"2024-05-04T02:20:17.963350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:39:24.225985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.547102+0000","last_change":"2024-05-04T02:20:14.291633+0000","last_active":"2024-05-04T02:20:18.547102+0000","last_peered":"2024-05-04T02:20:18.547102+0000","last_clean":"2024-05-04T02:20:18.547102+0000","last_became_active":"2024-05-04T02:20:14.291313+0000","last_became_peered":"2024-05-04T02:20:14.291313+0000","last_unstale":"2024-05-04T02:20:18.547102+0000","last_undegraded":"2024-05-04T02:20:18.547102+0000","last_fullsized":"2024-05-04T02:20:18.547102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:48:36.710163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65100,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509451,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":303104,"data_stored":675478,"data_compressed":32550,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509451,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":245760,"data_stored":86140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509451,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":237568,"data_stored":84618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509451,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":245760,"data_stored":86140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509451,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":233472,"data_stored":84528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509450,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31420,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340420,"statfs":{"total":96636764160,"available":96604590080,"internally_reserved":0,"allocated":241664,"data_stored":84688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542155,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":245760,"data_stored":84654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31492,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340348,"statfs":{"total":96636764160,"available":96604516352,"internally_reserved":0,"allocated":311296,"data_stored":675534,"data_compressed":32550,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32550,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32550,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-04T02:20:33.347 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-04T02:20:33.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:33.494+0000 7f48caac8640 1 Processor -- start 2024-05-04T02:20:33.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:33.494+0000 7f48caac8640 1 -- start start 2024-05-04T02:20:33.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:33.496+0000 7f48caac8640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f48c40cdc20 0x7f48c406c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:33.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:33.496+0000 7f48caac8640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f48c4164df0 0x7f48c4167210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:33.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:33.496+0000 7f48caac8640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48c40c69e0 con 0x7f48c40c6f70 2024-05-04T02:20:33.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:33.496+0000 7f48caac8640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f48c4160a20 con 0x7f48c40cdc20 2024-05-04T02:20:33.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:33.496+0000 7f48caac8640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f48c4160740 con 0x7f48c4164df0 2024-05-04T02:20:33.499 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:33.496+0000 7f48c9065640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f48c4164df0 0x7f48c4167210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:33.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:33.497+0000 7f48c8864640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f48c40cdc20 0x7f48c406c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:33.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:33.497+0000 7f48c3fff640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f48c40c6f70 0x7f48c40ccea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:42042/0 (socket says 172.21.15.1:42042) 2024-05-04T02:20:33.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:33.497+0000 7f48c3fff640 1 -- 172.21.15.1:0/1739028857 learned_addr learned my addr 172.21.15.1:0/1739028857 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-05-04T02:20:33.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:33.500+0000 7f48c9065640 1 -- 172.21.15.1:0/1739028857 >> v2:172.21.15.1:3300/0 conn(0x7f48c40cdc20 msgr2=0x7f48c406c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:33.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:33.500+0000 7f48c9065640 1 --2- 172.21.15.1:0/1739028857 >> v2:172.21.15.1:3300/0 conn(0x7f48c40cdc20 0x7f48c406c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:33.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:33.500+0000 7f48c9065640 1 -- 172.21.15.1:0/1739028857 >> v1:172.21.15.1:6789/0 conn(0x7f48c40c6f70 legacy=0x7f48c40ccea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:33.502 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:33.500+0000 7f48c9065640 1 -- 172.21.15.1:0/1739028857 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48c40c77f0 con 0x7f48c4164df0 2024-05-04T02:20:33.504 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:33.502+0000 7f48c9065640 1 --2- 172.21.15.1:0/1739028857 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f48c4164df0 0x7f48c4167210 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f48c415d610 tx=0x7f48bc02a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8242ad5345f9e426 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:33.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:33.506+0000 7f48c37fe640 1 -- 172.21.15.1:0/1739028857 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48bc007740 con 0x7f48c4164df0 2024-05-04T02:20:33.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:33.506+0000 7f48c37fe640 1 -- 172.21.15.1:0/1739028857 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48bc0078e0 con 0x7f48c4164df0 2024-05-04T02:20:33.508 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:33.506+0000 7f48c37fe640 1 -- 172.21.15.1:0/1739028857 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48bc007cb0 con 0x7f48c4164df0 2024-05-04T02:20:33.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:33.507+0000 7f48caac8640 1 -- 172.21.15.1:0/1739028857 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f48c4164df0 msgr2=0x7f48c4167210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:33.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:33.507+0000 7f48caac8640 1 --2- 172.21.15.1:0/1739028857 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f48c4164df0 0x7f48c4167210 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f48c415d610 tx=0x7f48bc02a710 comp rx=0 tx=0).stop 2024-05-04T02:20:33.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:33.507+0000 7f48caac8640 1 -- 172.21.15.1:0/1739028857 shutdown_connections 2024-05-04T02:20:33.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:33.507+0000 7f48caac8640 1 --2- 172.21.15.1:0/1739028857 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f48c4164df0 0x7f48c4167210 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:33.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:33.507+0000 7f48caac8640 1 --2- 172.21.15.1:0/1739028857 >> v2:172.21.15.1:3300/0 conn(0x7f48c40cdc20 0x7f48c406c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:33.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:33.507+0000 7f48caac8640 1 -- 172.21.15.1:0/1739028857 >> 172.21.15.1:0/1739028857 conn(0x7f48c408e210 msgr2=0x7f48c40d1960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:33.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:33.507+0000 7f48caac8640 1 -- 172.21.15.1:0/1739028857 shutdown_connections 2024-05-04T02:20:33.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:33.507+0000 7f48caac8640 1 -- 172.21.15.1:0/1739028857 wait complete. 2024-05-04T02:20:33.514 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:33.509+0000 7f48caac8640 1 Processor -- start 2024-05-04T02:20:33.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:33.509+0000 7f48caac8640 1 -- start start 2024-05-04T02:20:33.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:33.510+0000 7f48caac8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f48c40c6f70 0x7f48c40b4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:33.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:33.510+0000 7f48caac8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f48c40cdc20 0x7f48c4157a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:33.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:33.510+0000 7f48caac8640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f48c4164df0 0x7f48c4159660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:33.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:33.510+0000 7f48caac8640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f48c40c8090 con 0x7f48c40c6f70 2024-05-04T02:20:33.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:33.510+0000 7f48caac8640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f48c40c7db0 con 0x7f48c40cdc20 2024-05-04T02:20:33.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:33.510+0000 7f48caac8640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f48c4160450 con 0x7f48c4164df0 2024-05-04T02:20:33.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:33.511+0000 7f48c8864640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f48c40c6f70 0x7f48c40b4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:33.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:33.511+0000 7f48c3fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f48c40cdc20 0x7f48c4157a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:33.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:33.511+0000 7f48c9065640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f48c4164df0 0x7f48c4159660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:33.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:33.511+0000 7f48c8864640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f48c40c6f70 0x7f48c40b4490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40898/0 (socket says 172.21.15.1:40898) 2024-05-04T02:20:33.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:33.511+0000 7f48c8864640 1 -- 172.21.15.1:0/2719387388 learned_addr learned my addr 172.21.15.1:0/2719387388 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:33.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:33.515+0000 7f48c8864640 1 -- 172.21.15.1:0/2719387388 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f48c4164df0 msgr2=0x7f48c4159660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:33.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:33.515+0000 7f48c8864640 1 --2- 172.21.15.1:0/2719387388 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f48c4164df0 0x7f48c4159660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:33.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:33.515+0000 7f48c8864640 1 -- 172.21.15.1:0/2719387388 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f48c40cdc20 msgr2=0x7f48c4157a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:33.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:33.515+0000 7f48c8864640 1 --2- 172.21.15.1:0/2719387388 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f48c40cdc20 0x7f48c4157a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:33.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:33.515+0000 7f48c8864640 1 -- 172.21.15.1:0/2719387388 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48c4157fd0 con 0x7f48c40c6f70 2024-05-04T02:20:33.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:33.518+0000 7f48c8864640 1 --2- 172.21.15.1:0/2719387388 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f48c40c6f70 0x7f48c40b4490 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f48b400e8a0 tx=0x7f48b400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:33.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:33.522+0000 7f48c17fa640 1 -- 172.21.15.1:0/2719387388 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b4017070 con 0x7f48c40c6f70 2024-05-04T02:20:33.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:33.522+0000 7f48c17fa640 1 -- 172.21.15.1:0/2719387388 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48b400c940 con 0x7f48c40c6f70 2024-05-04T02:20:33.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:33.522+0000 7f48caac8640 1 -- 172.21.15.1:0/2719387388 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48c4156d10 con 0x7f48c40c6f70 2024-05-04T02:20:33.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:33.522+0000 7f48c17fa640 1 -- 172.21.15.1:0/2719387388 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b400cd30 con 0x7f48c40c6f70 2024-05-04T02:20:33.524 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:33.522+0000 7f48caac8640 1 -- 172.21.15.1:0/2719387388 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48c4157290 con 0x7f48c40c6f70 2024-05-04T02:20:33.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:33.523+0000 7f48caac8640 1 -- 172.21.15.1:0/2719387388 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48c4069bc0 con 0x7f48c40c6f70 2024-05-04T02:20:33.550 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:33.548+0000 7f48c17fa640 1 -- 172.21.15.1:0/2719387388 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f48b401a070 con 0x7f48c40c6f70 2024-05-04T02:20:33.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:33.549+0000 7f48c17fa640 1 --2- 172.21.15.1:0/2719387388 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f48b0076320 0x7f48b0078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:33.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:33.549+0000 7f48c3fff640 1 --2- 172.21.15.1:0/2719387388 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f48b0076320 0x7f48b0078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:33.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:33.550+0000 7f48c3fff640 1 --2- 172.21.15.1:0/2719387388 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f48b0076320 0x7f48b0078830 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f48c406d780 tx=0x7f48b8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:33.555 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:33.553+0000 7f48c17fa640 1 -- 172.21.15.1:0/2719387388 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f48b405d1d0 con 0x7f48c40c6f70 2024-05-04T02:20:33.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:33.839+0000 7f48c17fa640 1 -- 172.21.15.1:0/2719387388 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f48b4060f40 con 0x7f48c40c6f70 2024-05-04T02:20:34.039 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.037+0000 7f48caac8640 1 -- 172.21.15.1:0/2719387388 --> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f48c40cda00 con 0x7f48b0076320 2024-05-04T02:20:34.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.044+0000 7f48c17fa640 1 -- 172.21.15.1:0/2719387388 <== mgr.4108 v2:172.21.15.107:6800/3809222574 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251902 (secure 0 0 0) 0x7f48c40cda00 con 0x7f48b0076320 2024-05-04T02:20:34.050 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:20:34.051 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-05-04T02:20:34.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.047+0000 7f48caac8640 1 -- 172.21.15.1:0/2719387388 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f48b0076320 msgr2=0x7f48b0078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:34.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.047+0000 7f48caac8640 1 --2- 172.21.15.1:0/2719387388 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f48b0076320 0x7f48b0078830 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f48c406d780 tx=0x7f48b8009040 comp rx=0 tx=0).stop 2024-05-04T02:20:34.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.047+0000 7f48caac8640 1 -- 172.21.15.1:0/2719387388 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f48c40c6f70 msgr2=0x7f48c40b4490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:34.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.047+0000 7f48caac8640 1 --2- 172.21.15.1:0/2719387388 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f48c40c6f70 0x7f48c40b4490 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f48b400e8a0 tx=0x7f48b400ed60 comp rx=0 tx=0).stop 2024-05-04T02:20:34.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.047+0000 7f48caac8640 1 -- 172.21.15.1:0/2719387388 shutdown_connections 2024-05-04T02:20:34.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.047+0000 7f48caac8640 1 --2- 172.21.15.1:0/2719387388 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f48b0076320 0x7f48b0078830 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:34.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.047+0000 7f48caac8640 1 --2- 172.21.15.1:0/2719387388 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f48c4164df0 0x7f48c4159660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:34.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.047+0000 7f48caac8640 1 --2- 172.21.15.1:0/2719387388 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f48c40cdc20 0x7f48c4157a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:34.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.047+0000 7f48caac8640 1 --2- 172.21.15.1:0/2719387388 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f48c40c6f70 0x7f48c40b4490 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:34.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.047+0000 7f48caac8640 1 -- 172.21.15.1:0/2719387388 >> 172.21.15.1:0/2719387388 conn(0x7f48c408e210 msgr2=0x7f48c40caf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:34.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.047+0000 7f48caac8640 1 -- 172.21.15.1:0/2719387388 shutdown_connections 2024-05-04T02:20:34.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.047+0000 7f48caac8640 1 -- 172.21.15.1:0/2719387388 wait complete. 2024-05-04T02:20:34.060 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-05-04T02:20:33.126582+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":234852,"kb_used_data":2016,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739868,"statfs":{"total":773094113280,"available":772853624832,"internally_reserved":0,"allocated":2064384,"data_stored":1861780,"data_compressed":65100,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1612,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002883"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.547287+0000","last_change":"2024-05-04T02:20:15.298728+0000","last_active":"2024-05-04T02:20:18.547287+0000","last_peered":"2024-05-04T02:20:18.547287+0000","last_clean":"2024-05-04T02:20:18.547287+0000","last_became_active":"2024-05-04T02:20:15.298265+0000","last_became_peered":"2024-05-04T02:20:15.298265+0000","last_unstale":"2024-05-04T02:20:18.547287+0000","last_undegraded":"2024-05-04T02:20:18.547287+0000","last_fullsized":"2024-05-04T02:20:18.547287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:57:21.783118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.023924+0000","last_change":"2024-05-04T02:20:15.299265+0000","last_active":"2024-05-04T02:20:18.023924+0000","last_peered":"2024-05-04T02:20:18.023924+0000","last_clean":"2024-05-04T02:20:18.023924+0000","last_became_active":"2024-05-04T02:20:15.298956+0000","last_became_peered":"2024-05-04T02:20:15.298956+0000","last_unstale":"2024-05-04T02:20:18.023924+0000","last_undegraded":"2024-05-04T02:20:18.023924+0000","last_fullsized":"2024-05-04T02:20:18.023924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:23:25.157473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546733+0000","last_change":"2024-05-04T02:20:15.297447+0000","last_active":"2024-05-04T02:20:18.546733+0000","last_peered":"2024-05-04T02:20:18.546733+0000","last_clean":"2024-05-04T02:20:18.546733+0000","last_became_active":"2024-05-04T02:20:15.297150+0000","last_became_peered":"2024-05-04T02:20:15.297150+0000","last_unstale":"2024-05-04T02:20:18.546733+0000","last_undegraded":"2024-05-04T02:20:18.546733+0000","last_fullsized":"2024-05-04T02:20:18.546733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:10:27.059401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546433+0000","last_change":"2024-05-04T02:20:15.301427+0000","last_active":"2024-05-04T02:20:18.546433+0000","last_peered":"2024-05-04T02:20:18.546433+0000","last_clean":"2024-05-04T02:20:18.546433+0000","last_became_active":"2024-05-04T02:20:15.301113+0000","last_became_peered":"2024-05-04T02:20:15.301113+0000","last_unstale":"2024-05-04T02:20:18.546433+0000","last_undegraded":"2024-05-04T02:20:18.546433+0000","last_fullsized":"2024-05-04T02:20:18.546433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:06:48.185771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.547075+0000","last_change":"2024-05-04T02:20:15.297817+0000","last_active":"2024-05-04T02:20:18.547075+0000","last_peered":"2024-05-04T02:20:18.547075+0000","last_clean":"2024-05-04T02:20:18.547075+0000","last_became_active":"2024-05-04T02:20:15.297511+0000","last_became_peered":"2024-05-04T02:20:15.297511+0000","last_unstale":"2024-05-04T02:20:18.547075+0000","last_undegraded":"2024-05-04T02:20:18.547075+0000","last_fullsized":"2024-05-04T02:20:18.547075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:33:31.416768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546640+0000","last_change":"2024-05-04T02:20:15.306853+0000","last_active":"2024-05-04T02:20:18.546640+0000","last_peered":"2024-05-04T02:20:18.546640+0000","last_clean":"2024-05-04T02:20:18.546640+0000","last_became_active":"2024-05-04T02:20:15.306537+0000","last_became_peered":"2024-05-04T02:20:15.306537+0000","last_unstale":"2024-05-04T02:20:18.546640+0000","last_undegraded":"2024-05-04T02:20:18.546640+0000","last_fullsized":"2024-05-04T02:20:18.546640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:35:15.732585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546478+0000","last_change":"2024-05-04T02:20:15.299499+0000","last_active":"2024-05-04T02:20:18.546478+0000","last_peered":"2024-05-04T02:20:18.546478+0000","last_clean":"2024-05-04T02:20:18.546478+0000","last_became_active":"2024-05-04T02:20:15.299177+0000","last_became_peered":"2024-05-04T02:20:15.299177+0000","last_unstale":"2024-05-04T02:20:18.546478+0000","last_undegraded":"2024-05-04T02:20:18.546478+0000","last_fullsized":"2024-05-04T02:20:18.546478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:13:25.600467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.963063+0000","last_change":"2024-05-04T02:20:15.306964+0000","last_active":"2024-05-04T02:20:17.963063+0000","last_peered":"2024-05-04T02:20:17.963063+0000","last_clean":"2024-05-04T02:20:17.963063+0000","last_became_active":"2024-05-04T02:20:15.306663+0000","last_became_peered":"2024-05-04T02:20:15.306663+0000","last_unstale":"2024-05-04T02:20:17.963063+0000","last_undegraded":"2024-05-04T02:20:17.963063+0000","last_fullsized":"2024-05-04T02:20:17.963063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:52:22.299082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.547373+0000","last_change":"2024-05-04T02:20:15.303354+0000","last_active":"2024-05-04T02:20:18.547373+0000","last_peered":"2024-05-04T02:20:18.547373+0000","last_clean":"2024-05-04T02:20:18.547373+0000","last_became_active":"2024-05-04T02:20:15.303055+0000","last_became_peered":"2024-05-04T02:20:15.303055+0000","last_unstale":"2024-05-04T02:20:18.547373+0000","last_undegraded":"2024-05-04T02:20:18.547373+0000","last_fullsized":"2024-05-04T02:20:18.547373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:22:30.839899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.975983+0000","last_change":"2024-05-04T02:20:15.307433+0000","last_active":"2024-05-04T02:20:17.975983+0000","last_peered":"2024-05-04T02:20:17.975983+0000","last_clean":"2024-05-04T02:20:17.975983+0000","last_became_active":"2024-05-04T02:20:15.307124+0000","last_became_peered":"2024-05-04T02:20:15.307124+0000","last_unstale":"2024-05-04T02:20:17.975983+0000","last_undegraded":"2024-05-04T02:20:17.975983+0000","last_fullsized":"2024-05-04T02:20:17.975983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:22:04.903746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.975729+0000","last_change":"2024-05-04T02:20:15.306714+0000","last_active":"2024-05-04T02:20:17.975729+0000","last_peered":"2024-05-04T02:20:17.975729+0000","last_clean":"2024-05-04T02:20:17.975729+0000","last_became_active":"2024-05-04T02:20:15.306409+0000","last_became_peered":"2024-05-04T02:20:15.306409+0000","last_unstale":"2024-05-04T02:20:17.975729+0000","last_undegraded":"2024-05-04T02:20:17.975729+0000","last_fullsized":"2024-05-04T02:20:17.975729+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:51:58.828664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.964671+0000","last_change":"2024-05-04T02:20:15.296940+0000","last_active":"2024-05-04T02:20:17.964671+0000","last_peered":"2024-05-04T02:20:17.964671+0000","last_clean":"2024-05-04T02:20:17.964671+0000","last_became_active":"2024-05-04T02:20:15.296640+0000","last_became_peered":"2024-05-04T02:20:15.296640+0000","last_unstale":"2024-05-04T02:20:17.964671+0000","last_undegraded":"2024-05-04T02:20:17.964671+0000","last_fullsized":"2024-05-04T02:20:17.964671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:25:44.598454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.963262+0000","last_change":"2024-05-04T02:20:15.294287+0000","last_active":"2024-05-04T02:20:17.963262+0000","last_peered":"2024-05-04T02:20:17.963262+0000","last_clean":"2024-05-04T02:20:17.963262+0000","last_became_active":"2024-05-04T02:20:15.293909+0000","last_became_peered":"2024-05-04T02:20:15.293909+0000","last_unstale":"2024-05-04T02:20:17.963262+0000","last_undegraded":"2024-05-04T02:20:17.963262+0000","last_fullsized":"2024-05-04T02:20:17.963262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:31:26.635672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546404+0000","last_change":"2024-05-04T02:20:15.293837+0000","last_active":"2024-05-04T02:20:18.546404+0000","last_peered":"2024-05-04T02:20:18.546404+0000","last_clean":"2024-05-04T02:20:18.546404+0000","last_became_active":"2024-05-04T02:20:15.293550+0000","last_became_peered":"2024-05-04T02:20:15.293550+0000","last_unstale":"2024-05-04T02:20:18.546404+0000","last_undegraded":"2024-05-04T02:20:18.546404+0000","last_fullsized":"2024-05-04T02:20:18.546404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:55:35.975972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.023439+0000","last_change":"2024-05-04T02:20:15.306005+0000","last_active":"2024-05-04T02:20:18.023439+0000","last_peered":"2024-05-04T02:20:18.023439+0000","last_clean":"2024-05-04T02:20:18.023439+0000","last_became_active":"2024-05-04T02:20:15.305549+0000","last_became_peered":"2024-05-04T02:20:15.305549+0000","last_unstale":"2024-05-04T02:20:18.023439+0000","last_undegraded":"2024-05-04T02:20:18.023439+0000","last_fullsized":"2024-05-04T02:20:18.023439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:58:55.400048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546265+0000","last_change":"2024-05-04T02:20:15.305322+0000","last_active":"2024-05-04T02:20:18.546265+0000","last_peered":"2024-05-04T02:20:18.546265+0000","last_clean":"2024-05-04T02:20:18.546265+0000","last_became_active":"2024-05-04T02:20:15.301515+0000","last_became_peered":"2024-05-04T02:20:15.301515+0000","last_unstale":"2024-05-04T02:20:18.546265+0000","last_undegraded":"2024-05-04T02:20:18.546265+0000","last_fullsized":"2024-05-04T02:20:18.546265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:10:21.048301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546917+0000","last_change":"2024-05-04T02:20:15.301042+0000","last_active":"2024-05-04T02:20:18.546917+0000","last_peered":"2024-05-04T02:20:18.546917+0000","last_clean":"2024-05-04T02:20:18.546917+0000","last_became_active":"2024-05-04T02:20:15.300707+0000","last_became_peered":"2024-05-04T02:20:15.300707+0000","last_unstale":"2024-05-04T02:20:18.546917+0000","last_undegraded":"2024-05-04T02:20:18.546917+0000","last_fullsized":"2024-05-04T02:20:18.546917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:36:19.111702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546693+0000","last_change":"2024-05-04T02:20:15.292059+0000","last_active":"2024-05-04T02:20:18.546693+0000","last_peered":"2024-05-04T02:20:18.546693+0000","last_clean":"2024-05-04T02:20:18.546693+0000","last_became_active":"2024-05-04T02:20:15.291766+0000","last_became_peered":"2024-05-04T02:20:15.291766+0000","last_unstale":"2024-05-04T02:20:18.546693+0000","last_undegraded":"2024-05-04T02:20:18.546693+0000","last_fullsized":"2024-05-04T02:20:18.546693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:49:41.728826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.547413+0000","last_change":"2024-05-04T02:20:15.297861+0000","last_active":"2024-05-04T02:20:18.547413+0000","last_peered":"2024-05-04T02:20:18.547413+0000","last_clean":"2024-05-04T02:20:18.547413+0000","last_became_active":"2024-05-04T02:20:15.297568+0000","last_became_peered":"2024-05-04T02:20:15.297568+0000","last_unstale":"2024-05-04T02:20:18.547413+0000","last_undegraded":"2024-05-04T02:20:18.547413+0000","last_fullsized":"2024-05-04T02:20:18.547413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:52:52.278453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.975867+0000","last_change":"2024-05-04T02:20:15.303036+0000","last_active":"2024-05-04T02:20:17.975867+0000","last_peered":"2024-05-04T02:20:17.975867+0000","last_clean":"2024-05-04T02:20:17.975867+0000","last_became_active":"2024-05-04T02:20:15.302743+0000","last_became_peered":"2024-05-04T02:20:15.302743+0000","last_unstale":"2024-05-04T02:20:17.975867+0000","last_undegraded":"2024-05-04T02:20:17.975867+0000","last_fullsized":"2024-05-04T02:20:17.975867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:58:55.400048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546536+0000","last_change":"2024-05-04T02:20:15.300987+0000","last_active":"2024-05-04T02:20:18.546536+0000","last_peered":"2024-05-04T02:20:18.546536+0000","last_clean":"2024-05-04T02:20:18.546536+0000","last_became_active":"2024-05-04T02:20:15.300709+0000","last_became_peered":"2024-05-04T02:20:15.300709+0000","last_unstale":"2024-05-04T02:20:18.546536+0000","last_undegraded":"2024-05-04T02:20:18.546536+0000","last_fullsized":"2024-05-04T02:20:18.546536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:15:46.319755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546742+0000","last_change":"2024-05-04T02:20:15.301545+0000","last_active":"2024-05-04T02:20:18.546742+0000","last_peered":"2024-05-04T02:20:18.546742+0000","last_clean":"2024-05-04T02:20:18.546742+0000","last_became_active":"2024-05-04T02:20:15.300848+0000","last_became_peered":"2024-05-04T02:20:15.300848+0000","last_unstale":"2024-05-04T02:20:18.546742+0000","last_undegraded":"2024-05-04T02:20:18.546742+0000","last_fullsized":"2024-05-04T02:20:18.546742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:26:17.650165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.963300+0000","last_change":"2024-05-04T02:20:15.302188+0000","last_active":"2024-05-04T02:20:17.963300+0000","last_peered":"2024-05-04T02:20:17.963300+0000","last_clean":"2024-05-04T02:20:17.963300+0000","last_became_active":"2024-05-04T02:20:15.301879+0000","last_became_peered":"2024-05-04T02:20:15.301879+0000","last_unstale":"2024-05-04T02:20:17.963300+0000","last_undegraded":"2024-05-04T02:20:17.963300+0000","last_fullsized":"2024-05-04T02:20:17.963300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:51:58.828664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546335+0000","last_change":"2024-05-04T02:20:15.305583+0000","last_active":"2024-05-04T02:20:18.546335+0000","last_peered":"2024-05-04T02:20:18.546335+0000","last_clean":"2024-05-04T02:20:18.546335+0000","last_became_active":"2024-05-04T02:20:15.302385+0000","last_became_peered":"2024-05-04T02:20:15.302385+0000","last_unstale":"2024-05-04T02:20:18.546335+0000","last_undegraded":"2024-05-04T02:20:18.546335+0000","last_fullsized":"2024-05-04T02:20:18.546335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:15:56.592451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.963538+0000","last_change":"2024-05-04T02:20:15.301659+0000","last_active":"2024-05-04T02:20:17.963538+0000","last_peered":"2024-05-04T02:20:17.963538+0000","last_clean":"2024-05-04T02:20:17.963538+0000","last_became_active":"2024-05-04T02:20:15.301363+0000","last_became_peered":"2024-05-04T02:20:15.301363+0000","last_unstale":"2024-05-04T02:20:17.963538+0000","last_undegraded":"2024-05-04T02:20:17.963538+0000","last_fullsized":"2024-05-04T02:20:17.963538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:23:25.157473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.976005+0000","last_change":"2024-05-04T02:20:15.295843+0000","last_active":"2024-05-04T02:20:17.976005+0000","last_peered":"2024-05-04T02:20:17.976005+0000","last_clean":"2024-05-04T02:20:17.976005+0000","last_became_active":"2024-05-04T02:20:15.295577+0000","last_became_peered":"2024-05-04T02:20:15.295577+0000","last_unstale":"2024-05-04T02:20:17.976005+0000","last_undegraded":"2024-05-04T02:20:17.976005+0000","last_fullsized":"2024-05-04T02:20:17.976005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:23:25.157473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.023622+0000","last_change":"2024-05-04T02:20:15.299661+0000","last_active":"2024-05-04T02:20:18.023622+0000","last_peered":"2024-05-04T02:20:18.023622+0000","last_clean":"2024-05-04T02:20:18.023622+0000","last_became_active":"2024-05-04T02:20:15.299230+0000","last_became_peered":"2024-05-04T02:20:15.299230+0000","last_unstale":"2024-05-04T02:20:18.023622+0000","last_undegraded":"2024-05-04T02:20:18.023622+0000","last_fullsized":"2024-05-04T02:20:18.023622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:51:58.828664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.963907+0000","last_change":"2024-05-04T02:20:15.302719+0000","last_active":"2024-05-04T02:20:17.963907+0000","last_peered":"2024-05-04T02:20:17.963907+0000","last_clean":"2024-05-04T02:20:17.963907+0000","last_became_active":"2024-05-04T02:20:15.302456+0000","last_became_peered":"2024-05-04T02:20:15.302456+0000","last_unstale":"2024-05-04T02:20:17.963907+0000","last_undegraded":"2024-05-04T02:20:17.963907+0000","last_fullsized":"2024-05-04T02:20:17.963907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:06:48.185771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546634+0000","last_change":"2024-05-04T02:20:15.296567+0000","last_active":"2024-05-04T02:20:18.546634+0000","last_peered":"2024-05-04T02:20:18.546634+0000","last_clean":"2024-05-04T02:20:18.546634+0000","last_became_active":"2024-05-04T02:20:15.296235+0000","last_became_peered":"2024-05-04T02:20:15.296235+0000","last_unstale":"2024-05-04T02:20:18.546634+0000","last_undegraded":"2024-05-04T02:20:18.546634+0000","last_fullsized":"2024-05-04T02:20:18.546634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:32:20.652776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546840+0000","last_change":"2024-05-04T02:20:15.302190+0000","last_active":"2024-05-04T02:20:18.546840+0000","last_peered":"2024-05-04T02:20:18.546840+0000","last_clean":"2024-05-04T02:20:18.546840+0000","last_became_active":"2024-05-04T02:20:15.301184+0000","last_became_peered":"2024-05-04T02:20:15.301184+0000","last_unstale":"2024-05-04T02:20:18.546840+0000","last_undegraded":"2024-05-04T02:20:18.546840+0000","last_fullsized":"2024-05-04T02:20:18.546840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:52:52.278453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546581+0000","last_change":"2024-05-04T02:20:15.301739+0000","last_active":"2024-05-04T02:20:18.546581+0000","last_peered":"2024-05-04T02:20:18.546581+0000","last_clean":"2024-05-04T02:20:18.546581+0000","last_became_active":"2024-05-04T02:20:15.301424+0000","last_became_peered":"2024-05-04T02:20:15.301424+0000","last_unstale":"2024-05-04T02:20:18.546581+0000","last_undegraded":"2024-05-04T02:20:18.546581+0000","last_fullsized":"2024-05-04T02:20:18.546581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:40:19.927293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.975804+0000","last_change":"2024-05-04T02:20:15.293189+0000","last_active":"2024-05-04T02:20:17.975804+0000","last_peered":"2024-05-04T02:20:17.975804+0000","last_clean":"2024-05-04T02:20:17.975804+0000","last_became_active":"2024-05-04T02:20:15.292840+0000","last_became_peered":"2024-05-04T02:20:15.292840+0000","last_unstale":"2024-05-04T02:20:17.975804+0000","last_undegraded":"2024-05-04T02:20:17.975804+0000","last_fullsized":"2024-05-04T02:20:17.975804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:01:57.617230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.964296+0000","last_change":"2024-05-04T02:20:15.297718+0000","last_active":"2024-05-04T02:20:17.964296+0000","last_peered":"2024-05-04T02:20:17.964296+0000","last_clean":"2024-05-04T02:20:17.964296+0000","last_became_active":"2024-05-04T02:20:15.297415+0000","last_became_peered":"2024-05-04T02:20:15.297415+0000","last_unstale":"2024-05-04T02:20:17.964296+0000","last_undegraded":"2024-05-04T02:20:17.964296+0000","last_fullsized":"2024-05-04T02:20:17.964296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:03:46.054307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.963488+0000","last_change":"2024-05-04T02:20:14.290469+0000","last_active":"2024-05-04T02:20:17.963488+0000","last_peered":"2024-05-04T02:20:17.963488+0000","last_clean":"2024-05-04T02:20:17.963488+0000","last_became_active":"2024-05-04T02:20:14.289651+0000","last_became_peered":"2024-05-04T02:20:14.289651+0000","last_unstale":"2024-05-04T02:20:17.963488+0000","last_undegraded":"2024-05-04T02:20:17.963488+0000","last_fullsized":"2024-05-04T02:20:17.963488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:57:10.542857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546730+0000","last_change":"2024-05-04T02:20:15.305933+0000","last_active":"2024-05-04T02:20:18.546730+0000","last_peered":"2024-05-04T02:20:18.546730+0000","last_clean":"2024-05-04T02:20:18.546730+0000","last_became_active":"2024-05-04T02:20:15.305597+0000","last_became_peered":"2024-05-04T02:20:15.305597+0000","last_unstale":"2024-05-04T02:20:18.546730+0000","last_undegraded":"2024-05-04T02:20:18.546730+0000","last_fullsized":"2024-05-04T02:20:18.546730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:50:29.983685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.975696+0000","last_change":"2024-05-04T02:20:14.359094+0000","last_active":"2024-05-04T02:20:17.975696+0000","last_peered":"2024-05-04T02:20:17.975696+0000","last_clean":"2024-05-04T02:20:17.975696+0000","last_became_active":"2024-05-04T02:20:14.358394+0000","last_became_peered":"2024-05-04T02:20:14.358394+0000","last_unstale":"2024-05-04T02:20:17.975696+0000","last_undegraded":"2024-05-04T02:20:17.975696+0000","last_fullsized":"2024-05-04T02:20:17.975696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:57:26.889464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.963182+0000","last_change":"2024-05-04T02:20:14.356259+0000","last_active":"2024-05-04T02:20:17.963182+0000","last_peered":"2024-05-04T02:20:17.963182+0000","last_clean":"2024-05-04T02:20:17.963182+0000","last_became_active":"2024-05-04T02:20:14.355988+0000","last_became_peered":"2024-05-04T02:20:14.355988+0000","last_unstale":"2024-05-04T02:20:17.963182+0000","last_undegraded":"2024-05-04T02:20:17.963182+0000","last_fullsized":"2024-05-04T02:20:17.963182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:40:36.439339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.963128+0000","last_change":"2024-05-04T02:20:15.295517+0000","last_active":"2024-05-04T02:20:17.963128+0000","last_peered":"2024-05-04T02:20:17.963128+0000","last_clean":"2024-05-04T02:20:17.963128+0000","last_became_active":"2024-05-04T02:20:15.295222+0000","last_became_peered":"2024-05-04T02:20:15.295222+0000","last_unstale":"2024-05-04T02:20:17.963128+0000","last_undegraded":"2024-05-04T02:20:17.963128+0000","last_fullsized":"2024-05-04T02:20:17.963128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:58:55.400048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546388+0000","last_change":"2024-05-04T02:20:14.291543+0000","last_active":"2024-05-04T02:20:18.546388+0000","last_peered":"2024-05-04T02:20:18.546388+0000","last_clean":"2024-05-04T02:20:18.546388+0000","last_became_active":"2024-05-04T02:20:14.290893+0000","last_became_peered":"2024-05-04T02:20:14.290893+0000","last_unstale":"2024-05-04T02:20:18.546388+0000","last_undegraded":"2024-05-04T02:20:18.546388+0000","last_fullsized":"2024-05-04T02:20:18.546388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:57:10.542857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.023655+0000","last_change":"2024-05-04T02:20:15.291991+0000","last_active":"2024-05-04T02:20:18.023655+0000","last_peered":"2024-05-04T02:20:18.023655+0000","last_clean":"2024-05-04T02:20:18.023655+0000","last_became_active":"2024-05-04T02:20:15.291704+0000","last_became_peered":"2024-05-04T02:20:15.291704+0000","last_unstale":"2024-05-04T02:20:18.023655+0000","last_undegraded":"2024-05-04T02:20:18.023655+0000","last_fullsized":"2024-05-04T02:20:18.023655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:52:22.299082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.976029+0000","last_change":"2024-05-04T02:20:14.359336+0000","last_active":"2024-05-04T02:20:17.976029+0000","last_peered":"2024-05-04T02:20:17.976029+0000","last_clean":"2024-05-04T02:20:17.976029+0000","last_became_active":"2024-05-04T02:20:14.357940+0000","last_became_peered":"2024-05-04T02:20:14.357940+0000","last_unstale":"2024-05-04T02:20:17.976029+0000","last_undegraded":"2024-05-04T02:20:17.976029+0000","last_fullsized":"2024-05-04T02:20:17.976029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:48:24.055870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546559+0000","last_change":"2024-05-04T02:20:15.301852+0000","last_active":"2024-05-04T02:20:18.546559+0000","last_peered":"2024-05-04T02:20:18.546559+0000","last_clean":"2024-05-04T02:20:18.546559+0000","last_became_active":"2024-05-04T02:20:15.300374+0000","last_became_peered":"2024-05-04T02:20:15.300374+0000","last_unstale":"2024-05-04T02:20:18.546559+0000","last_undegraded":"2024-05-04T02:20:18.546559+0000","last_fullsized":"2024-05-04T02:20:18.546559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:16:20.585860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546660+0000","last_change":"2024-05-04T02:20:14.358952+0000","last_active":"2024-05-04T02:20:18.546660+0000","last_peered":"2024-05-04T02:20:18.546660+0000","last_clean":"2024-05-04T02:20:18.546660+0000","last_became_active":"2024-05-04T02:20:14.358625+0000","last_became_peered":"2024-05-04T02:20:14.358625+0000","last_unstale":"2024-05-04T02:20:18.546660+0000","last_undegraded":"2024-05-04T02:20:18.546660+0000","last_fullsized":"2024-05-04T02:20:18.546660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:52:21.185127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.547067+0000","last_change":"2024-05-04T02:20:15.307242+0000","last_active":"2024-05-04T02:20:18.547067+0000","last_peered":"2024-05-04T02:20:18.547067+0000","last_clean":"2024-05-04T02:20:18.547067+0000","last_became_active":"2024-05-04T02:20:15.306572+0000","last_became_peered":"2024-05-04T02:20:15.306572+0000","last_unstale":"2024-05-04T02:20:18.547067+0000","last_undegraded":"2024-05-04T02:20:18.547067+0000","last_fullsized":"2024-05-04T02:20:18.547067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:31:36.578679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.023779+0000","last_change":"2024-05-04T02:20:14.292979+0000","last_active":"2024-05-04T02:20:18.023779+0000","last_peered":"2024-05-04T02:20:18.023779+0000","last_clean":"2024-05-04T02:20:18.023779+0000","last_became_active":"2024-05-04T02:20:14.292564+0000","last_became_peered":"2024-05-04T02:20:14.292564+0000","last_unstale":"2024-05-04T02:20:18.023779+0000","last_undegraded":"2024-05-04T02:20:18.023779+0000","last_fullsized":"2024-05-04T02:20:18.023779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:34:37.703735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.964726+0000","last_change":"2024-05-04T02:20:15.298392+0000","last_active":"2024-05-04T02:20:17.964726+0000","last_peered":"2024-05-04T02:20:17.964726+0000","last_clean":"2024-05-04T02:20:17.964726+0000","last_became_active":"2024-05-04T02:20:15.298018+0000","last_became_peered":"2024-05-04T02:20:15.298018+0000","last_unstale":"2024-05-04T02:20:17.964726+0000","last_undegraded":"2024-05-04T02:20:17.964726+0000","last_fullsized":"2024-05-04T02:20:17.964726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:42:57.398678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":25,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.975964+0000","last_change":"2024-05-04T02:20:14.360237+0000","last_active":"2024-05-04T02:20:17.975964+0000","last_peered":"2024-05-04T02:20:17.975964+0000","last_clean":"2024-05-04T02:20:17.975964+0000","last_became_active":"2024-05-04T02:20:14.359886+0000","last_became_peered":"2024-05-04T02:20:14.359886+0000","last_unstale":"2024-05-04T02:20:17.975964+0000","last_undegraded":"2024-05-04T02:20:17.975964+0000","last_fullsized":"2024-05-04T02:20:17.975964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:34:37.703735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.547226+0000","last_change":"2024-05-04T02:20:15.299908+0000","last_active":"2024-05-04T02:20:18.547226+0000","last_peered":"2024-05-04T02:20:18.547226+0000","last_clean":"2024-05-04T02:20:18.547226+0000","last_became_active":"2024-05-04T02:20:15.299336+0000","last_became_peered":"2024-05-04T02:20:15.299336+0000","last_unstale":"2024-05-04T02:20:18.547226+0000","last_undegraded":"2024-05-04T02:20:18.547226+0000","last_fullsized":"2024-05-04T02:20:18.547226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:36:19.111702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546789+0000","last_change":"2024-05-04T02:20:14.274932+0000","last_active":"2024-05-04T02:20:18.546789+0000","last_peered":"2024-05-04T02:20:18.546789+0000","last_clean":"2024-05-04T02:20:18.546789+0000","last_became_active":"2024-05-04T02:20:14.274604+0000","last_became_peered":"2024-05-04T02:20:14.274604+0000","last_unstale":"2024-05-04T02:20:18.546789+0000","last_undegraded":"2024-05-04T02:20:18.546789+0000","last_fullsized":"2024-05-04T02:20:18.546789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:35:43.182599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546447+0000","last_change":"2024-05-04T02:20:15.300355+0000","last_active":"2024-05-04T02:20:18.546447+0000","last_peered":"2024-05-04T02:20:18.546447+0000","last_clean":"2024-05-04T02:20:18.546447+0000","last_became_active":"2024-05-04T02:20:15.300052+0000","last_became_peered":"2024-05-04T02:20:15.300052+0000","last_unstale":"2024-05-04T02:20:18.546447+0000","last_undegraded":"2024-05-04T02:20:18.546447+0000","last_fullsized":"2024-05-04T02:20:18.546447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:06:27.072275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546935+0000","last_change":"2024-05-04T02:20:14.290125+0000","last_active":"2024-05-04T02:20:18.546935+0000","last_peered":"2024-05-04T02:20:18.546935+0000","last_clean":"2024-05-04T02:20:18.546935+0000","last_became_active":"2024-05-04T02:20:14.289826+0000","last_became_peered":"2024-05-04T02:20:14.289826+0000","last_unstale":"2024-05-04T02:20:18.546935+0000","last_undegraded":"2024-05-04T02:20:18.546935+0000","last_fullsized":"2024-05-04T02:20:18.546935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:39:23.112031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.547089+0000","last_change":"2024-05-04T02:20:15.303257+0000","last_active":"2024-05-04T02:20:18.547089+0000","last_peered":"2024-05-04T02:20:18.547089+0000","last_clean":"2024-05-04T02:20:18.547089+0000","last_became_active":"2024-05-04T02:20:15.302963+0000","last_became_peered":"2024-05-04T02:20:15.302963+0000","last_unstale":"2024-05-04T02:20:18.547089+0000","last_undegraded":"2024-05-04T02:20:18.547089+0000","last_fullsized":"2024-05-04T02:20:18.547089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:05:46.729556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.975686+0000","last_change":"2024-05-04T02:20:14.359226+0000","last_active":"2024-05-04T02:20:17.975686+0000","last_peered":"2024-05-04T02:20:17.975686+0000","last_clean":"2024-05-04T02:20:17.975686+0000","last_became_active":"2024-05-04T02:20:14.358494+0000","last_became_peered":"2024-05-04T02:20:14.358494+0000","last_unstale":"2024-05-04T02:20:17.975686+0000","last_undegraded":"2024-05-04T02:20:17.975686+0000","last_fullsized":"2024-05-04T02:20:17.975686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:43:19.283728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.975673+0000","last_change":"2024-05-04T02:20:15.294689+0000","last_active":"2024-05-04T02:20:17.975673+0000","last_peered":"2024-05-04T02:20:17.975673+0000","last_clean":"2024-05-04T02:20:17.975673+0000","last_became_active":"2024-05-04T02:20:15.294400+0000","last_became_peered":"2024-05-04T02:20:15.294400+0000","last_unstale":"2024-05-04T02:20:17.975673+0000","last_undegraded":"2024-05-04T02:20:17.975673+0000","last_fullsized":"2024-05-04T02:20:17.975673+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:22:33.019301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":27,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546431+0000","last_change":"2024-05-04T02:20:14.269539+0000","last_active":"2024-05-04T02:20:18.546431+0000","last_peered":"2024-05-04T02:20:18.546431+0000","last_clean":"2024-05-04T02:20:18.546431+0000","last_became_active":"2024-05-04T02:20:14.269238+0000","last_became_peered":"2024-05-04T02:20:14.269238+0000","last_unstale":"2024-05-04T02:20:18.546431+0000","last_undegraded":"2024-05-04T02:20:18.546431+0000","last_fullsized":"2024-05-04T02:20:18.546431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:19:48.082162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546599+0000","last_change":"2024-05-04T02:20:15.304355+0000","last_active":"2024-05-04T02:20:18.546599+0000","last_peered":"2024-05-04T02:20:18.546599+0000","last_clean":"2024-05-04T02:20:18.546599+0000","last_became_active":"2024-05-04T02:20:15.302736+0000","last_became_peered":"2024-05-04T02:20:15.302736+0000","last_unstale":"2024-05-04T02:20:18.546599+0000","last_undegraded":"2024-05-04T02:20:18.546599+0000","last_fullsized":"2024-05-04T02:20:18.546599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:35:15.732585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.964800+0000","last_change":"2024-05-04T02:20:14.272218+0000","last_active":"2024-05-04T02:20:17.964800+0000","last_peered":"2024-05-04T02:20:17.964800+0000","last_clean":"2024-05-04T02:20:17.964800+0000","last_became_active":"2024-05-04T02:20:14.271883+0000","last_became_peered":"2024-05-04T02:20:14.271883+0000","last_unstale":"2024-05-04T02:20:17.964800+0000","last_undegraded":"2024-05-04T02:20:17.964800+0000","last_fullsized":"2024-05-04T02:20:17.964800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:32:55.463882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.547349+0000","last_change":"2024-05-04T02:20:15.302202+0000","last_active":"2024-05-04T02:20:18.547349+0000","last_peered":"2024-05-04T02:20:18.547349+0000","last_clean":"2024-05-04T02:20:18.547349+0000","last_became_active":"2024-05-04T02:20:15.301880+0000","last_became_peered":"2024-05-04T02:20:15.301880+0000","last_unstale":"2024-05-04T02:20:18.547349+0000","last_undegraded":"2024-05-04T02:20:18.547349+0000","last_fullsized":"2024-05-04T02:20:18.547349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:32:43.559282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546821+0000","last_change":"2024-05-04T02:20:14.292107+0000","last_active":"2024-05-04T02:20:18.546821+0000","last_peered":"2024-05-04T02:20:18.546821+0000","last_clean":"2024-05-04T02:20:18.546821+0000","last_became_active":"2024-05-04T02:20:14.290132+0000","last_became_peered":"2024-05-04T02:20:14.290132+0000","last_unstale":"2024-05-04T02:20:18.546821+0000","last_undegraded":"2024-05-04T02:20:18.546821+0000","last_fullsized":"2024-05-04T02:20:18.546821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:40:35.516308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.547411+0000","last_change":"2024-05-04T02:20:15.302140+0000","last_active":"2024-05-04T02:20:18.547411+0000","last_peered":"2024-05-04T02:20:18.547411+0000","last_clean":"2024-05-04T02:20:18.547411+0000","last_became_active":"2024-05-04T02:20:15.301798+0000","last_became_peered":"2024-05-04T02:20:15.301798+0000","last_unstale":"2024-05-04T02:20:18.547411+0000","last_undegraded":"2024-05-04T02:20:18.547411+0000","last_fullsized":"2024-05-04T02:20:18.547411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:20:28.069809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.023816+0000","last_change":"2024-05-04T02:20:14.274965+0000","last_active":"2024-05-04T02:20:18.023816+0000","last_peered":"2024-05-04T02:20:18.023816+0000","last_clean":"2024-05-04T02:20:18.023816+0000","last_became_active":"2024-05-04T02:20:14.274609+0000","last_became_peered":"2024-05-04T02:20:14.274609+0000","last_unstale":"2024-05-04T02:20:18.023816+0000","last_undegraded":"2024-05-04T02:20:18.023816+0000","last_fullsized":"2024-05-04T02:20:18.023816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:43:19.283728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546618+0000","last_change":"2024-05-04T02:20:15.305486+0000","last_active":"2024-05-04T02:20:18.546618+0000","last_peered":"2024-05-04T02:20:18.546618+0000","last_clean":"2024-05-04T02:20:18.546618+0000","last_became_active":"2024-05-04T02:20:15.301880+0000","last_became_peered":"2024-05-04T02:20:15.301880+0000","last_unstale":"2024-05-04T02:20:18.546618+0000","last_undegraded":"2024-05-04T02:20:18.546618+0000","last_fullsized":"2024-05-04T02:20:18.546618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:13:25.600467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546688+0000","last_change":"2024-05-04T02:20:14.288834+0000","last_active":"2024-05-04T02:20:18.546688+0000","last_peered":"2024-05-04T02:20:18.546688+0000","last_clean":"2024-05-04T02:20:18.546688+0000","last_became_active":"2024-05-04T02:20:14.287992+0000","last_became_peered":"2024-05-04T02:20:14.287992+0000","last_unstale":"2024-05-04T02:20:18.546688+0000","last_undegraded":"2024-05-04T02:20:18.546688+0000","last_fullsized":"2024-05-04T02:20:18.546688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:39:08.143762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.547284+0000","last_change":"2024-05-04T02:20:15.303880+0000","last_active":"2024-05-04T02:20:18.547284+0000","last_peered":"2024-05-04T02:20:18.547284+0000","last_clean":"2024-05-04T02:20:18.547284+0000","last_became_active":"2024-05-04T02:20:15.303601+0000","last_became_peered":"2024-05-04T02:20:15.303601+0000","last_unstale":"2024-05-04T02:20:18.547284+0000","last_undegraded":"2024-05-04T02:20:18.547284+0000","last_fullsized":"2024-05-04T02:20:18.547284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:26:17.650165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":114,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546844+0000","last_change":"2024-05-04T02:20:02.920020+0000","last_active":"2024-05-04T02:20:18.546844+0000","last_peered":"2024-05-04T02:20:18.546844+0000","last_clean":"2024-05-04T02:20:18.546844+0000","last_became_active":"2024-05-04T02:20:02.918859+0000","last_became_peered":"2024-05-04T02:20:02.918859+0000","last_unstale":"2024-05-04T02:20:18.546844+0000","last_undegraded":"2024-05-04T02:20:18.546844+0000","last_fullsized":"2024-05-04T02:20:18.546844+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:00.162760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:00.162760+0000","last_clean_scrub_stamp":"2024-05-04T02:20:00.162760+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:25:04.934922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546389+0000","last_change":"2024-05-04T02:20:14.290136+0000","last_active":"2024-05-04T02:20:18.546389+0000","last_peered":"2024-05-04T02:20:18.546389+0000","last_clean":"2024-05-04T02:20:18.546389+0000","last_became_active":"2024-05-04T02:20:14.289597+0000","last_became_peered":"2024-05-04T02:20:14.289597+0000","last_unstale":"2024-05-04T02:20:18.546389+0000","last_undegraded":"2024-05-04T02:20:18.546389+0000","last_fullsized":"2024-05-04T02:20:18.546389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:43:19.283728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.963442+0000","last_change":"2024-05-04T02:20:15.306971+0000","last_active":"2024-05-04T02:20:17.963442+0000","last_peered":"2024-05-04T02:20:17.963442+0000","last_clean":"2024-05-04T02:20:17.963442+0000","last_became_active":"2024-05-04T02:20:15.306640+0000","last_became_peered":"2024-05-04T02:20:15.306640+0000","last_unstale":"2024-05-04T02:20:17.963442+0000","last_undegraded":"2024-05-04T02:20:17.963442+0000","last_fullsized":"2024-05-04T02:20:17.963442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:22:04.903746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546739+0000","last_change":"2024-05-04T02:20:14.291379+0000","last_active":"2024-05-04T02:20:18.546739+0000","last_peered":"2024-05-04T02:20:18.546739+0000","last_clean":"2024-05-04T02:20:18.546739+0000","last_became_active":"2024-05-04T02:20:14.291044+0000","last_became_peered":"2024-05-04T02:20:14.291044+0000","last_unstale":"2024-05-04T02:20:18.546739+0000","last_undegraded":"2024-05-04T02:20:18.546739+0000","last_fullsized":"2024-05-04T02:20:18.546739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:58:54.286093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546344+0000","last_change":"2024-05-04T02:20:15.305870+0000","last_active":"2024-05-04T02:20:18.546344+0000","last_peered":"2024-05-04T02:20:18.546344+0000","last_clean":"2024-05-04T02:20:18.546344+0000","last_became_active":"2024-05-04T02:20:15.305512+0000","last_became_peered":"2024-05-04T02:20:15.305512+0000","last_unstale":"2024-05-04T02:20:18.546344+0000","last_undegraded":"2024-05-04T02:20:18.546344+0000","last_fullsized":"2024-05-04T02:20:18.546344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:11:17.529449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546641+0000","last_change":"2024-05-04T02:20:14.287676+0000","last_active":"2024-05-04T02:20:18.546641+0000","last_peered":"2024-05-04T02:20:18.546641+0000","last_clean":"2024-05-04T02:20:18.546641+0000","last_became_active":"2024-05-04T02:20:14.287335+0000","last_became_peered":"2024-05-04T02:20:14.287335+0000","last_unstale":"2024-05-04T02:20:18.546641+0000","last_undegraded":"2024-05-04T02:20:18.546641+0000","last_fullsized":"2024-05-04T02:20:18.546641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:54:20.482900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.023390+0000","last_change":"2024-05-04T02:20:15.297316+0000","last_active":"2024-05-04T02:20:18.023390+0000","last_peered":"2024-05-04T02:20:18.023390+0000","last_clean":"2024-05-04T02:20:18.023390+0000","last_became_active":"2024-05-04T02:20:15.297010+0000","last_became_peered":"2024-05-04T02:20:15.297010+0000","last_unstale":"2024-05-04T02:20:18.023390+0000","last_undegraded":"2024-05-04T02:20:18.023390+0000","last_fullsized":"2024-05-04T02:20:18.023390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:22:33.019301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.547029+0000","last_change":"2024-05-04T02:20:14.292802+0000","last_active":"2024-05-04T02:20:18.547029+0000","last_peered":"2024-05-04T02:20:18.547029+0000","last_clean":"2024-05-04T02:20:18.547029+0000","last_became_active":"2024-05-04T02:20:14.292595+0000","last_became_peered":"2024-05-04T02:20:14.292595+0000","last_unstale":"2024-05-04T02:20:18.547029+0000","last_undegraded":"2024-05-04T02:20:18.547029+0000","last_fullsized":"2024-05-04T02:20:18.547029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:31:25.521717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.964423+0000","last_change":"2024-05-04T02:20:15.296358+0000","last_active":"2024-05-04T02:20:17.964423+0000","last_peered":"2024-05-04T02:20:17.964423+0000","last_clean":"2024-05-04T02:20:17.964423+0000","last_became_active":"2024-05-04T02:20:15.296075+0000","last_became_peered":"2024-05-04T02:20:15.296075+0000","last_unstale":"2024-05-04T02:20:17.964423+0000","last_undegraded":"2024-05-04T02:20:17.964423+0000","last_fullsized":"2024-05-04T02:20:17.964423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:30:50.014584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.023655+0000","last_change":"2024-05-04T02:20:14.253846+0000","last_active":"2024-05-04T02:20:18.023655+0000","last_peered":"2024-05-04T02:20:18.023655+0000","last_clean":"2024-05-04T02:20:18.023655+0000","last_became_active":"2024-05-04T02:20:14.253513+0000","last_became_peered":"2024-05-04T02:20:14.253513+0000","last_unstale":"2024-05-04T02:20:18.023655+0000","last_undegraded":"2024-05-04T02:20:18.023655+0000","last_fullsized":"2024-05-04T02:20:18.023655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:40:36.439339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546859+0000","last_change":"2024-05-04T02:20:15.300702+0000","last_active":"2024-05-04T02:20:18.546859+0000","last_peered":"2024-05-04T02:20:18.546859+0000","last_clean":"2024-05-04T02:20:18.546859+0000","last_became_active":"2024-05-04T02:20:15.300251+0000","last_became_peered":"2024-05-04T02:20:15.300251+0000","last_unstale":"2024-05-04T02:20:18.546859+0000","last_undegraded":"2024-05-04T02:20:18.546859+0000","last_fullsized":"2024-05-04T02:20:18.546859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:05:46.729556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.547456+0000","last_change":"2024-05-04T02:20:14.291304+0000","last_active":"2024-05-04T02:20:18.547456+0000","last_peered":"2024-05-04T02:20:18.547456+0000","last_clean":"2024-05-04T02:20:18.547456+0000","last_became_active":"2024-05-04T02:20:14.290952+0000","last_became_peered":"2024-05-04T02:20:14.290952+0000","last_unstale":"2024-05-04T02:20:18.547456+0000","last_undegraded":"2024-05-04T02:20:18.547456+0000","last_fullsized":"2024-05-04T02:20:18.547456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:15:55.478496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.023562+0000","last_change":"2024-05-04T02:20:15.296895+0000","last_active":"2024-05-04T02:20:18.023562+0000","last_peered":"2024-05-04T02:20:18.023562+0000","last_clean":"2024-05-04T02:20:18.023562+0000","last_became_active":"2024-05-04T02:20:15.296562+0000","last_became_peered":"2024-05-04T02:20:15.296562+0000","last_unstale":"2024-05-04T02:20:18.023562+0000","last_undegraded":"2024-05-04T02:20:18.023562+0000","last_fullsized":"2024-05-04T02:20:18.023562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:22:04.903746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.024002+0000","last_change":"2024-05-04T02:20:14.358920+0000","last_active":"2024-05-04T02:20:18.024002+0000","last_peered":"2024-05-04T02:20:18.024002+0000","last_clean":"2024-05-04T02:20:18.024002+0000","last_became_active":"2024-05-04T02:20:14.358621+0000","last_became_peered":"2024-05-04T02:20:14.358621+0000","last_unstale":"2024-05-04T02:20:18.024002+0000","last_undegraded":"2024-05-04T02:20:18.024002+0000","last_fullsized":"2024-05-04T02:20:18.024002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:57:10.542857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.963661+0000","last_change":"2024-05-04T02:20:15.299992+0000","last_active":"2024-05-04T02:20:17.963661+0000","last_peered":"2024-05-04T02:20:17.963661+0000","last_clean":"2024-05-04T02:20:17.963661+0000","last_became_active":"2024-05-04T02:20:15.299678+0000","last_became_peered":"2024-05-04T02:20:15.299678+0000","last_unstale":"2024-05-04T02:20:17.963661+0000","last_undegraded":"2024-05-04T02:20:17.963661+0000","last_fullsized":"2024-05-04T02:20:17.963661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:39:43.029499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.976082+0000","last_change":"2024-05-04T02:20:14.359479+0000","last_active":"2024-05-04T02:20:17.976082+0000","last_peered":"2024-05-04T02:20:17.976082+0000","last_clean":"2024-05-04T02:20:17.976082+0000","last_became_active":"2024-05-04T02:20:14.358524+0000","last_became_peered":"2024-05-04T02:20:14.358524+0000","last_unstale":"2024-05-04T02:20:17.976082+0000","last_undegraded":"2024-05-04T02:20:17.976082+0000","last_fullsized":"2024-05-04T02:20:17.976082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:40:36.439339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.547004+0000","last_change":"2024-05-04T02:20:15.293908+0000","last_active":"2024-05-04T02:20:18.547004+0000","last_peered":"2024-05-04T02:20:18.547004+0000","last_clean":"2024-05-04T02:20:18.547004+0000","last_became_active":"2024-05-04T02:20:15.293602+0000","last_became_peered":"2024-05-04T02:20:15.293602+0000","last_unstale":"2024-05-04T02:20:18.547004+0000","last_undegraded":"2024-05-04T02:20:18.547004+0000","last_fullsized":"2024-05-04T02:20:18.547004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:18:03.065030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546622+0000","last_change":"2024-05-04T02:20:14.291515+0000","last_active":"2024-05-04T02:20:18.546622+0000","last_peered":"2024-05-04T02:20:18.546622+0000","last_clean":"2024-05-04T02:20:18.546622+0000","last_became_active":"2024-05-04T02:20:14.291068+0000","last_became_peered":"2024-05-04T02:20:14.291068+0000","last_unstale":"2024-05-04T02:20:18.546622+0000","last_undegraded":"2024-05-04T02:20:18.546622+0000","last_fullsized":"2024-05-04T02:20:18.546622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:57:10.542857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.964360+0000","last_change":"2024-05-04T02:20:15.247885+0000","last_active":"2024-05-04T02:20:17.964360+0000","last_peered":"2024-05-04T02:20:17.964360+0000","last_clean":"2024-05-04T02:20:17.964360+0000","last_became_active":"2024-05-04T02:20:15.247583+0000","last_became_peered":"2024-05-04T02:20:15.247583+0000","last_unstale":"2024-05-04T02:20:17.964360+0000","last_undegraded":"2024-05-04T02:20:17.964360+0000","last_fullsized":"2024-05-04T02:20:17.964360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:39:16.967443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.023555+0000","last_change":"2024-05-04T02:20:14.289690+0000","last_active":"2024-05-04T02:20:18.023555+0000","last_peered":"2024-05-04T02:20:18.023555+0000","last_clean":"2024-05-04T02:20:18.023555+0000","last_became_active":"2024-05-04T02:20:14.289360+0000","last_became_peered":"2024-05-04T02:20:14.289360+0000","last_unstale":"2024-05-04T02:20:18.023555+0000","last_undegraded":"2024-05-04T02:20:18.023555+0000","last_fullsized":"2024-05-04T02:20:18.023555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:57:26.889464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.963256+0000","last_change":"2024-05-04T02:20:15.296623+0000","last_active":"2024-05-04T02:20:17.963256+0000","last_peered":"2024-05-04T02:20:17.963256+0000","last_clean":"2024-05-04T02:20:17.963256+0000","last_became_active":"2024-05-04T02:20:15.296330+0000","last_became_peered":"2024-05-04T02:20:15.296330+0000","last_unstale":"2024-05-04T02:20:17.963256+0000","last_undegraded":"2024-05-04T02:20:17.963256+0000","last_fullsized":"2024-05-04T02:20:17.963256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:39:18.114604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.023764+0000","last_change":"2024-05-04T02:20:14.289113+0000","last_active":"2024-05-04T02:20:18.023764+0000","last_peered":"2024-05-04T02:20:18.023764+0000","last_clean":"2024-05-04T02:20:18.023764+0000","last_became_active":"2024-05-04T02:20:14.288769+0000","last_became_peered":"2024-05-04T02:20:14.288769+0000","last_unstale":"2024-05-04T02:20:18.023764+0000","last_undegraded":"2024-05-04T02:20:18.023764+0000","last_fullsized":"2024-05-04T02:20:18.023764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:48:24.055870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.963379+0000","last_change":"2024-05-04T02:20:15.295428+0000","last_active":"2024-05-04T02:20:17.963379+0000","last_peered":"2024-05-04T02:20:17.963379+0000","last_clean":"2024-05-04T02:20:17.963379+0000","last_became_active":"2024-05-04T02:20:15.295128+0000","last_became_peered":"2024-05-04T02:20:15.295128+0000","last_unstale":"2024-05-04T02:20:17.963379+0000","last_undegraded":"2024-05-04T02:20:17.963379+0000","last_fullsized":"2024-05-04T02:20:17.963379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:10:21.048301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.547224+0000","last_change":"2024-05-04T02:20:14.294321+0000","last_active":"2024-05-04T02:20:18.547224+0000","last_peered":"2024-05-04T02:20:18.547224+0000","last_clean":"2024-05-04T02:20:18.547224+0000","last_became_active":"2024-05-04T02:20:14.293862+0000","last_became_peered":"2024-05-04T02:20:14.293862+0000","last_unstale":"2024-05-04T02:20:18.547224+0000","last_undegraded":"2024-05-04T02:20:18.547224+0000","last_fullsized":"2024-05-04T02:20:18.547224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:39:17.000649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.975812+0000","last_change":"2024-05-04T02:20:15.296883+0000","last_active":"2024-05-04T02:20:17.975812+0000","last_peered":"2024-05-04T02:20:17.975812+0000","last_clean":"2024-05-04T02:20:17.975812+0000","last_became_active":"2024-05-04T02:20:15.296544+0000","last_became_peered":"2024-05-04T02:20:15.296544+0000","last_unstale":"2024-05-04T02:20:17.975812+0000","last_undegraded":"2024-05-04T02:20:17.975812+0000","last_fullsized":"2024-05-04T02:20:17.975812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:52:22.299082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546509+0000","last_change":"2024-05-04T02:20:15.306263+0000","last_active":"2024-05-04T02:20:18.546509+0000","last_peered":"2024-05-04T02:20:18.546509+0000","last_clean":"2024-05-04T02:20:18.546509+0000","last_became_active":"2024-05-04T02:20:15.305941+0000","last_became_peered":"2024-05-04T02:20:15.305941+0000","last_unstale":"2024-05-04T02:20:18.546509+0000","last_undegraded":"2024-05-04T02:20:18.546509+0000","last_fullsized":"2024-05-04T02:20:18.546509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:33:31.416768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.547164+0000","last_change":"2024-05-04T02:20:14.294204+0000","last_active":"2024-05-04T02:20:18.547164+0000","last_peered":"2024-05-04T02:20:18.547164+0000","last_clean":"2024-05-04T02:20:18.547164+0000","last_became_active":"2024-05-04T02:20:14.293788+0000","last_became_peered":"2024-05-04T02:20:14.293788+0000","last_unstale":"2024-05-04T02:20:18.547164+0000","last_undegraded":"2024-05-04T02:20:18.547164+0000","last_fullsized":"2024-05-04T02:20:18.547164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:52:21.185127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546530+0000","last_change":"2024-05-04T02:20:15.306357+0000","last_active":"2024-05-04T02:20:18.546530+0000","last_peered":"2024-05-04T02:20:18.546530+0000","last_clean":"2024-05-04T02:20:18.546530+0000","last_became_active":"2024-05-04T02:20:15.306050+0000","last_became_peered":"2024-05-04T02:20:15.306050+0000","last_unstale":"2024-05-04T02:20:18.546530+0000","last_undegraded":"2024-05-04T02:20:18.546530+0000","last_fullsized":"2024-05-04T02:20:18.546530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:39:18.114604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.547329+0000","last_change":"2024-05-04T02:20:14.357677+0000","last_active":"2024-05-04T02:20:18.547329+0000","last_peered":"2024-05-04T02:20:18.547329+0000","last_clean":"2024-05-04T02:20:18.547329+0000","last_became_active":"2024-05-04T02:20:14.357368+0000","last_became_peered":"2024-05-04T02:20:14.357368+0000","last_unstale":"2024-05-04T02:20:18.547329+0000","last_undegraded":"2024-05-04T02:20:18.547329+0000","last_fullsized":"2024-05-04T02:20:18.547329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:10:19.934346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.546966+0000","last_change":"2024-05-04T02:20:15.307496+0000","last_active":"2024-05-04T02:20:18.546966+0000","last_peered":"2024-05-04T02:20:18.546966+0000","last_clean":"2024-05-04T02:20:18.546966+0000","last_became_active":"2024-05-04T02:20:15.306956+0000","last_became_peered":"2024-05-04T02:20:15.306956+0000","last_unstale":"2024-05-04T02:20:18.546966+0000","last_undegraded":"2024-05-04T02:20:18.546966+0000","last_fullsized":"2024-05-04T02:20:18.546966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:19:48.110866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.963458+0000","last_change":"2024-05-04T02:20:14.291632+0000","last_active":"2024-05-04T02:20:17.963458+0000","last_peered":"2024-05-04T02:20:17.963458+0000","last_clean":"2024-05-04T02:20:17.963458+0000","last_became_active":"2024-05-04T02:20:14.291331+0000","last_became_peered":"2024-05-04T02:20:14.291331+0000","last_unstale":"2024-05-04T02:20:17.963458+0000","last_undegraded":"2024-05-04T02:20:17.963458+0000","last_fullsized":"2024-05-04T02:20:17.963458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:22:31.905346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:17.963350+0000","last_change":"2024-05-04T02:20:15.294309+0000","last_active":"2024-05-04T02:20:17.963350+0000","last_peered":"2024-05-04T02:20:17.963350+0000","last_clean":"2024-05-04T02:20:17.963350+0000","last_became_active":"2024-05-04T02:20:15.294026+0000","last_became_peered":"2024-05-04T02:20:15.294026+0000","last_unstale":"2024-05-04T02:20:17.963350+0000","last_undegraded":"2024-05-04T02:20:17.963350+0000","last_fullsized":"2024-05-04T02:20:17.963350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:39:24.225985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-05-04T02:20:18.547102+0000","last_change":"2024-05-04T02:20:14.291633+0000","last_active":"2024-05-04T02:20:18.547102+0000","last_peered":"2024-05-04T02:20:18.547102+0000","last_clean":"2024-05-04T02:20:18.547102+0000","last_became_active":"2024-05-04T02:20:14.291313+0000","last_became_peered":"2024-05-04T02:20:14.291313+0000","last_unstale":"2024-05-04T02:20:18.547102+0000","last_undegraded":"2024-05-04T02:20:18.547102+0000","last_fullsized":"2024-05-04T02:20:18.547102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:48:36.710163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65100,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509451,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":303104,"data_stored":675478,"data_compressed":32550,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509451,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":245760,"data_stored":86140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509451,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":237568,"data_stored":84618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509451,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":245760,"data_stored":86140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509451,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":233472,"data_stored":84528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509450,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31420,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340420,"statfs":{"total":96636764160,"available":96604590080,"internally_reserved":0,"allocated":241664,"data_stored":84688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542155,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":245760,"data_stored":84654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31492,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340348,"statfs":{"total":96636764160,"available":96604516352,"internally_reserved":0,"allocated":311296,"data_stored":675534,"data_compressed":32550,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32550,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32550,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-04T02:20:34.064 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-04T02:20:34.064 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-04T02:20:34.064 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-05-04T02:20:34.065 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-04T02:20:34.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.209+0000 7f32ddf76640 1 Processor -- start 2024-05-04T02:20:34.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.210+0000 7f32ddf76640 1 -- start start 2024-05-04T02:20:34.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.211+0000 7f32ddf76640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f32d80cde50 0x7f32d815cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:34.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.211+0000 7f32ddf76640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f32d80cc590 0x7f32d80cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:34.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.211+0000 7f32ddf76640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32d80cd6c0 con 0x7f32d80c7da0 2024-05-04T02:20:34.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.211+0000 7f32ddf76640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f32d80c7070 con 0x7f32d80cde50 2024-05-04T02:20:34.213 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.211+0000 7f32ddf76640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f32d80cd980 con 0x7f32d80cc590 2024-05-04T02:20:34.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.211+0000 7f32d6ffd640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f32d80c7da0 0x7f32d806c6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:42044/0 (socket says 172.21.15.1:42044) 2024-05-04T02:20:34.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.211+0000 7f32d6ffd640 1 -- 172.21.15.1:0/1444030532 learned_addr learned my addr 172.21.15.1:0/1444030532 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-05-04T02:20:34.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.212+0000 7f32d7fff640 1 --2- 172.21.15.1:0/1444030532 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f32d80cc590 0x7f32d80cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:34.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.212+0000 7f32d77fe640 1 --2- 172.21.15.1:0/1444030532 >> v2:172.21.15.107:3300/0 conn(0x7f32d80cde50 0x7f32d815cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:34.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.214+0000 7f32d67fc640 1 -- 172.21.15.1:0/1444030532 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4088294672 0 0) 0x7f32d80cd6c0 con 0x7f32d80c7da0 2024-05-04T02:20:34.216 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.214+0000 7f32d67fc640 1 -- 172.21.15.1:0/1444030532 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f32c0003520 con 0x7f32d80c7da0 2024-05-04T02:20:34.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.215+0000 7f32d7fff640 1 -- 172.21.15.1:0/1444030532 >> v2:172.21.15.107:3300/0 conn(0x7f32d80cde50 msgr2=0x7f32d815cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:34.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.215+0000 7f32d7fff640 1 --2- 172.21.15.1:0/1444030532 >> v2:172.21.15.107:3300/0 conn(0x7f32d80cde50 0x7f32d815cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:34.217 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.215+0000 7f32d7fff640 1 -- 172.21.15.1:0/1444030532 >> v1:172.21.15.1:6789/0 conn(0x7f32d80c7da0 legacy=0x7f32d806c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:34.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.215+0000 7f32d7fff640 1 -- 172.21.15.1:0/1444030532 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32d80c72c0 con 0x7f32d80cc590 2024-05-04T02:20:34.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.218+0000 7f32d7fff640 1 --2- 172.21.15.1:0/1444030532 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f32d80cc590 0x7f32d80cc9a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f32d80c71f0 tx=0x7f32d002a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa40c2ea5a79131d server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:34.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.222+0000 7f32d67fc640 1 -- 172.21.15.1:0/1444030532 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d0007740 con 0x7f32d80cc590 2024-05-04T02:20:34.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.222+0000 7f32d67fc640 1 -- 172.21.15.1:0/1444030532 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32d00078e0 con 0x7f32d80cc590 2024-05-04T02:20:34.224 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.222+0000 7f32d67fc640 1 -- 172.21.15.1:0/1444030532 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d0007cb0 con 0x7f32d80cc590 2024-05-04T02:20:34.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.222+0000 7f32ddf76640 1 -- 172.21.15.1:0/1444030532 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f32d80cc590 msgr2=0x7f32d80cc9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:34.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.222+0000 7f32ddf76640 1 --2- 172.21.15.1:0/1444030532 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f32d80cc590 0x7f32d80cc9a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f32d80c71f0 tx=0x7f32d002a6d0 comp rx=0 tx=0).stop 2024-05-04T02:20:34.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.222+0000 7f32ddf76640 1 -- 172.21.15.1:0/1444030532 shutdown_connections 2024-05-04T02:20:34.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.222+0000 7f32ddf76640 1 --2- 172.21.15.1:0/1444030532 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f32d80cc590 0x7f32d80cc9a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:34.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.222+0000 7f32ddf76640 1 --2- 172.21.15.1:0/1444030532 >> v2:172.21.15.107:3300/0 conn(0x7f32d80cde50 0x7f32d815cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:34.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.222+0000 7f32ddf76640 1 -- 172.21.15.1:0/1444030532 >> 172.21.15.1:0/1444030532 conn(0x7f32d80d2590 msgr2=0x7f32d80ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:34.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.223+0000 7f32ddf76640 1 -- 172.21.15.1:0/1444030532 shutdown_connections 2024-05-04T02:20:34.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.223+0000 7f32ddf76640 1 -- 172.21.15.1:0/1444030532 wait complete. 2024-05-04T02:20:34.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.224+0000 7f32ddf76640 1 Processor -- start 2024-05-04T02:20:34.227 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.225+0000 7f32ddf76640 1 -- start start 2024-05-04T02:20:34.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.226+0000 7f32ddf76640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f32d80c7da0 0x7f32d815dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:34.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.226+0000 7f32ddf76640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f32d80cc590 0x7f32d815f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:34.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.226+0000 7f32ddf76640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f32d81e9680 0x7f32d815ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:34.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.226+0000 7f32ddf76640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f32d8156b40 con 0x7f32d80c7da0 2024-05-04T02:20:34.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.226+0000 7f32ddf76640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f32d80c7880 con 0x7f32d80cc590 2024-05-04T02:20:34.229 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.226+0000 7f32ddf76640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f32d80cd310 con 0x7f32d81e9680 2024-05-04T02:20:34.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.226+0000 7f32d77fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f32d80c7da0 0x7f32d815dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:34.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.226+0000 7f32d7fff640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f32d81e9680 0x7f32d815ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:34.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.227+0000 7f32d77fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f32d80c7da0 0x7f32d815dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40904/0 (socket says 172.21.15.1:40904) 2024-05-04T02:20:34.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.227+0000 7f32d77fe640 1 -- 172.21.15.1:0/2310395199 learned_addr learned my addr 172.21.15.1:0/2310395199 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:34.230 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.227+0000 7f32d6ffd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f32d80cc590 0x7f32d815f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:34.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.231+0000 7f32d77fe640 1 -- 172.21.15.1:0/2310395199 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f32d81e9680 msgr2=0x7f32d815ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:34.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.231+0000 7f32d77fe640 1 --2- 172.21.15.1:0/2310395199 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f32d81e9680 0x7f32d815ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:34.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.231+0000 7f32d77fe640 1 -- 172.21.15.1:0/2310395199 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f32d80cc590 msgr2=0x7f32d815f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:34.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.231+0000 7f32d77fe640 1 --2- 172.21.15.1:0/2310395199 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f32d80cc590 0x7f32d815f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:34.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.231+0000 7f32d77fe640 1 -- 172.21.15.1:0/2310395199 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32d815dff0 con 0x7f32d80c7da0 2024-05-04T02:20:34.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.233+0000 7f32d77fe640 1 --2- 172.21.15.1:0/2310395199 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f32d80c7da0 0x7f32d815dab0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f32c800e840 tx=0x7f32c800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:34.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.237+0000 7f32bffff640 1 -- 172.21.15.1:0/2310395199 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c8017070 con 0x7f32d80c7da0 2024-05-04T02:20:34.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.237+0000 7f32bffff640 1 -- 172.21.15.1:0/2310395199 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32c800c940 con 0x7f32d80c7da0 2024-05-04T02:20:34.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.237+0000 7f32bffff640 1 -- 172.21.15.1:0/2310395199 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c800cd10 con 0x7f32d80c7da0 2024-05-04T02:20:34.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.237+0000 7f32ddf76640 1 -- 172.21.15.1:0/2310395199 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32d814e200 con 0x7f32d80c7da0 2024-05-04T02:20:34.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.237+0000 7f32ddf76640 1 -- 172.21.15.1:0/2310395199 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32d814f2e0 con 0x7f32d80c7da0 2024-05-04T02:20:34.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.238+0000 7f32ddf76640 1 -- 172.21.15.1:0/2310395199 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32d8069bc0 con 0x7f32d80c7da0 2024-05-04T02:20:34.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.261+0000 7f32bffff640 1 -- 172.21.15.1:0/2310395199 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f32c801a070 con 0x7f32d80c7da0 2024-05-04T02:20:34.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.261+0000 7f32bffff640 1 --2- 172.21.15.1:0/2310395199 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f32c4076320 0x7f32c4078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:34.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.262+0000 7f32d6ffd640 1 --2- 172.21.15.1:0/2310395199 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f32c4076320 0x7f32c4078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:34.264 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.262+0000 7f32d6ffd640 1 --2- 172.21.15.1:0/2310395199 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f32c4076320 0x7f32c4078830 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f32cc005880 tx=0x7f32cc006aa0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:34.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.265+0000 7f32bffff640 1 -- 172.21.15.1:0/2310395199 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f32c805d130 con 0x7f32d80c7da0 2024-05-04T02:20:34.552 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.550+0000 7f32bffff640 1 -- 172.21.15.1:0/2310395199 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f32c8060ea0 con 0x7f32d80c7da0 2024-05-04T02:20:34.784 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.782+0000 7f32ddf76640 1 -- 172.21.15.1:0/2310395199 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f32d8159e50 con 0x7f32d80c7da0 2024-05-04T02:20:34.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.788+0000 7f32bffff640 1 -- 172.21.15.1:0/2310395199 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f32c80651a0 con 0x7f32d80c7da0 2024-05-04T02:20:34.791 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:20:34.791 INFO:teuthology.orchestra.run.smithi001.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-04T02:20:34.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.790+0000 7f32ddf76640 1 -- 172.21.15.1:0/2310395199 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f32c4076320 msgr2=0x7f32c4078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:34.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.791+0000 7f32ddf76640 1 --2- 172.21.15.1:0/2310395199 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f32c4076320 0x7f32c4078830 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f32cc005880 tx=0x7f32cc006aa0 comp rx=0 tx=0).stop 2024-05-04T02:20:34.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.791+0000 7f32ddf76640 1 -- 172.21.15.1:0/2310395199 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f32d80c7da0 msgr2=0x7f32d815dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:34.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.791+0000 7f32ddf76640 1 --2- 172.21.15.1:0/2310395199 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f32d80c7da0 0x7f32d815dab0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f32c800e840 tx=0x7f32c800ed00 comp rx=0 tx=0).stop 2024-05-04T02:20:34.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.791+0000 7f32ddf76640 1 -- 172.21.15.1:0/2310395199 shutdown_connections 2024-05-04T02:20:34.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.791+0000 7f32ddf76640 1 --2- 172.21.15.1:0/2310395199 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f32c4076320 0x7f32c4078830 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:34.793 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.791+0000 7f32ddf76640 1 --2- 172.21.15.1:0/2310395199 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f32d81e9680 0x7f32d815ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:34.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.791+0000 7f32ddf76640 1 --2- 172.21.15.1:0/2310395199 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f32d80cc590 0x7f32d815f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:34.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.791+0000 7f32ddf76640 1 --2- 172.21.15.1:0/2310395199 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f32d80c7da0 0x7f32d815dab0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:34.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.791+0000 7f32ddf76640 1 -- 172.21.15.1:0/2310395199 >> 172.21.15.1:0/2310395199 conn(0x7f32d80d2590 msgr2=0x7f32d815cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:34.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.791+0000 7f32ddf76640 1 -- 172.21.15.1:0/2310395199 shutdown_connections 2024-05-04T02:20:34.794 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.791+0000 7f32ddf76640 1 -- 172.21.15.1:0/2310395199 wait complete. 2024-05-04T02:20:34.804 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-05-04T02:20:34.804 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-04T02:20:34.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.914+0000 7f94de39d640 1 Processor -- start 2024-05-04T02:20:34.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.914+0000 7f94de39d640 1 -- start start 2024-05-04T02:20:34.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.916+0000 7f94de39d640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f94d815a110 0x7f94d80cb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:34.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.916+0000 7f94de39d640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f94d80ca240 0x7f94d80ca650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:34.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.916+0000 7f94de39d640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f94d80702d0 0x7f94d80706e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:34.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.916+0000 7f94de39d640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f94d80cb360 con 0x7f94d815a110 2024-05-04T02:20:34.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.916+0000 7f94de39d640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f94d815b0d0 con 0x7f94d80702d0 2024-05-04T02:20:34.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.916+0000 7f94de39d640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f94d815a830 con 0x7f94d80ca240 2024-05-04T02:20:34.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.939+0000 7f94ddb9c640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f94d80702d0 0x7f94d80706e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:34.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.939+0000 7f94ddb9c640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f94d80702d0 0x7f94d80706e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.1:56896/0 (socket says 172.21.15.1:56896) 2024-05-04T02:20:34.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.939+0000 7f94ddb9c640 1 -- 172.21.15.1:0/1583785315 learned_addr learned my addr 172.21.15.1:0/1583785315 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:34.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.942+0000 7f94ddb9c640 1 -- 172.21.15.1:0/1583785315 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f94d80ca240 msgr2=0x7f94d80ca650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:34.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.942+0000 7f94ddb9c640 1 --2- 172.21.15.1:0/1583785315 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f94d80ca240 0x7f94d80ca650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:34.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.942+0000 7f94ddb9c640 1 -- 172.21.15.1:0/1583785315 >> v2:172.21.15.1:3300/0 conn(0x7f94d815a110 msgr2=0x7f94d80cb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:34.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.942+0000 7f94ddb9c640 1 --2- 172.21.15.1:0/1583785315 >> v2:172.21.15.1:3300/0 conn(0x7f94d815a110 0x7f94d80cb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:34.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.942+0000 7f94ddb9c640 1 -- 172.21.15.1:0/1583785315 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94d815ab10 con 0x7f94d80702d0 2024-05-04T02:20:34.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.944+0000 7f94ddb9c640 1 --2- 172.21.15.1:0/1583785315 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94d80702d0 0x7f94d80706e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f94d806e020 tx=0x7f94d002a610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5bc4f0394ddc41da server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:34.952 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.950+0000 7f94cffff640 1 -- 172.21.15.1:0/1583785315 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d0036070 con 0x7f94d80702d0 2024-05-04T02:20:34.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.950+0000 7f94cffff640 1 -- 172.21.15.1:0/1583785315 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94d0031600 con 0x7f94d80702d0 2024-05-04T02:20:34.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.950+0000 7f94cffff640 1 -- 172.21.15.1:0/1583785315 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d00319d0 con 0x7f94d80702d0 2024-05-04T02:20:34.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.951+0000 7f94de39d640 1 -- 172.21.15.1:0/1583785315 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94d80702d0 msgr2=0x7f94d80706e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:34.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.951+0000 7f94de39d640 1 --2- 172.21.15.1:0/1583785315 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94d80702d0 0x7f94d80706e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f94d806e020 tx=0x7f94d002a610 comp rx=0 tx=0).stop 2024-05-04T02:20:34.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.951+0000 7f94de39d640 1 -- 172.21.15.1:0/1583785315 shutdown_connections 2024-05-04T02:20:34.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.951+0000 7f94de39d640 1 --2- 172.21.15.1:0/1583785315 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94d80702d0 0x7f94d80706e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:34.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.951+0000 7f94de39d640 1 --2- 172.21.15.1:0/1583785315 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f94d80ca240 0x7f94d80ca650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:34.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.951+0000 7f94de39d640 1 --2- 172.21.15.1:0/1583785315 >> v2:172.21.15.1:3300/0 conn(0x7f94d815a110 0x7f94d80cb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:34.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.951+0000 7f94de39d640 1 -- 172.21.15.1:0/1583785315 >> 172.21.15.1:0/1583785315 conn(0x7f94d80cf880 msgr2=0x7f94d80cfc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:34.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.951+0000 7f94de39d640 1 -- 172.21.15.1:0/1583785315 shutdown_connections 2024-05-04T02:20:34.954 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.951+0000 7f94de39d640 1 -- 172.21.15.1:0/1583785315 wait complete. 2024-05-04T02:20:34.955 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.953+0000 7f94de39d640 1 Processor -- start 2024-05-04T02:20:34.955 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.953+0000 7f94de39d640 1 -- start start 2024-05-04T02:20:34.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.954+0000 7f94de39d640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f94d80702d0 0x7f94d81f0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:34.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.954+0000 7f94de39d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94d80ca240 0x7f94d81e5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:34.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.954+0000 7f94de39d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f94d815a110 0x7f94d8148360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:34.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.954+0000 7f94de39d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f94d815a520 con 0x7f94d815a110 2024-05-04T02:20:34.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.954+0000 7f94de39d640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f94d80caff0 con 0x7f94d80ca240 2024-05-04T02:20:34.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.954+0000 7f94de39d640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f94d8071870 con 0x7f94d80702d0 2024-05-04T02:20:34.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.955+0000 7f94ddb9c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f94d815a110 0x7f94d8148360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:34.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.955+0000 7f94dd39b640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f94d80702d0 0x7f94d81f0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:34.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.955+0000 7f94ddb9c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f94d815a110 0x7f94d8148360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40920/0 (socket says 172.21.15.1:40920) 2024-05-04T02:20:34.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.955+0000 7f94dcb9a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94d80ca240 0x7f94d81e5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:34.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.955+0000 7f94ddb9c640 1 -- 172.21.15.1:0/3687501191 learned_addr learned my addr 172.21.15.1:0/3687501191 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:34.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.959+0000 7f94ddb9c640 1 -- 172.21.15.1:0/3687501191 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f94d80702d0 msgr2=0x7f94d81f0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:34.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.959+0000 7f94ddb9c640 1 --2- 172.21.15.1:0/3687501191 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f94d80702d0 0x7f94d81f0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:34.961 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.959+0000 7f94ddb9c640 1 -- 172.21.15.1:0/3687501191 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94d80ca240 msgr2=0x7f94d81e5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:34.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.959+0000 7f94ddb9c640 1 --2- 172.21.15.1:0/3687501191 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94d80ca240 0x7f94d81e5740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:34.962 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.959+0000 7f94ddb9c640 1 -- 172.21.15.1:0/3687501191 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94d81488a0 con 0x7f94d815a110 2024-05-04T02:20:34.963 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.962+0000 7f94ddb9c640 1 --2- 172.21.15.1:0/3687501191 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f94d815a110 0x7f94d8148360 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f94d0009f40 tx=0x7f94d0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:34.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.966+0000 7f94cdffb640 1 -- 172.21.15.1:0/3687501191 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d0036050 con 0x7f94d815a110 2024-05-04T02:20:34.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.966+0000 7f94cdffb640 1 -- 172.21.15.1:0/3687501191 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94d0042070 con 0x7f94d815a110 2024-05-04T02:20:34.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.966+0000 7f94de39d640 1 -- 172.21.15.1:0/3687501191 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94d814aef0 con 0x7f94d815a110 2024-05-04T02:20:34.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.966+0000 7f94cdffb640 1 -- 172.21.15.1:0/3687501191 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d0009510 con 0x7f94d815a110 2024-05-04T02:20:34.968 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.966+0000 7f94de39d640 1 -- 172.21.15.1:0/3687501191 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94d80cdbe0 con 0x7f94d815a110 2024-05-04T02:20:34.969 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.967+0000 7f94de39d640 1 -- 172.21.15.1:0/3687501191 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94d80cd650 con 0x7f94d815a110 2024-05-04T02:20:34.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.991+0000 7f94cdffb640 1 -- 172.21.15.1:0/3687501191 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f94d0007bd0 con 0x7f94d815a110 2024-05-04T02:20:34.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.991+0000 7f94cdffb640 1 --2- 172.21.15.1:0/3687501191 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f94bc0762d0 0x7f94bc0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:34.993 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.991+0000 7f94dd39b640 1 --2- 172.21.15.1:0/3687501191 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f94bc0762d0 0x7f94bc0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:34.994 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.992+0000 7f94dd39b640 1 --2- 172.21.15.1:0/3687501191 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f94bc0762d0 0x7f94bc0787e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f94c80098e0 tx=0x7f94c8009060 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:34.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:34.995+0000 7f94cdffb640 1 -- 172.21.15.1:0/3687501191 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f94d007e570 con 0x7f94d815a110 2024-05-04T02:20:35.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:35.283+0000 7f94cdffb640 1 -- 172.21.15.1:0/3687501191 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f94d81488a0 con 0x7f94d815a110 2024-05-04T02:20:35.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:35.514+0000 7f94de39d640 1 -- 172.21.15.1:0/3687501191 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f94d80762f0 con 0x7f94d815a110 2024-05-04T02:20:35.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:35.529+0000 7f94cdffb640 1 -- 172.21.15.1:0/3687501191 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+6818 (secure 0 0 0) 0x7f94d00822e0 con 0x7f94d815a110 2024-05-04T02:20:35.532 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:20:35.532 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4214,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/2012070226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":2012070226},{"type":"v1","addr":"172.21.15.107:6837","nonce":2012070226}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4217,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/779417024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":779417024},{"type":"v1","addr":"172.21.15.107:6836","nonce":779417024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4223,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/4178520860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":4178520860},{"type":"v1","addr":"172.21.15.1:6837","nonce":4178520860}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4273,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6833/410847489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":410847489},{"type":"v1","addr":"172.21.15.1:6833","nonce":410847489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/1145100080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":1145100080},{"type":"v1","addr":"172.21.15.1:6835","nonce":1145100080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-04T02:20:15.309997+0000","modified":"2024-05-04T02:20:21.184612+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.107:6839/1807033208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":1807033208},{"type":"v1","addr":"172.21.15.107:6839","nonce":1807033208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4285,"qdb_cluster":[4285]},"id":1}]} 2024-05-04T02:20:35.532 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 7 2024-05-04T02:20:35.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:35.531+0000 7f94de39d640 1 -- 172.21.15.1:0/3687501191 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f94bc0762d0 msgr2=0x7f94bc0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:35.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:35.531+0000 7f94de39d640 1 --2- 172.21.15.1:0/3687501191 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f94bc0762d0 0x7f94bc0787e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f94c80098e0 tx=0x7f94c8009060 comp rx=0 tx=0).stop 2024-05-04T02:20:35.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:35.531+0000 7f94de39d640 1 -- 172.21.15.1:0/3687501191 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f94d815a110 msgr2=0x7f94d8148360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:35.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:35.531+0000 7f94de39d640 1 --2- 172.21.15.1:0/3687501191 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f94d815a110 0x7f94d8148360 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f94d0009f40 tx=0x7f94d0004a40 comp rx=0 tx=0).stop 2024-05-04T02:20:35.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:35.531+0000 7f94de39d640 1 -- 172.21.15.1:0/3687501191 shutdown_connections 2024-05-04T02:20:35.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:35.531+0000 7f94de39d640 1 --2- 172.21.15.1:0/3687501191 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f94bc0762d0 0x7f94bc0787e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:35.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:35.531+0000 7f94de39d640 1 --2- 172.21.15.1:0/3687501191 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f94d815a110 0x7f94d8148360 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:35.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:35.531+0000 7f94de39d640 1 --2- 172.21.15.1:0/3687501191 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f94d80ca240 0x7f94d81e5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:35.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:35.531+0000 7f94de39d640 1 --2- 172.21.15.1:0/3687501191 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f94d80702d0 0x7f94d81f0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:35.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:35.531+0000 7f94de39d640 1 -- 172.21.15.1:0/3687501191 >> 172.21.15.1:0/3687501191 conn(0x7f94d80cf880 msgr2=0x7f94d80b2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:35.535 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:35.531+0000 7f94de39d640 1 -- 172.21.15.1:0/3687501191 shutdown_connections 2024-05-04T02:20:35.535 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:35.531+0000 7f94de39d640 1 -- 172.21.15.1:0/3687501191 wait complete. 2024-05-04T02:20:35.545 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-04T02:20:35.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:35.655+0000 7f004114d640 1 Processor -- start 2024-05-04T02:20:35.657 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:35.655+0000 7f004114d640 1 -- start start 2024-05-04T02:20:35.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:35.656+0000 7f004114d640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f003c0cde50 0x7f003c15cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:35.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:35.656+0000 7f004114d640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f003c0c7da0 0x7f003c06c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:35.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:35.656+0000 7f004114d640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f003c0cd6c0 con 0x7f003c0cc590 2024-05-04T02:20:35.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:35.656+0000 7f004114d640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f003c0c7070 con 0x7f003c0c7da0 2024-05-04T02:20:35.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:35.656+0000 7f004114d640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f003c06cc30 con 0x7f003c0cde50 2024-05-04T02:20:35.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:35.657+0000 7f0033fff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f003c0c7da0 0x7f003c06c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:35.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:35.657+0000 7f003ad9d640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f003c0cde50 0x7f003c15cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:35.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:35.657+0000 7f003b59e640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f003c0cc590 0x7f003c15fb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.1:39034/0 (socket says 172.21.15.1:39034) 2024-05-04T02:20:35.660 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:35.657+0000 7f003b59e640 1 -- 172.21.15.1:0/4263257340 learned_addr learned my addr 172.21.15.1:0/4263257340 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-05-04T02:20:35.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:35.660+0000 7f003a59c640 1 -- 172.21.15.1:0/4263257340 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2647052614 0 0) 0x7f003c0cd6c0 con 0x7f003c0cc590 2024-05-04T02:20:35.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:35.660+0000 7f003a59c640 1 -- 172.21.15.1:0/4263257340 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0028003520 con 0x7f003c0cc590 2024-05-04T02:20:35.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:35.660+0000 7f0033fff640 1 -- 172.21.15.1:0/4263257340 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f003c0cde50 msgr2=0x7f003c15cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:35.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:35.660+0000 7f0033fff640 1 --2- 172.21.15.1:0/4263257340 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f003c0cde50 0x7f003c15cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:35.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:35.660+0000 7f0033fff640 1 -- 172.21.15.1:0/4263257340 >> v1:172.21.15.107:6789/0 conn(0x7f003c0cc590 legacy=0x7f003c15fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:35.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:35.660+0000 7f0033fff640 1 -- 172.21.15.1:0/4263257340 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f003c0cd980 con 0x7f003c0c7da0 2024-05-04T02:20:35.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:35.660+0000 7f003ad9d640 1 --2- 172.21.15.1:0/4263257340 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f003c0cde50 0x7f003c15cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-04T02:20:35.665 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:35.663+0000 7f0033fff640 1 --2- 172.21.15.1:0/4263257340 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f003c0c7da0 0x7f003c06c6f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f00240097a0 tx=0x7f002402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e92a0d486af7b1c3 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:35.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:35.666+0000 7f003a59c640 1 -- 172.21.15.1:0/4263257340 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0024037070 con 0x7f003c0c7da0 2024-05-04T02:20:35.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:35.666+0000 7f003a59c640 1 -- 172.21.15.1:0/4263257340 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0024032440 con 0x7f003c0c7da0 2024-05-04T02:20:35.668 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:35.666+0000 7f003a59c640 1 -- 172.21.15.1:0/4263257340 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0024032810 con 0x7f003c0c7da0 2024-05-04T02:20:35.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:35.667+0000 7f004114d640 1 -- 172.21.15.1:0/4263257340 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f003c0c7da0 msgr2=0x7f003c06c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:35.669 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:35.667+0000 7f004114d640 1 --2- 172.21.15.1:0/4263257340 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f003c0c7da0 0x7f003c06c6f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f00240097a0 tx=0x7f002402a210 comp rx=0 tx=0).stop 2024-05-04T02:20:35.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:35.667+0000 7f004114d640 1 -- 172.21.15.1:0/4263257340 shutdown_connections 2024-05-04T02:20:35.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:35.667+0000 7f004114d640 1 --2- 172.21.15.1:0/4263257340 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f003c0c7da0 0x7f003c06c6f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:35.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:35.667+0000 7f004114d640 1 --2- 172.21.15.1:0/4263257340 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f003c0cde50 0x7f003c15cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:35.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:35.667+0000 7f004114d640 1 -- 172.21.15.1:0/4263257340 >> 172.21.15.1:0/4263257340 conn(0x7f003c0d2590 msgr2=0x7f003c0ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:35.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:35.667+0000 7f004114d640 1 -- 172.21.15.1:0/4263257340 shutdown_connections 2024-05-04T02:20:35.670 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:35.667+0000 7f004114d640 1 -- 172.21.15.1:0/4263257340 wait complete. 2024-05-04T02:20:35.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:35.669+0000 7f004114d640 1 Processor -- start 2024-05-04T02:20:35.671 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:35.669+0000 7f004114d640 1 -- start start 2024-05-04T02:20:35.672 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:35.670+0000 7f004114d640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f003c0c7da0 0x7f003c1f2360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:35.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:35.670+0000 7f004114d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f003c0cc590 0x7f003c0caaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:35.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:35.670+0000 7f004114d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f003c151b80 0x7f003c0cafe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:35.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:35.670+0000 7f004114d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f003c0c7880 con 0x7f003c0cc590 2024-05-04T02:20:35.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:35.670+0000 7f004114d640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f003c0c75a0 con 0x7f003c151b80 2024-05-04T02:20:35.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:35.670+0000 7f004114d640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f003c156b40 con 0x7f003c0c7da0 2024-05-04T02:20:35.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:35.671+0000 7f0033fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f003c0cc590 0x7f003c0caaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:35.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:35.671+0000 7f003b59e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f003c151b80 0x7f003c0cafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:35.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:35.671+0000 7f003ad9d640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f003c0c7da0 0x7f003c1f2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:35.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:35.671+0000 7f0033fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f003c0cc590 0x7f003c0caaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40938/0 (socket says 172.21.15.1:40938) 2024-05-04T02:20:35.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:35.671+0000 7f0033fff640 1 -- 172.21.15.1:0/1458961263 learned_addr learned my addr 172.21.15.1:0/1458961263 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:35.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:35.675+0000 7f0033fff640 1 -- 172.21.15.1:0/1458961263 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f003c0c7da0 msgr2=0x7f003c1f2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:35.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:35.675+0000 7f0033fff640 1 --2- 172.21.15.1:0/1458961263 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f003c0c7da0 0x7f003c1f2360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:35.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:35.675+0000 7f0033fff640 1 -- 172.21.15.1:0/1458961263 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f003c151b80 msgr2=0x7f003c0cafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:35.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:35.675+0000 7f0033fff640 1 --2- 172.21.15.1:0/1458961263 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f003c151b80 0x7f003c0cafe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:35.678 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:35.675+0000 7f0033fff640 1 -- 172.21.15.1:0/1458961263 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f003c1f28a0 con 0x7f003c0cc590 2024-05-04T02:20:35.680 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:35.678+0000 7f0033fff640 1 --2- 172.21.15.1:0/1458961263 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f003c0cc590 0x7f003c0caaa0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0024009890 tx=0x7f00240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:35.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:35.682+0000 7f00337fe640 1 -- 172.21.15.1:0/1458961263 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0024037050 con 0x7f003c0cc590 2024-05-04T02:20:35.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:35.682+0000 7f00337fe640 1 -- 172.21.15.1:0/1458961263 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0024043070 con 0x7f003c0cc590 2024-05-04T02:20:35.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:35.682+0000 7f00337fe640 1 -- 172.21.15.1:0/1458961263 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f002403cb30 con 0x7f003c0cc590 2024-05-04T02:20:35.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:35.682+0000 7f004114d640 1 -- 172.21.15.1:0/1458961263 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f003c0d1580 con 0x7f003c0cc590 2024-05-04T02:20:35.684 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:35.682+0000 7f004114d640 1 -- 172.21.15.1:0/1458961263 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f003c1f5bb0 con 0x7f003c0cc590 2024-05-04T02:20:35.685 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:35.683+0000 7f004114d640 1 -- 172.21.15.1:0/1458961263 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f003c069bc0 con 0x7f003c0cc590 2024-05-04T02:20:35.709 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:35.707+0000 7f00337fe640 1 -- 172.21.15.1:0/1458961263 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f002403ccd0 con 0x7f003c0cc590 2024-05-04T02:20:35.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:35.708+0000 7f00337fe640 1 --2- 172.21.15.1:0/1458961263 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f001c076320 0x7f001c078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:35.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:35.708+0000 7f003ad9d640 1 --2- 172.21.15.1:0/1458961263 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f001c076320 0x7f001c078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:35.710 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:35.709+0000 7f003ad9d640 1 --2- 172.21.15.1:0/1458961263 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f001c076320 0x7f001c078830 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f002c009560 tx=0x7f002c009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:36.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:35.997+0000 7f00337fe640 1 -- 172.21.15.1:0/1458961263 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f002407e2b0 con 0x7f003c0cc590 2024-05-04T02:20:36.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:35.997+0000 7f00337fe640 1 -- 172.21.15.1:0/1458961263 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0024082020 con 0x7f003c0cc590 2024-05-04T02:20:36.238 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.236+0000 7f004114d640 1 -- 172.21.15.1:0/1458961263 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f003c0c6c40 con 0x7f003c0cc590 2024-05-04T02:20:36.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.251+0000 7f00337fe640 1 -- 172.21.15.1:0/1458961263 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+6818 (secure 0 0 0) 0x7f0024086320 con 0x7f003c0cc590 2024-05-04T02:20:36.253 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:20:36.253 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4214,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/2012070226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":2012070226},{"type":"v1","addr":"172.21.15.107:6837","nonce":2012070226}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4217,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/779417024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":779417024},{"type":"v1","addr":"172.21.15.107:6836","nonce":779417024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4223,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/4178520860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":4178520860},{"type":"v1","addr":"172.21.15.1:6837","nonce":4178520860}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4273,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6833/410847489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":410847489},{"type":"v1","addr":"172.21.15.1:6833","nonce":410847489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/1145100080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":1145100080},{"type":"v1","addr":"172.21.15.1:6835","nonce":1145100080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-04T02:20:15.309997+0000","modified":"2024-05-04T02:20:21.184612+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.107:6839/1807033208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":1807033208},{"type":"v1","addr":"172.21.15.107:6839","nonce":1807033208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4285,"qdb_cluster":[4285]},"id":1}]} 2024-05-04T02:20:36.254 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 7 2024-05-04T02:20:36.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.253+0000 7f004114d640 1 -- 172.21.15.1:0/1458961263 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f001c076320 msgr2=0x7f001c078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:36.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.253+0000 7f004114d640 1 --2- 172.21.15.1:0/1458961263 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f001c076320 0x7f001c078830 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f002c009560 tx=0x7f002c009190 comp rx=0 tx=0).stop 2024-05-04T02:20:36.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.253+0000 7f004114d640 1 -- 172.21.15.1:0/1458961263 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f003c0cc590 msgr2=0x7f003c0caaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:36.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.253+0000 7f004114d640 1 --2- 172.21.15.1:0/1458961263 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f003c0cc590 0x7f003c0caaa0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0024009890 tx=0x7f00240046c0 comp rx=0 tx=0).stop 2024-05-04T02:20:36.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.253+0000 7f004114d640 1 -- 172.21.15.1:0/1458961263 shutdown_connections 2024-05-04T02:20:36.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.253+0000 7f004114d640 1 --2- 172.21.15.1:0/1458961263 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f001c076320 0x7f001c078830 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:36.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.253+0000 7f004114d640 1 --2- 172.21.15.1:0/1458961263 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f003c151b80 0x7f003c0cafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:36.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.253+0000 7f004114d640 1 --2- 172.21.15.1:0/1458961263 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f003c0cc590 0x7f003c0caaa0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:36.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.253+0000 7f004114d640 1 --2- 172.21.15.1:0/1458961263 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f003c0c7da0 0x7f003c1f2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:36.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.253+0000 7f004114d640 1 -- 172.21.15.1:0/1458961263 >> 172.21.15.1:0/1458961263 conn(0x7f003c0d2590 msgr2=0x7f003c06ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:36.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.253+0000 7f004114d640 1 -- 172.21.15.1:0/1458961263 shutdown_connections 2024-05-04T02:20:36.256 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.253+0000 7f004114d640 1 -- 172.21.15.1:0/1458961263 wait complete. 2024-05-04T02:20:36.267 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-04T02:20:36.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.376+0000 7fe7b2ed1640 1 Processor -- start 2024-05-04T02:20:36.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.376+0000 7fe7b2ed1640 1 -- start start 2024-05-04T02:20:36.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.377+0000 7fe7b2ed1640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe7ac1546d0 0x7fe7ac15ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:36.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.377+0000 7fe7b2ed1640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe7ac0cb4d0 0x7fe7ac0cb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:36.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.377+0000 7fe7b2ed1640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7ac15d6e0 con 0x7fe7ac0b5170 2024-05-04T02:20:36.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.377+0000 7fe7b2ed1640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7fe7ac0cbe20 con 0x7fe7ac0cb4d0 2024-05-04T02:20:36.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.377+0000 7fe7b2ed1640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe7ac15b370 con 0x7fe7ac1546d0 2024-05-04T02:20:36.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.378+0000 7fe7b146e640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe7ac0cb4d0 0x7fe7ac0cb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:36.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.378+0000 7fe7abfff640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe7ac1546d0 0x7fe7ac15ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:36.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.378+0000 7fe7b0c6d640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fe7ac0b5170 0x7fe7ac0702a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.1:39044/0 (socket says 172.21.15.1:39044) 2024-05-04T02:20:36.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.378+0000 7fe7b0c6d640 1 -- 172.21.15.1:0/1662859402 learned_addr learned my addr 172.21.15.1:0/1662859402 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-05-04T02:20:36.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.381+0000 7fe7ab7fe640 1 -- 172.21.15.1:0/1662859402 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 24789337 0 0) 0x7fe7ac15d6e0 con 0x7fe7ac0b5170 2024-05-04T02:20:36.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.381+0000 7fe7ab7fe640 1 -- 172.21.15.1:0/1662859402 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe79c003520 con 0x7fe7ac0b5170 2024-05-04T02:20:36.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.381+0000 7fe7b146e640 1 -- 172.21.15.1:0/1662859402 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe7ac1546d0 msgr2=0x7fe7ac15ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:36.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.381+0000 7fe7b146e640 1 --2- 172.21.15.1:0/1662859402 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe7ac1546d0 0x7fe7ac15ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:36.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.381+0000 7fe7b146e640 1 -- 172.21.15.1:0/1662859402 >> v1:172.21.15.107:6789/0 conn(0x7fe7ac0b5170 legacy=0x7fe7ac0702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:36.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.381+0000 7fe7b146e640 1 -- 172.21.15.1:0/1662859402 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7ac0ca190 con 0x7fe7ac0cb4d0 2024-05-04T02:20:36.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.383+0000 7fe7b146e640 1 --2- 172.21.15.1:0/1662859402 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe7ac0cb4d0 0x7fe7ac0cb8e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe7a4009d90 tx=0x7fe7a402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be624ab554a74971 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:36.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.387+0000 7fe7ab7fe640 1 -- 172.21.15.1:0/1662859402 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7a4007740 con 0x7fe7ac0cb4d0 2024-05-04T02:20:36.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.387+0000 7fe7ab7fe640 1 -- 172.21.15.1:0/1662859402 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7a40078e0 con 0x7fe7ac0cb4d0 2024-05-04T02:20:36.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.387+0000 7fe7ab7fe640 1 -- 172.21.15.1:0/1662859402 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7a4007cb0 con 0x7fe7ac0cb4d0 2024-05-04T02:20:36.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.388+0000 7fe7b2ed1640 1 -- 172.21.15.1:0/1662859402 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe7ac0cb4d0 msgr2=0x7fe7ac0cb8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:36.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.388+0000 7fe7b2ed1640 1 --2- 172.21.15.1:0/1662859402 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe7ac0cb4d0 0x7fe7ac0cb8e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe7a4009d90 tx=0x7fe7a402a660 comp rx=0 tx=0).stop 2024-05-04T02:20:36.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.388+0000 7fe7b2ed1640 1 -- 172.21.15.1:0/1662859402 shutdown_connections 2024-05-04T02:20:36.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.388+0000 7fe7b2ed1640 1 --2- 172.21.15.1:0/1662859402 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe7ac0cb4d0 0x7fe7ac0cb8e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:36.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.388+0000 7fe7b2ed1640 1 --2- 172.21.15.1:0/1662859402 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe7ac1546d0 0x7fe7ac15ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:36.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.388+0000 7fe7b2ed1640 1 -- 172.21.15.1:0/1662859402 >> 172.21.15.1:0/1662859402 conn(0x7fe7ac0cf6e0 msgr2=0x7fe7ac0cfaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:36.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.388+0000 7fe7b2ed1640 1 -- 172.21.15.1:0/1662859402 shutdown_connections 2024-05-04T02:20:36.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.388+0000 7fe7b2ed1640 1 -- 172.21.15.1:0/1662859402 wait complete. 2024-05-04T02:20:36.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.390+0000 7fe7b2ed1640 1 Processor -- start 2024-05-04T02:20:36.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.390+0000 7fe7b2ed1640 1 -- start start 2024-05-04T02:20:36.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.391+0000 7fe7b2ed1640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe7ac0b5170 0x7fe7ac0c69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:36.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.391+0000 7fe7b2ed1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7ac0cb4d0 0x7fe7ac0c5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:36.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.391+0000 7fe7b2ed1640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe7ac1546d0 0x7fe7ac14d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:36.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.391+0000 7fe7b2ed1640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe7ac0ca9f0 con 0x7fe7ac0b5170 2024-05-04T02:20:36.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.391+0000 7fe7b2ed1640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe7ac0ca710 con 0x7fe7ac0cb4d0 2024-05-04T02:20:36.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.391+0000 7fe7b2ed1640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe7ac0cacd0 con 0x7fe7ac1546d0 2024-05-04T02:20:36.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.392+0000 7fe7b0c6d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe7ac0b5170 0x7fe7ac0c69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:36.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.392+0000 7fe7b0c6d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe7ac0b5170 0x7fe7ac0c69e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40962/0 (socket says 172.21.15.1:40962) 2024-05-04T02:20:36.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.392+0000 7fe7b0c6d640 1 -- 172.21.15.1:0/4179935864 learned_addr learned my addr 172.21.15.1:0/4179935864 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:36.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.392+0000 7fe7b146e640 1 --2- 172.21.15.1:0/4179935864 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe7ac1546d0 0x7fe7ac14d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:36.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.392+0000 7fe7abfff640 1 --2- 172.21.15.1:0/4179935864 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7ac0cb4d0 0x7fe7ac0c5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:36.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.396+0000 7fe7b0c6d640 1 -- 172.21.15.1:0/4179935864 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe7ac1546d0 msgr2=0x7fe7ac14d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:36.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.396+0000 7fe7b0c6d640 1 --2- 172.21.15.1:0/4179935864 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe7ac1546d0 0x7fe7ac14d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:36.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.396+0000 7fe7b0c6d640 1 -- 172.21.15.1:0/4179935864 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7ac0cb4d0 msgr2=0x7fe7ac0c5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:36.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.396+0000 7fe7b0c6d640 1 --2- 172.21.15.1:0/4179935864 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7ac0cb4d0 0x7fe7ac0c5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:36.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.396+0000 7fe7b0c6d640 1 -- 172.21.15.1:0/4179935864 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7ac0c6f20 con 0x7fe7ac0b5170 2024-05-04T02:20:36.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.398+0000 7fe7b0c6d640 1 --2- 172.21.15.1:0/4179935864 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe7ac0b5170 0x7fe7ac0c69e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe7a000c440 tx=0x7fe7a000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:36.404 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.402+0000 7fe7a97fa640 1 -- 172.21.15.1:0/4179935864 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7a0017070 con 0x7fe7ac0b5170 2024-05-04T02:20:36.404 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.402+0000 7fe7a97fa640 1 -- 172.21.15.1:0/4179935864 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7a0005ce0 con 0x7fe7ac0b5170 2024-05-04T02:20:36.404 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.402+0000 7fe7b2ed1640 1 -- 172.21.15.1:0/4179935864 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7ac1e3b90 con 0x7fe7ac0b5170 2024-05-04T02:20:36.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.402+0000 7fe7a97fa640 1 -- 172.21.15.1:0/4179935864 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7a0007270 con 0x7fe7ac0b5170 2024-05-04T02:20:36.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.402+0000 7fe7b2ed1640 1 -- 172.21.15.1:0/4179935864 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7ac1531b0 con 0x7fe7ac0b5170 2024-05-04T02:20:36.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.403+0000 7fe7b2ed1640 1 -- 172.21.15.1:0/4179935864 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7ac076740 con 0x7fe7ac0b5170 2024-05-04T02:20:36.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.427+0000 7fe7a97fa640 1 -- 172.21.15.1:0/4179935864 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe7a001a070 con 0x7fe7ac0b5170 2024-05-04T02:20:36.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.427+0000 7fe7a97fa640 1 --2- 172.21.15.1:0/4179935864 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fe790076300 0x7fe790078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:36.429 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.427+0000 7fe7abfff640 1 --2- 172.21.15.1:0/4179935864 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fe790076300 0x7fe790078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:36.430 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.428+0000 7fe7abfff640 1 --2- 172.21.15.1:0/4179935864 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fe790076300 0x7fe790078810 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac0d0120 tx=0x7fe798009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:36.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.729+0000 7fe7a97fa640 1 -- 172.21.15.1:0/4179935864 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fe7a005c2a0 con 0x7fe7ac0b5170 2024-05-04T02:20:36.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.729+0000 7fe7a97fa640 1 -- 172.21.15.1:0/4179935864 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe7a0060010 con 0x7fe7ac0b5170 2024-05-04T02:20:36.938 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.936+0000 7fe7b2ed1640 1 -- 172.21.15.1:0/4179935864 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe7ac0cfe70 con 0x7fe7ac0b5170 2024-05-04T02:20:36.980 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.978+0000 7fe7a97fa640 1 -- 172.21.15.1:0/4179935864 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16545 (secure 0 0 0) 0x7fe7a0064310 con 0x7fe7ac0b5170 2024-05-04T02:20:36.981 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:20:36.981 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":23,"fsid":"b45b4a9a-b84c-4a66-907b-43f0ca45e7c0","created":"2024-05-04T02:19:44.555410+0000","modified":"2024-05-04T02:20:17.793991+0000","last_up_change":"2024-05-04T02:20:00.162760+0000","last_in_change":"2024-05-04T02:19:50.811018+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-04T02:19:59.664283+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-04T02:20:12.783217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-04T02:20:13.872502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d8ad7964-7bd6-4ba9-ae4f-b55d7566b18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":2338132980},{"type":"v1","addr":"172.21.15.1:6801","nonce":2338132980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":2338132980},{"type":"v1","addr":"172.21.15.1:6803","nonce":2338132980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":2338132980},{"type":"v1","addr":"172.21.15.1:6807","nonce":2338132980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":2338132980},{"type":"v1","addr":"172.21.15.1:6805","nonce":2338132980}]},"public_addr":"172.21.15.1:6801/2338132980","cluster_addr":"172.21.15.1:6803/2338132980","heartbeat_back_addr":"172.21.15.1:6807/2338132980","heartbeat_front_addr":"172.21.15.1:6805/2338132980","state":["exists","up"]},{"osd":1,"uuid":"ce155f6d-7e0c-47c8-a0e0-fb53ff0c7726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":459131368},{"type":"v1","addr":"172.21.15.1:6817","nonce":459131368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":459131368},{"type":"v1","addr":"172.21.15.1:6819","nonce":459131368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":459131368},{"type":"v1","addr":"172.21.15.1:6823","nonce":459131368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":459131368},{"type":"v1","addr":"172.21.15.1:6821","nonce":459131368}]},"public_addr":"172.21.15.1:6817/459131368","cluster_addr":"172.21.15.1:6819/459131368","heartbeat_back_addr":"172.21.15.1:6823/459131368","heartbeat_front_addr":"172.21.15.1:6821/459131368","state":["exists","up"]},{"osd":2,"uuid":"7847c281-5da0-4d7d-b888-7f49d99a50b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":3463851105},{"type":"v1","addr":"172.21.15.1:6809","nonce":3463851105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":3463851105},{"type":"v1","addr":"172.21.15.1:6811","nonce":3463851105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":3463851105},{"type":"v1","addr":"172.21.15.1:6815","nonce":3463851105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":3463851105},{"type":"v1","addr":"172.21.15.1:6813","nonce":3463851105}]},"public_addr":"172.21.15.1:6809/3463851105","cluster_addr":"172.21.15.1:6811/3463851105","heartbeat_back_addr":"172.21.15.1:6815/3463851105","heartbeat_front_addr":"172.21.15.1:6813/3463851105","state":["exists","up"]},{"osd":3,"uuid":"26386eba-d106-4abe-8d6b-7dccdd106cb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":3859721636},{"type":"v1","addr":"172.21.15.1:6825","nonce":3859721636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":3859721636},{"type":"v1","addr":"172.21.15.1:6827","nonce":3859721636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":3859721636},{"type":"v1","addr":"172.21.15.1:6831","nonce":3859721636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":3859721636},{"type":"v1","addr":"172.21.15.1:6829","nonce":3859721636}]},"public_addr":"172.21.15.1:6825/3859721636","cluster_addr":"172.21.15.1:6827/3859721636","heartbeat_back_addr":"172.21.15.1:6831/3859721636","heartbeat_front_addr":"172.21.15.1:6829/3859721636","state":["exists","up"]},{"osd":4,"uuid":"2ba3d1b3-c5fa-4ff4-bf5d-772e77d79c59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":2335597098},{"type":"v1","addr":"172.21.15.107:6803","nonce":2335597098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":2335597098},{"type":"v1","addr":"172.21.15.107:6805","nonce":2335597098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2335597098},{"type":"v1","addr":"172.21.15.107:6810","nonce":2335597098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":2335597098},{"type":"v1","addr":"172.21.15.107:6807","nonce":2335597098}]},"public_addr":"172.21.15.107:6803/2335597098","cluster_addr":"172.21.15.107:6805/2335597098","heartbeat_back_addr":"172.21.15.107:6810/2335597098","heartbeat_front_addr":"172.21.15.107:6807/2335597098","state":["exists","up"]},{"osd":5,"uuid":"c42646eb-6e14-4b42-a7a3-54f99f1662bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":1274544305},{"type":"v1","addr":"172.21.15.107:6819","nonce":1274544305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":1274544305},{"type":"v1","addr":"172.21.15.107:6821","nonce":1274544305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":1274544305},{"type":"v1","addr":"172.21.15.107:6825","nonce":1274544305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":1274544305},{"type":"v1","addr":"172.21.15.107:6823","nonce":1274544305}]},"public_addr":"172.21.15.107:6819/1274544305","cluster_addr":"172.21.15.107:6821/1274544305","heartbeat_back_addr":"172.21.15.107:6825/1274544305","heartbeat_front_addr":"172.21.15.107:6823/1274544305","state":["exists","up"]},{"osd":6,"uuid":"a8a2dbb8-0107-4b8e-93c3-5fa7e6af15a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6809","nonce":941385299},{"type":"v1","addr":"172.21.15.107:6811","nonce":941385299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":941385299},{"type":"v1","addr":"172.21.15.107:6813","nonce":941385299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":941385299},{"type":"v1","addr":"172.21.15.107:6817","nonce":941385299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":941385299},{"type":"v1","addr":"172.21.15.107:6815","nonce":941385299}]},"public_addr":"172.21.15.107:6811/941385299","cluster_addr":"172.21.15.107:6813/941385299","heartbeat_back_addr":"172.21.15.107:6817/941385299","heartbeat_front_addr":"172.21.15.107:6815/941385299","state":["exists","up"]},{"osd":7,"uuid":"3b9bdc70-8831-4df9-8d50-362aa0f02aed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":1723298539},{"type":"v1","addr":"172.21.15.107:6827","nonce":1723298539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":1723298539},{"type":"v1","addr":"172.21.15.107:6829","nonce":1723298539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":1723298539},{"type":"v1","addr":"172.21.15.107:6833","nonce":1723298539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":1723298539},{"type":"v1","addr":"172.21.15.107:6831","nonce":1723298539}]},"public_addr":"172.21.15.107:6827/1723298539","cluster_addr":"172.21.15.107:6829/1723298539","heartbeat_back_addr":"172.21.15.107:6833/1723298539","heartbeat_front_addr":"172.21.15.107:6831/1723298539","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T02:19:56.277538+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T02:19:56.402984+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T02:19:56.374787+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T02:19:56.461914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T02:19:56.384856+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T02:19:56.469958+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T02:19:56.489376+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T02:19:56.393205+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-04T02:20:36.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.981+0000 7fe7b2ed1640 1 -- 172.21.15.1:0/4179935864 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fe790076300 msgr2=0x7fe790078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:36.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.981+0000 7fe7b2ed1640 1 --2- 172.21.15.1:0/4179935864 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fe790076300 0x7fe790078810 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac0d0120 tx=0x7fe798009190 comp rx=0 tx=0).stop 2024-05-04T02:20:36.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.981+0000 7fe7b2ed1640 1 -- 172.21.15.1:0/4179935864 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe7ac0b5170 msgr2=0x7fe7ac0c69e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:36.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.981+0000 7fe7b2ed1640 1 --2- 172.21.15.1:0/4179935864 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe7ac0b5170 0x7fe7ac0c69e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe7a000c440 tx=0x7fe7a000c900 comp rx=0 tx=0).stop 2024-05-04T02:20:36.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.981+0000 7fe7b2ed1640 1 -- 172.21.15.1:0/4179935864 shutdown_connections 2024-05-04T02:20:36.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.981+0000 7fe7b2ed1640 1 --2- 172.21.15.1:0/4179935864 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fe790076300 0x7fe790078810 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:36.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.981+0000 7fe7b2ed1640 1 --2- 172.21.15.1:0/4179935864 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe7ac1546d0 0x7fe7ac14d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:36.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.981+0000 7fe7b2ed1640 1 --2- 172.21.15.1:0/4179935864 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7ac0cb4d0 0x7fe7ac0c5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:36.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.981+0000 7fe7b2ed1640 1 --2- 172.21.15.1:0/4179935864 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe7ac0b5170 0x7fe7ac0c69e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:36.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.981+0000 7fe7b2ed1640 1 -- 172.21.15.1:0/4179935864 >> 172.21.15.1:0/4179935864 conn(0x7fe7ac0cf6e0 msgr2=0x7fe7ac0ce3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:36.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.981+0000 7fe7b2ed1640 1 -- 172.21.15.1:0/4179935864 shutdown_connections 2024-05-04T02:20:36.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:36.981+0000 7fe7b2ed1640 1 -- 172.21.15.1:0/4179935864 wait complete. 2024-05-04T02:20:36.995 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-04T02:20:37.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:37.105+0000 7fe631043640 1 Processor -- start 2024-05-04T02:20:37.107 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:37.105+0000 7fe631043640 1 -- start start 2024-05-04T02:20:37.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:37.106+0000 7fe631043640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe62c156af0 0x7fe62c0b73c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:37.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:37.106+0000 7fe631043640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe62c15d090 0x7fe62c0ccfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:37.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:37.106+0000 7fe631043640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe62c0c8d70 con 0x7fe62c0cd500 2024-05-04T02:20:37.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:37.106+0000 7fe631043640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7fe62c0c9c20 con 0x7fe62c156af0 2024-05-04T02:20:37.108 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:37.106+0000 7fe631043640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe62c0c9010 con 0x7fe62c15d090 2024-05-04T02:20:37.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:37.107+0000 7fe623fff640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe62c15d090 0x7fe62c0ccfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:37.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:37.107+0000 7fe62ad9d640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe62c156af0 0x7fe62c0b73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:37.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:37.107+0000 7fe62b59e640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fe62c0cd500 0x7fe62c0ca160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:42056/0 (socket says 172.21.15.1:42056) 2024-05-04T02:20:37.109 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:37.107+0000 7fe62b59e640 1 -- 172.21.15.1:0/3125933078 learned_addr learned my addr 172.21.15.1:0/3125933078 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-05-04T02:20:37.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:37.110+0000 7fe623fff640 1 -- 172.21.15.1:0/3125933078 >> v2:172.21.15.1:3300/0 conn(0x7fe62c156af0 msgr2=0x7fe62c0b73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:37.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:37.110+0000 7fe623fff640 1 --2- 172.21.15.1:0/3125933078 >> v2:172.21.15.1:3300/0 conn(0x7fe62c156af0 0x7fe62c0b73c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:37.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:37.110+0000 7fe623fff640 1 -- 172.21.15.1:0/3125933078 >> v1:172.21.15.1:6789/0 conn(0x7fe62c0cd500 legacy=0x7fe62c0ca160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:37.112 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:37.110+0000 7fe623fff640 1 -- 172.21.15.1:0/3125933078 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe62c0c92f0 con 0x7fe62c15d090 2024-05-04T02:20:37.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:37.112+0000 7fe623fff640 1 --2- 172.21.15.1:0/3125933078 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe62c15d090 0x7fe62c0ccfc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe6140097a0 tx=0x7fe61402a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14b3d6f502fbd8b5 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:37.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:37.116+0000 7fe62a59c640 1 -- 172.21.15.1:0/3125933078 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe614037070 con 0x7fe62c15d090 2024-05-04T02:20:37.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:37.116+0000 7fe62a59c640 1 -- 172.21.15.1:0/3125933078 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe614032440 con 0x7fe62c15d090 2024-05-04T02:20:37.118 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:37.116+0000 7fe62a59c640 1 -- 172.21.15.1:0/3125933078 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe614032810 con 0x7fe62c15d090 2024-05-04T02:20:37.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:37.117+0000 7fe631043640 1 -- 172.21.15.1:0/3125933078 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe62c15d090 msgr2=0x7fe62c0ccfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:37.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:37.117+0000 7fe631043640 1 --2- 172.21.15.1:0/3125933078 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe62c15d090 0x7fe62c0ccfc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe6140097a0 tx=0x7fe61402a210 comp rx=0 tx=0).stop 2024-05-04T02:20:37.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:37.117+0000 7fe631043640 1 -- 172.21.15.1:0/3125933078 shutdown_connections 2024-05-04T02:20:37.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:37.117+0000 7fe631043640 1 --2- 172.21.15.1:0/3125933078 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe62c15d090 0x7fe62c0ccfc0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:37.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:37.117+0000 7fe631043640 1 --2- 172.21.15.1:0/3125933078 >> v2:172.21.15.1:3300/0 conn(0x7fe62c156af0 0x7fe62c0b73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:37.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:37.117+0000 7fe631043640 1 -- 172.21.15.1:0/3125933078 >> 172.21.15.1:0/3125933078 conn(0x7fe62c0ce980 msgr2=0x7fe62c08cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:37.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:37.117+0000 7fe631043640 1 -- 172.21.15.1:0/3125933078 shutdown_connections 2024-05-04T02:20:37.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:37.117+0000 7fe631043640 1 -- 172.21.15.1:0/3125933078 wait complete. 2024-05-04T02:20:37.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:37.119+0000 7fe631043640 1 Processor -- start 2024-05-04T02:20:37.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:37.119+0000 7fe631043640 1 -- start start 2024-05-04T02:20:37.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:37.120+0000 7fe631043640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe62c0cd500 0x7fe62c155650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:37.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:37.120+0000 7fe631043640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe62c156af0 0x7fe62c14f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:37.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:37.120+0000 7fe631043640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe62c15d090 0x7fe62c14fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:37.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:37.120+0000 7fe631043640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe62c15d4a0 con 0x7fe62c15d090 2024-05-04T02:20:37.122 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:37.120+0000 7fe631043640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe62c0c98b0 con 0x7fe62c156af0 2024-05-04T02:20:37.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:37.120+0000 7fe631043640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe62c0cdfd0 con 0x7fe62c0cd500 2024-05-04T02:20:37.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:37.120+0000 7fe62b59e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe62c15d090 0x7fe62c14fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:37.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:37.120+0000 7fe62ad9d640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe62c0cd500 0x7fe62c155650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:37.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:37.121+0000 7fe623fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe62c156af0 0x7fe62c14f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:37.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:37.121+0000 7fe62b59e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe62c15d090 0x7fe62c14fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40978/0 (socket says 172.21.15.1:40978) 2024-05-04T02:20:37.124 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:37.121+0000 7fe62b59e640 1 -- 172.21.15.1:0/3258719161 learned_addr learned my addr 172.21.15.1:0/3258719161 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:37.126 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:37.124+0000 7fe62ad9d640 1 -- 172.21.15.1:0/3258719161 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe62c156af0 msgr2=0x7fe62c14f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:37.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:37.124+0000 7fe62ad9d640 1 --2- 172.21.15.1:0/3258719161 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe62c156af0 0x7fe62c14f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:37.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:37.124+0000 7fe62ad9d640 1 -- 172.21.15.1:0/3258719161 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe62c15d090 msgr2=0x7fe62c14fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:37.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:37.124+0000 7fe62ad9d640 1 --2- 172.21.15.1:0/3258719161 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe62c15d090 0x7fe62c14fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:37.127 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:37.124+0000 7fe62ad9d640 1 -- 172.21.15.1:0/3258719161 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe62c1f6b60 con 0x7fe62c0cd500 2024-05-04T02:20:37.129 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:37.127+0000 7fe62ad9d640 1 --2- 172.21.15.1:0/3258719161 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe62c0cd500 0x7fe62c155650 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe61c00e8d0 tx=0x7fe61c00ed90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:37.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:37.131+0000 7fe6237fe640 1 -- 172.21.15.1:0/3258719161 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe61c017070 con 0x7fe62c0cd500 2024-05-04T02:20:37.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:37.131+0000 7fe6237fe640 1 -- 172.21.15.1:0/3258719161 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe61c00c8e0 con 0x7fe62c0cd500 2024-05-04T02:20:37.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:37.131+0000 7fe631043640 1 -- 172.21.15.1:0/3258719161 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe62c157ca0 con 0x7fe62c0cd500 2024-05-04T02:20:37.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:37.131+0000 7fe6237fe640 1 -- 172.21.15.1:0/3258719161 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe61c009e60 con 0x7fe62c0cd500 2024-05-04T02:20:37.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:37.131+0000 7fe631043640 1 -- 172.21.15.1:0/3258719161 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe62c158260 con 0x7fe62c0cd500 2024-05-04T02:20:37.134 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:37.132+0000 7fe631043640 1 -- 172.21.15.1:0/3258719161 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe62c076740 con 0x7fe62c0cd500 2024-05-04T02:20:37.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:37.409+0000 7fe6237fe640 1 -- 172.21.15.1:0/3258719161 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe61c01a070 con 0x7fe62c0cd500 2024-05-04T02:20:37.411 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:37.409+0000 7fe6237fe640 1 --2- 172.21.15.1:0/3258719161 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fe60c076350 0x7fe60c078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:37.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:37.410+0000 7fe623fff640 1 --2- 172.21.15.1:0/3258719161 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fe60c076350 0x7fe60c078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:37.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:37.410+0000 7fe623fff640 1 --2- 172.21.15.1:0/3258719161 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fe60c076350 0x7fe60c078860 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe614034000 tx=0x7fe61402e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:37.415 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:37.413+0000 7fe6237fe640 1 -- 172.21.15.1:0/3258719161 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fe61c05d050 con 0x7fe62c0cd500 2024-05-04T02:20:37.426 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:37.424+0000 7fe6237fe640 1 -- 172.21.15.1:0/3258719161 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe61c060dc0 con 0x7fe62c0cd500 2024-05-04T02:20:37.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:37.665+0000 7fe631043640 1 -- 172.21.15.1:0/3258719161 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe62c06dcc0 con 0x7fe62c0cd500 2024-05-04T02:20:37.693 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:37.691+0000 7fe6237fe640 1 -- 172.21.15.1:0/3258719161 <== mon.2 v2:172.21.15.107:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+6818 (secure 0 0 0) 0x7fe61c0650c0 con 0x7fe62c0cd500 2024-05-04T02:20:37.693 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:20:37.693 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4214,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/2012070226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":2012070226},{"type":"v1","addr":"172.21.15.107:6837","nonce":2012070226}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4217,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/779417024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":779417024},{"type":"v1","addr":"172.21.15.107:6836","nonce":779417024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4223,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/4178520860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":4178520860},{"type":"v1","addr":"172.21.15.1:6837","nonce":4178520860}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4273,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6833/410847489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":410847489},{"type":"v1","addr":"172.21.15.1:6833","nonce":410847489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/1145100080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":1145100080},{"type":"v1","addr":"172.21.15.1:6835","nonce":1145100080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-04T02:20:15.309997+0000","modified":"2024-05-04T02:20:21.184612+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.107:6839/1807033208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":1807033208},{"type":"v1","addr":"172.21.15.107:6839","nonce":1807033208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4285,"qdb_cluster":[4285]},"id":1}]} 2024-05-04T02:20:37.693 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 7 2024-05-04T02:20:37.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:37.693+0000 7fe631043640 1 -- 172.21.15.1:0/3258719161 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fe60c076350 msgr2=0x7fe60c078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:37.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:37.693+0000 7fe631043640 1 --2- 172.21.15.1:0/3258719161 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fe60c076350 0x7fe60c078860 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe614034000 tx=0x7fe61402e000 comp rx=0 tx=0).stop 2024-05-04T02:20:37.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:37.693+0000 7fe631043640 1 -- 172.21.15.1:0/3258719161 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe62c0cd500 msgr2=0x7fe62c155650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:37.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:37.693+0000 7fe631043640 1 --2- 172.21.15.1:0/3258719161 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe62c0cd500 0x7fe62c155650 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe61c00e8d0 tx=0x7fe61c00ed90 comp rx=0 tx=0).stop 2024-05-04T02:20:37.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:37.693+0000 7fe631043640 1 -- 172.21.15.1:0/3258719161 shutdown_connections 2024-05-04T02:20:37.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:37.693+0000 7fe631043640 1 --2- 172.21.15.1:0/3258719161 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fe60c076350 0x7fe60c078860 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:37.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:37.693+0000 7fe631043640 1 --2- 172.21.15.1:0/3258719161 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe62c15d090 0x7fe62c14fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:37.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:37.693+0000 7fe631043640 1 --2- 172.21.15.1:0/3258719161 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe62c156af0 0x7fe62c14f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:37.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:37.693+0000 7fe631043640 1 --2- 172.21.15.1:0/3258719161 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe62c0cd500 0x7fe62c155650 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:37.696 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:37.693+0000 7fe631043640 1 -- 172.21.15.1:0/3258719161 >> 172.21.15.1:0/3258719161 conn(0x7fe62c0ce980 msgr2=0x7fe62c0c7290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:37.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:37.693+0000 7fe631043640 1 -- 172.21.15.1:0/3258719161 shutdown_connections 2024-05-04T02:20:37.697 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:37.693+0000 7fe631043640 1 -- 172.21.15.1:0/3258719161 wait complete. 2024-05-04T02:20:38.311 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-04T02:20:15.309997+0000', 'modified': '2024-05-04T02:20:21.184612+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4285}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4285': {'gid': 4285, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.107:6839/1807033208', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.107:6838', 'nonce': 1807033208}, {'type': 'v1', 'addr': '172.21.15.107:6839', 'nonce': 1807033208}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4285, 'qdb_cluster': [4285]} 2024-05-04T02:20:38.311 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-04T02:20:38.311 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-05-04T02:20:38.436 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.434+0000 7fea2f269640 1 Processor -- start 2024-05-04T02:20:38.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.434+0000 7fea2f269640 1 -- start start 2024-05-04T02:20:38.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.436+0000 7fea2f269640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fea280cdc20 0x7fea2806c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:38.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.436+0000 7fea2f269640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fea280c6f70 0x7fea280ccea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:38.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.436+0000 7fea2f269640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fea280cd3e0 0x7fea2815c500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:38.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.436+0000 7fea2f269640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7fea28160a20 con 0x7fea280c6f70 2024-05-04T02:20:38.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.436+0000 7fea2f269640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fea280c69e0 con 0x7fea280cdc20 2024-05-04T02:20:38.438 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.436+0000 7fea2f269640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fea28160740 con 0x7fea280cd3e0 2024-05-04T02:20:38.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.436+0000 7fea2c804640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fea280c6f70 0x7fea280ccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:38.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.436+0000 7fea2d806640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fea280cd3e0 0x7fea2815c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:38.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.436+0000 7fea2d005640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fea280cdc20 0x7fea2806c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:38.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.437+0000 7fea2c804640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fea280c6f70 0x7fea280ccea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40982/0 (socket says 172.21.15.1:40982) 2024-05-04T02:20:38.439 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.437+0000 7fea2c804640 1 -- 172.21.15.1:0/1568743259 learned_addr learned my addr 172.21.15.1:0/1568743259 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:38.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.439+0000 7fea2c804640 1 -- 172.21.15.1:0/1568743259 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fea280cd3e0 msgr2=0x7fea2815c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:38.441 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.439+0000 7fea2c804640 1 --2- 172.21.15.1:0/1568743259 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fea280cd3e0 0x7fea2815c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:38.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.439+0000 7fea2c804640 1 -- 172.21.15.1:0/1568743259 >> v2:172.21.15.107:3300/0 conn(0x7fea280cdc20 msgr2=0x7fea2806c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:38.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.439+0000 7fea2c804640 1 --2- 172.21.15.1:0/1568743259 >> v2:172.21.15.107:3300/0 conn(0x7fea280cdc20 0x7fea2806c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:38.442 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.439+0000 7fea2c804640 1 -- 172.21.15.1:0/1568743259 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea280c77f0 con 0x7fea280c6f70 2024-05-04T02:20:38.443 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.441+0000 7fea2c804640 1 --2- 172.21.15.1:0/1568743259 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fea280c6f70 0x7fea280ccea0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fea280cf810 tx=0x7fea1c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a83937dde836f74 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:38.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.446+0000 7fea27fff640 1 -- 172.21.15.1:0/1568743259 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea1c037070 con 0x7fea280c6f70 2024-05-04T02:20:38.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.446+0000 7fea27fff640 1 -- 172.21.15.1:0/1568743259 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea1c032440 con 0x7fea280c6f70 2024-05-04T02:20:38.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.446+0000 7fea27fff640 1 -- 172.21.15.1:0/1568743259 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea1c032810 con 0x7fea280c6f70 2024-05-04T02:20:38.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.446+0000 7fea2f269640 1 -- 172.21.15.1:0/1568743259 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fea280c6f70 msgr2=0x7fea280ccea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:38.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.446+0000 7fea2f269640 1 --2- 172.21.15.1:0/1568743259 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fea280c6f70 0x7fea280ccea0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fea280cf810 tx=0x7fea1c02a270 comp rx=0 tx=0).stop 2024-05-04T02:20:38.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.446+0000 7fea2f269640 1 -- 172.21.15.1:0/1568743259 shutdown_connections 2024-05-04T02:20:38.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.447+0000 7fea2f269640 1 --2- 172.21.15.1:0/1568743259 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fea280cd3e0 0x7fea2815c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:38.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.447+0000 7fea2f269640 1 --2- 172.21.15.1:0/1568743259 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fea280c6f70 0x7fea280ccea0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:38.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.447+0000 7fea2f269640 1 --2- 172.21.15.1:0/1568743259 >> v2:172.21.15.107:3300/0 conn(0x7fea280cdc20 0x7fea2806c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:38.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.447+0000 7fea2f269640 1 -- 172.21.15.1:0/1568743259 >> 172.21.15.1:0/1568743259 conn(0x7fea2808e210 msgr2=0x7fea280d1960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:38.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.447+0000 7fea2f269640 1 -- 172.21.15.1:0/1568743259 shutdown_connections 2024-05-04T02:20:38.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.447+0000 7fea2f269640 1 -- 172.21.15.1:0/1568743259 wait complete. 2024-05-04T02:20:38.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.448+0000 7fea2f269640 1 Processor -- start 2024-05-04T02:20:38.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.448+0000 7fea2f269640 1 -- start start 2024-05-04T02:20:38.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.450+0000 7fea2f269640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fea280c6f70 0x7fea28156c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:38.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.450+0000 7fea2f269640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea280cd3e0 0x7fea281e69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:38.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.450+0000 7fea2f269640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fea280cdc20 0x7fea2815ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:38.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.450+0000 7fea2f269640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fea280c8090 con 0x7fea280c6f70 2024-05-04T02:20:38.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.450+0000 7fea2f269640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fea280c7db0 con 0x7fea280cd3e0 2024-05-04T02:20:38.452 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.450+0000 7fea2f269640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fea28160450 con 0x7fea280cdc20 2024-05-04T02:20:38.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.450+0000 7fea2d005640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fea280c6f70 0x7fea28156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:38.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.450+0000 7fea2d806640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fea280cdc20 0x7fea2815ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:38.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.450+0000 7fea2d005640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fea280c6f70 0x7fea28156c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:40996/0 (socket says 172.21.15.1:40996) 2024-05-04T02:20:38.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.450+0000 7fea2d005640 1 -- 172.21.15.1:0/267038577 learned_addr learned my addr 172.21.15.1:0/267038577 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:38.453 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.450+0000 7fea2c804640 1 --2- 172.21.15.1:0/267038577 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea280cd3e0 0x7fea281e69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:38.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.454+0000 7fea2d806640 1 -- 172.21.15.1:0/267038577 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea280cd3e0 msgr2=0x7fea281e69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:38.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.455+0000 7fea2d806640 1 --2- 172.21.15.1:0/267038577 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea280cd3e0 0x7fea281e69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:38.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.455+0000 7fea2d806640 1 -- 172.21.15.1:0/267038577 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fea280c6f70 msgr2=0x7fea28156c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:38.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.455+0000 7fea2d806640 1 --2- 172.21.15.1:0/267038577 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fea280c6f70 0x7fea28156c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:38.457 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.455+0000 7fea2d806640 1 -- 172.21.15.1:0/267038577 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea28157310 con 0x7fea280cdc20 2024-05-04T02:20:38.459 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.457+0000 7fea2d806640 1 --2- 172.21.15.1:0/267038577 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fea280cdc20 0x7fea2815ea00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fea1800eab0 tx=0x7fea1800ef70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:38.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.461+0000 7fea25ffb640 1 -- 172.21.15.1:0/267038577 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea18018020 con 0x7fea280cdc20 2024-05-04T02:20:38.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.461+0000 7fea25ffb640 1 -- 172.21.15.1:0/267038577 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea1800bc00 con 0x7fea280cdc20 2024-05-04T02:20:38.463 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.461+0000 7fea25ffb640 1 -- 172.21.15.1:0/267038577 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea18014400 con 0x7fea280cdc20 2024-05-04T02:20:38.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.461+0000 7fea2f269640 1 -- 172.21.15.1:0/267038577 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea281f2810 con 0x7fea280cdc20 2024-05-04T02:20:38.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.461+0000 7fea2f269640 1 -- 172.21.15.1:0/267038577 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fea281f2dd0 con 0x7fea280cdc20 2024-05-04T02:20:38.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.464+0000 7fea361f3740 1 Processor -- start 2024-05-04T02:20:38.466 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.464+0000 7fea361f3740 1 -- start start 2024-05-04T02:20:38.467 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.465+0000 7fea361f3740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f1616f1270 0x55f161a93190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:38.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.465+0000 7fea361f3740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f1616c83b0 0x55f161ad23b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:38.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.465+0000 7fea361f3740 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55f1616d0590 0x55f161ab7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:38.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.465+0000 7fea361f3740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55f1619f78d0 con 0x55f1616c83b0 2024-05-04T02:20:38.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.465+0000 7fea361f3740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55f1619b0c10 con 0x55f1616f1270 2024-05-04T02:20:38.468 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.466+0000 7fea361f3740 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x55f1619f3890 con 0x55f1616d0590 2024-05-04T02:20:38.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.466+0000 7fea2d005640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f1616c83b0 0x55f161ad23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:38.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.466+0000 7fea2c804640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f1616f1270 0x55f161a93190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:38.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.466+0000 7fea2d005640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f1616c83b0 0x55f161ad23b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41010/0 (socket says 172.21.15.1:41010) 2024-05-04T02:20:38.469 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.466+0000 7fea2d005640 1 -- 172.21.15.1:0/4124019585 learned_addr learned my addr 172.21.15.1:0/4124019585 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:38.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.469+0000 7fea2d005640 1 -- 172.21.15.1:0/4124019585 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55f1616d0590 msgr2=0x55f161ab7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:38.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.469+0000 7fea2d005640 1 --2- 172.21.15.1:0/4124019585 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55f1616d0590 0x55f161ab7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:38.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.469+0000 7fea2d005640 1 -- 172.21.15.1:0/4124019585 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f1616f1270 msgr2=0x55f161a93190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:38.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.469+0000 7fea2d005640 1 --2- 172.21.15.1:0/4124019585 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f1616f1270 0x55f161a93190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:38.471 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.469+0000 7fea2d005640 1 -- 172.21.15.1:0/4124019585 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1619b85d0 con 0x55f1616c83b0 2024-05-04T02:20:38.473 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.471+0000 7fea2d005640 1 --2- 172.21.15.1:0/4124019585 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f1616c83b0 0x55f161ad23b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fea20009cd0 tx=0x7fea20011690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c2421d29fc2251b server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:38.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.475+0000 7fea0effd640 1 -- 172.21.15.1:0/4124019585 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea20014440 con 0x55f1616c83b0 2024-05-04T02:20:38.477 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.475+0000 7fea0effd640 1 -- 172.21.15.1:0/4124019585 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea200145e0 con 0x55f1616c83b0 2024-05-04T02:20:38.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.475+0000 7fea0effd640 1 -- 172.21.15.1:0/4124019585 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea200149b0 con 0x55f1616c83b0 2024-05-04T02:20:38.478 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.476+0000 7fea361f3740 1 -- 172.21.15.1:0/4124019585 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f1616c83b0 msgr2=0x55f161ad23b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:38.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.476+0000 7fea361f3740 1 --2- 172.21.15.1:0/4124019585 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f1616c83b0 0x55f161ad23b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fea20009cd0 tx=0x7fea20011690 comp rx=0 tx=0).stop 2024-05-04T02:20:38.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.476+0000 7fea361f3740 1 -- 172.21.15.1:0/4124019585 shutdown_connections 2024-05-04T02:20:38.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.476+0000 7fea361f3740 1 --2- 172.21.15.1:0/4124019585 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55f1616d0590 0x55f161ab7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:38.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.476+0000 7fea361f3740 1 --2- 172.21.15.1:0/4124019585 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f1616c83b0 0x55f161ad23b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:38.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.476+0000 7fea361f3740 1 --2- 172.21.15.1:0/4124019585 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f1616f1270 0x55f161a93190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:38.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.476+0000 7fea361f3740 1 -- 172.21.15.1:0/4124019585 >> 172.21.15.1:0/4124019585 conn(0x55f1616e53c0 msgr2=0x55f161a92090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:38.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.476+0000 7fea361f3740 1 -- 172.21.15.1:0/4124019585 shutdown_connections 2024-05-04T02:20:38.479 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.476+0000 7fea361f3740 1 -- 172.21.15.1:0/4124019585 wait complete. 2024-05-04T02:20:38.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.477+0000 7fea361f3740 1 -- start start 2024-05-04T02:20:38.480 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.478+0000 7fea361f3740 1 Processor -- start 2024-05-04T02:20:38.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.479+0000 7fea361f3740 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55f1616c83b0 0x55f161ad8d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:38.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.479+0000 7fea361f3740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f1616d0590 0x55f161ae3a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:38.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.479+0000 7fea361f3740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f1616f1270 0x55f161abb460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:38.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.479+0000 7fea361f3740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55f1619b4760 con 0x55f1616f1270 2024-05-04T02:20:38.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.479+0000 7fea361f3740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55f161ae42f0 con 0x55f1616d0590 2024-05-04T02:20:38.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.479+0000 7fea361f3740 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x55f161ad1580 con 0x55f1616c83b0 2024-05-04T02:20:38.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.479+0000 7fea361f3740 10 client.0 _ll_register_callbacks cb 0x55f1619edcf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-04T02:20:38.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.480+0000 7fea2c804640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f1616f1270 0x55f161abb460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:38.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.480+0000 7fea2d005640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f1616d0590 0x55f161ae3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:38.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.480+0000 7fea2c804640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f1616f1270 0x55f161abb460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41014/0 (socket says 172.21.15.1:41014) 2024-05-04T02:20:38.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.480+0000 7fea2c804640 1 -- 172.21.15.1:0/1993879276 learned_addr learned my addr 172.21.15.1:0/1993879276 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:38.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.484+0000 7fea2d005640 1 -- 172.21.15.1:0/1993879276 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55f1616c83b0 msgr2=0x55f161ad8d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:38.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.484+0000 7fea2d005640 1 --2- 172.21.15.1:0/1993879276 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55f1616c83b0 0x55f161ad8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:38.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.484+0000 7fea2d005640 1 -- 172.21.15.1:0/1993879276 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f1616f1270 msgr2=0x55f161abb460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:38.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.484+0000 7fea2d005640 1 --2- 172.21.15.1:0/1993879276 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f1616f1270 0x55f161abb460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:38.486 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.484+0000 7fea2d005640 1 -- 172.21.15.1:0/1993879276 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1617092d0 con 0x55f1616d0590 2024-05-04T02:20:38.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.486+0000 7fea2d005640 1 --2- 172.21.15.1:0/1993879276 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f1616d0590 0x55f161ae3a30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fea2001c000 tx=0x7fea20004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac34a6f8b8ac2b29 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:38.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.486+0000 7fea03fff640 10 client.0 ms_handle_connect on v2:172.21.15.107:3300/0 2024-05-04T02:20:38.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.486+0000 7fea25ffb640 1 -- 172.21.15.1:0/267038577 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fea1801b020 con 0x7fea280cdc20 2024-05-04T02:20:38.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.487+0000 7fea25ffb640 1 --2- 172.21.15.1:0/267038577 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fea140762b0 0x7fea140787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:38.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.487+0000 7fea2c804640 1 --2- 172.21.15.1:0/267038577 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fea140762b0 0x7fea140787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:38.489 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.488+0000 7fea2c804640 1 --2- 172.21.15.1:0/267038577 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fea140762b0 0x7fea140787c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fea1c009630 tx=0x7fea1c02c070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:38.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.490+0000 7fea03fff640 1 -- 172.21.15.1:0/1993879276 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea20014440 con 0x55f1616d0590 2024-05-04T02:20:38.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.490+0000 7fea03fff640 1 -- 172.21.15.1:0/1993879276 <== mon.1 v2:172.21.15.107:3300/0 2 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fea20028cb0 con 0x55f1616d0590 2024-05-04T02:20:38.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.490+0000 7fea361f3740 1 -- 172.21.15.1:0/1993879276 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea200145e0 con 0x55f1616d0590 2024-05-04T02:20:38.493 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.491+0000 7fea25ffb640 1 -- 172.21.15.1:0/267038577 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fea1805cf60 con 0x7fea280cdc20 2024-05-04T02:20:38.494 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.493+0000 7fea03fff640 1 -- 172.21.15.1:0/1993879276 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7fea2001d400 con 0x55f1616d0590 2024-05-04T02:20:38.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.493+0000 7fea361f3740 10 client.4516 fetch_fsmap learned FSMap version 7 2024-05-04T02:20:38.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.493+0000 7fea361f3740 1 -- 172.21.15.1:0/1993879276 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x55f1617d36b0 con 0x55f1616d0590 2024-05-04T02:20:38.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.507+0000 7fea03fff640 1 -- 172.21.15.1:0/1993879276 <== mon.1 v2:172.21.15.107:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea200145e0 con 0x55f1616d0590 2024-05-04T02:20:38.509 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.507+0000 7fea03fff640 1 -- 172.21.15.1:0/1993879276 <== mon.1 v2:172.21.15.107:3300/0 5 ==== fsmap(e 7) ==== 4704+0+0 (secure 0 0 0) 0x7fea20027600 con 0x55f1616d0590 2024-05-04T02:20:38.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.507+0000 7fea361f3740 10 client.4516 fetch_fsmap finished waiting for FSMap version 7 2024-05-04T02:20:38.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.507+0000 7fea361f3740 10 client.4516 resolve_mds: resolved name 'd' to daemon mds.d 2024-05-04T02:20:38.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.507+0000 7fea361f3740 20 client.4516 populate_metadata read hostname 'smithi001' 2024-05-04T02:20:38.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.507+0000 7fea361f3740 1 --2- 172.21.15.1:0/1993879276 >> [v2:172.21.15.107:6838/1807033208,v1:172.21.15.107:6839/1807033208] conn(0x55f1616afe40 0x55f161af29b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:38.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.507+0000 7fea361f3740 4 client.4516 mds_command: new command op to 4285 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-04T02:20:38.510 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.507+0000 7fea361f3740 1 -- 172.21.15.1:0/1993879276 --> [v2:172.21.15.107:6838/1807033208,v1:172.21.15.107:6839/1807033208] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f16197b760 con 0x55f1616afe40 2024-05-04T02:20:38.519 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.517+0000 7fea2c804640 1 --2- 172.21.15.1:0/1993879276 >> [v2:172.21.15.107:6838/1807033208,v1:172.21.15.107:6839/1807033208] conn(0x55f1616afe40 0x55f161af29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:38.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.660+0000 7fea2c804640 1 --2- 172.21.15.1:0/1993879276 >> [v2:172.21.15.107:6838/1807033208,v1:172.21.15.107:6839/1807033208] conn(0x55f1616afe40 0x55f161af29b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ecf6241cf3a50c95 server_cookie=a10b794fec6771dc in_seq=0 out_seq=0 2024-05-04T02:20:38.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.660+0000 7fea03fff640 10 client.4516 ms_handle_connect on v2:172.21.15.107:6838/1807033208 2024-05-04T02:20:38.811 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.808+0000 7fea03fff640 1 -- 172.21.15.1:0/1993879276 <== mds.0 v2:172.21.15.107:6838/1807033208 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55f16197b760 con 0x55f1616afe40 2024-05-04T02:20:38.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.809+0000 7fea03fff640 10 client.4516 handle_command_reply: tid=0 2024-05-04T02:20:38.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.809+0000 7fea361f3740 1 client.4516 shutdown 2024-05-04T02:20:38.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.809+0000 7fea361f3740 1 -- 172.21.15.1:0/1993879276 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f1616d0590 msgr2=0x55f161ae3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:38.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.809+0000 7fea361f3740 1 --2- 172.21.15.1:0/1993879276 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f1616d0590 0x55f161ae3a30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fea2001c000 tx=0x7fea20004730 comp rx=0 tx=0).stop 2024-05-04T02:20:38.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.809+0000 7fea361f3740 1 -- 172.21.15.1:0/1993879276 shutdown_connections 2024-05-04T02:20:38.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.809+0000 7fea361f3740 1 --2- 172.21.15.1:0/1993879276 >> [v2:172.21.15.107:6838/1807033208,v1:172.21.15.107:6839/1807033208] conn(0x55f1616afe40 0x55f161af29b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:38.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.809+0000 7fea361f3740 1 --2- 172.21.15.1:0/1993879276 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f1616f1270 0x55f161abb460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:38.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.809+0000 7fea361f3740 1 --2- 172.21.15.1:0/1993879276 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f1616d0590 0x55f161ae3a30 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:38.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.809+0000 7fea361f3740 1 --2- 172.21.15.1:0/1993879276 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55f1616c83b0 0x55f161ad8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:38.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.809+0000 7fea03fff640 0 client.4516 ms_handle_reset on v2:172.21.15.107:6838/1807033208 2024-05-04T02:20:38.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.809+0000 7fea361f3740 1 -- 172.21.15.1:0/1993879276 >> 172.21.15.1:0/1993879276 conn(0x55f1616e53c0 msgr2=0x55f161a90bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:38.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.809+0000 7fea361f3740 1 -- 172.21.15.1:0/1993879276 shutdown_connections 2024-05-04T02:20:38.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.809+0000 7fea361f3740 1 -- 172.21.15.1:0/1993879276 wait complete. 2024-05-04T02:20:38.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.809+0000 7fea361f3740 20 client.4516 trim_cache size 0 max 16384 2024-05-04T02:20:38.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.828+0000 7fea361f3740 1 Processor -- start 2024-05-04T02:20:38.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.828+0000 7fea361f3740 1 -- start start 2024-05-04T02:20:38.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.829+0000 7fea361f3740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f1616c83b0 0x55f161a8d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:38.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.829+0000 7fea361f3740 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55f1616d0590 0x55f161ad3c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:38.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.829+0000 7fea361f3740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f1616f1270 0x55f161ad4150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:38.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.829+0000 7fea361f3740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fea281f69b0 con 0x55f1616c83b0 2024-05-04T02:20:38.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.829+0000 7fea361f3740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55f161acdb50 con 0x55f1616f1270 2024-05-04T02:20:38.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.829+0000 7fea361f3740 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x55f161ae4030 con 0x55f1616d0590 2024-05-04T02:20:38.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.830+0000 7fea2d005640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f1616c83b0 0x55f161a8d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:38.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.830+0000 7fea2d005640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f1616c83b0 0x55f161a8d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41018/0 (socket says 172.21.15.1:41018) 2024-05-04T02:20:38.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.830+0000 7fea2d005640 1 -- 172.21.15.1:0/962762104 learned_addr learned my addr 172.21.15.1:0/962762104 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:38.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.830+0000 7fea2d806640 1 --2- 172.21.15.1:0/962762104 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f1616f1270 0x55f161ad4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:38.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.830+0000 7fea2c804640 1 --2- 172.21.15.1:0/962762104 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55f1616d0590 0x55f161ad3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:38.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.833+0000 7fea2d005640 1 -- 172.21.15.1:0/962762104 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55f1616d0590 msgr2=0x55f161ad3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:38.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.833+0000 7fea2d005640 1 --2- 172.21.15.1:0/962762104 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55f1616d0590 0x55f161ad3c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:38.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.833+0000 7fea2d005640 1 -- 172.21.15.1:0/962762104 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f1616f1270 msgr2=0x55f161ad4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:38.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.833+0000 7fea2d005640 1 --2- 172.21.15.1:0/962762104 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f1616f1270 0x55f161ad4150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:38.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.833+0000 7fea2d005640 1 -- 172.21.15.1:0/962762104 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f161a8f5b0 con 0x55f1616c83b0 2024-05-04T02:20:38.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.835+0000 7fea2d005640 1 --2- 172.21.15.1:0/962762104 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f1616c83b0 0x55f161a8d9e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fea2000a000 tx=0x7fea20023000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18a9c87102a61e9d server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:38.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.837+0000 7fea0e7fc640 1 -- 172.21.15.1:0/962762104 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea20027ce0 con 0x55f1616c83b0 2024-05-04T02:20:38.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.839+0000 7fea0e7fc640 1 -- 172.21.15.1:0/962762104 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea20014aa0 con 0x55f1616c83b0 2024-05-04T02:20:38.841 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.839+0000 7fea0e7fc640 1 -- 172.21.15.1:0/962762104 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea20027400 con 0x55f1616c83b0 2024-05-04T02:20:38.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.840+0000 7fea361f3740 1 -- 172.21.15.1:0/962762104 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f1616c83b0 msgr2=0x55f161a8d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:38.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.840+0000 7fea361f3740 1 --2- 172.21.15.1:0/962762104 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f1616c83b0 0x55f161a8d9e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fea2000a000 tx=0x7fea20023000 comp rx=0 tx=0).stop 2024-05-04T02:20:38.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.840+0000 7fea361f3740 1 -- 172.21.15.1:0/962762104 shutdown_connections 2024-05-04T02:20:38.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.840+0000 7fea361f3740 1 --2- 172.21.15.1:0/962762104 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f1616f1270 0x55f161ad4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:38.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.840+0000 7fea361f3740 1 --2- 172.21.15.1:0/962762104 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55f1616d0590 0x55f161ad3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:38.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.840+0000 7fea361f3740 1 --2- 172.21.15.1:0/962762104 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f1616c83b0 0x55f161a8d9e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:38.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.840+0000 7fea361f3740 1 -- 172.21.15.1:0/962762104 >> 172.21.15.1:0/962762104 conn(0x55f1616e53c0 msgr2=0x55f161ae37f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:38.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.840+0000 7fea361f3740 1 -- 172.21.15.1:0/962762104 shutdown_connections 2024-05-04T02:20:38.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.840+0000 7fea361f3740 1 -- 172.21.15.1:0/962762104 wait complete. 2024-05-04T02:20:38.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.841+0000 7fea361f3740 1 -- start start 2024-05-04T02:20:38.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.841+0000 7fea361f3740 1 Processor -- start 2024-05-04T02:20:38.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.843+0000 7fea361f3740 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f1616c83b0 0x55f161b54bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:38.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.843+0000 7fea361f3740 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f1616d0590 0x55f161aecd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:38.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.843+0000 7fea361f3740 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55f1616f1270 0x55f161b4aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:38.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.843+0000 7fea361f3740 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x55f161ae7070 con 0x55f1616d0590 2024-05-04T02:20:38.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.843+0000 7fea361f3740 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x55f161ad75e0 con 0x55f1616c83b0 2024-05-04T02:20:38.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.843+0000 7fea361f3740 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x55f161ae7700 con 0x55f1616f1270 2024-05-04T02:20:38.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.843+0000 7fea361f3740 10 client.0 _ll_register_callbacks cb 0x7fea20009060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-04T02:20:38.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.843+0000 7fea2c804640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f1616d0590 0x55f161aecd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:38.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.844+0000 7fea2d005640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f1616c83b0 0x55f161b54bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:38.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.844+0000 7fea2d806640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55f1616f1270 0x55f161b4aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:38.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.844+0000 7fea2c804640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f1616d0590 0x55f161aecd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41020/0 (socket says 172.21.15.1:41020) 2024-05-04T02:20:38.846 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.844+0000 7fea2c804640 1 -- 172.21.15.1:0/3223052622 learned_addr learned my addr 172.21.15.1:0/3223052622 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:38.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.847+0000 7fea2c804640 1 -- 172.21.15.1:0/3223052622 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55f1616f1270 msgr2=0x55f161b4aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:38.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.847+0000 7fea2c804640 1 --2- 172.21.15.1:0/3223052622 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55f1616f1270 0x55f161b4aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:38.849 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.847+0000 7fea2c804640 1 -- 172.21.15.1:0/3223052622 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f1616c83b0 msgr2=0x55f161b54bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:20:38.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.847+0000 7fea2c804640 1 --2- 172.21.15.1:0/3223052622 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f1616c83b0 0x55f161b54bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:38.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.847+0000 7fea2c804640 1 -- 172.21.15.1:0/3223052622 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f161b54130 con 0x55f1616d0590 2024-05-04T02:20:38.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.850+0000 7fea2c804640 1 --2- 172.21.15.1:0/3223052622 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f1616d0590 0x55f161aecd60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fea1c000c00 tx=0x7fea1c02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79c4dd93704c4c49 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:38.852 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.850+0000 7fea03fff640 10 client.0 ms_handle_connect on v2:172.21.15.1:3300/0 2024-05-04T02:20:38.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.853+0000 7fea03fff640 1 -- 172.21.15.1:0/3223052622 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea1c037040 con 0x55f1616d0590 2024-05-04T02:20:38.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.853+0000 7fea03fff640 1 -- 172.21.15.1:0/3223052622 <== mon.0 v2:172.21.15.1:3300/0 2 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fea1c052580 con 0x55f1616d0590 2024-05-04T02:20:38.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.853+0000 7fea361f3740 1 -- 172.21.15.1:0/3223052622 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea20014aa0 con 0x55f1616d0590 2024-05-04T02:20:38.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.856+0000 7fea03fff640 1 -- 172.21.15.1:0/3223052622 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7fea1c062050 con 0x55f1616d0590 2024-05-04T02:20:38.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.856+0000 7fea361f3740 10 client.4482 fetch_fsmap learned FSMap version 7 2024-05-04T02:20:38.858 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.856+0000 7fea361f3740 1 -- 172.21.15.1:0/3223052622 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x55f161b543f0 con 0x55f1616d0590 2024-05-04T02:20:38.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.861+0000 7fea03fff640 1 -- 172.21.15.1:0/3223052622 <== mon.0 v2:172.21.15.1:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea20014aa0 con 0x55f1616d0590 2024-05-04T02:20:38.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.861+0000 7fea03fff640 1 -- 172.21.15.1:0/3223052622 <== mon.0 v2:172.21.15.1:3300/0 5 ==== fsmap(e 7) ==== 4704+0+0 (secure 0 0 0) 0x7fea1c065020 con 0x55f1616d0590 2024-05-04T02:20:38.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.861+0000 7fea361f3740 10 client.4482 fetch_fsmap finished waiting for FSMap version 7 2024-05-04T02:20:38.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.861+0000 7fea361f3740 10 client.4482 resolve_mds: resolved name 'd' to daemon mds.d 2024-05-04T02:20:38.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.862+0000 7fea361f3740 20 client.4482 populate_metadata read hostname 'smithi001' 2024-05-04T02:20:38.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.862+0000 7fea361f3740 1 --2- 172.21.15.1:0/3223052622 >> [v2:172.21.15.107:6838/1807033208,v1:172.21.15.107:6839/1807033208] conn(0x55f161a935a0 0x55f161b5d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:38.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.862+0000 7fea361f3740 4 client.4482 mds_command: new command op to 4285 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-04T02:20:38.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.862+0000 7fea361f3740 1 -- 172.21.15.1:0/3223052622 --> [v2:172.21.15.107:6838/1807033208,v1:172.21.15.107:6839/1807033208] -- command(tid 0: {"prefix": "status"}) -- 0x55f161a054e0 con 0x55f161a935a0 2024-05-04T02:20:38.865 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.863+0000 7fea2d005640 1 --2- 172.21.15.1:0/3223052622 >> [v2:172.21.15.107:6838/1807033208,v1:172.21.15.107:6839/1807033208] conn(0x55f161a935a0 0x55f161b5d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:38.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.866+0000 7fea2d005640 1 --2- 172.21.15.1:0/3223052622 >> [v2:172.21.15.107:6838/1807033208,v1:172.21.15.107:6839/1807033208] conn(0x55f161a935a0 0x55f161b5d470 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fc692736c592ac9 server_cookie=fc9e249f727809dd in_seq=0 out_seq=0 2024-05-04T02:20:38.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.866+0000 7fea03fff640 10 client.4482 ms_handle_connect on v2:172.21.15.107:6838/1807033208 2024-05-04T02:20:38.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.888+0000 7fea03fff640 1 -- 172.21.15.1:0/3223052622 <== mds.0 v2:172.21.15.107:6838/1807033208 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x55f161a054e0 con 0x55f161a935a0 2024-05-04T02:20:38.890 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.888+0000 7fea03fff640 10 client.4482 handle_command_reply: tid=0 2024-05-04T02:20:38.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.888+0000 7fea361f3740 1 client.4482 shutdown 2024-05-04T02:20:38.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.888+0000 7fea361f3740 1 -- 172.21.15.1:0/3223052622 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f1616d0590 msgr2=0x55f161aecd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:38.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.888+0000 7fea361f3740 1 --2- 172.21.15.1:0/3223052622 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f1616d0590 0x55f161aecd60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fea1c000c00 tx=0x7fea1c02c000 comp rx=0 tx=0).stop 2024-05-04T02:20:38.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.888+0000 7fea361f3740 1 -- 172.21.15.1:0/3223052622 shutdown_connections 2024-05-04T02:20:38.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.888+0000 7fea361f3740 1 --2- 172.21.15.1:0/3223052622 >> [v2:172.21.15.107:6838/1807033208,v1:172.21.15.107:6839/1807033208] conn(0x55f161a935a0 0x55f161b5d470 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:38.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.888+0000 7fea361f3740 1 --2- 172.21.15.1:0/3223052622 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x55f1616f1270 0x55f161b4aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:38.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.888+0000 7fea361f3740 1 --2- 172.21.15.1:0/3223052622 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x55f1616d0590 0x55f161aecd60 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:38.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.888+0000 7fea03fff640 0 client.4482 ms_handle_reset on v2:172.21.15.107:6838/1807033208 2024-05-04T02:20:38.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.888+0000 7fea361f3740 1 --2- 172.21.15.1:0/3223052622 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x55f1616c83b0 0x55f161b54bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:38.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.888+0000 7fea361f3740 1 -- 172.21.15.1:0/3223052622 >> 172.21.15.1:0/3223052622 conn(0x55f1616e53c0 msgr2=0x55f161a92080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:38.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.888+0000 7fea361f3740 1 -- 172.21.15.1:0/3223052622 shutdown_connections 2024-05-04T02:20:38.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.888+0000 7fea361f3740 1 -- 172.21.15.1:0/3223052622 wait complete. 2024-05-04T02:20:38.891 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.888+0000 7fea361f3740 20 client.4482 trim_cache size 0 max 16384 2024-05-04T02:20:38.892 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-05-04T02:20:38.892 INFO:teuthology.orchestra.run.smithi001.stdout: "cluster_fsid": "b45b4a9a-b84c-4a66-907b-43f0ca45e7c0", 2024-05-04T02:20:38.892 INFO:teuthology.orchestra.run.smithi001.stdout: "whoami": 0, 2024-05-04T02:20:38.892 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 4285, 2024-05-04T02:20:38.892 INFO:teuthology.orchestra.run.smithi001.stdout: "want_state": "up:active", 2024-05-04T02:20:38.892 INFO:teuthology.orchestra.run.smithi001.stdout: "state": "up:active", 2024-05-04T02:20:38.892 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs", 2024-05-04T02:20:38.892 INFO:teuthology.orchestra.run.smithi001.stdout: "rank_uptime": 22.110597331000001, 2024-05-04T02:20:38.892 INFO:teuthology.orchestra.run.smithi001.stdout: "mdsmap_epoch": 7, 2024-05-04T02:20:38.892 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch": 23, 2024-05-04T02:20:38.892 INFO:teuthology.orchestra.run.smithi001.stdout: "osdmap_epoch_barrier": 23, 2024-05-04T02:20:38.892 INFO:teuthology.orchestra.run.smithi001.stdout: "uptime": 30.286378072000002 2024-05-04T02:20:38.893 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-05-04T02:20:38.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.888+0000 7fea2f269640 1 -- 172.21.15.1:0/267038577 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fea140762b0 msgr2=0x7fea140787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:38.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.888+0000 7fea2f269640 1 --2- 172.21.15.1:0/267038577 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fea140762b0 0x7fea140787c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fea1c009630 tx=0x7fea1c02c070 comp rx=0 tx=0).stop 2024-05-04T02:20:38.893 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.888+0000 7fea2f269640 1 -- 172.21.15.1:0/267038577 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fea280cdc20 msgr2=0x7fea2815ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:38.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.888+0000 7fea2f269640 1 --2- 172.21.15.1:0/267038577 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fea280cdc20 0x7fea2815ea00 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fea1800eab0 tx=0x7fea1800ef70 comp rx=0 tx=0).stop 2024-05-04T02:20:38.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.888+0000 7fea2f269640 1 -- 172.21.15.1:0/267038577 shutdown_connections 2024-05-04T02:20:38.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.888+0000 7fea2f269640 1 --2- 172.21.15.1:0/267038577 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fea140762b0 0x7fea140787c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:38.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.888+0000 7fea2f269640 1 --2- 172.21.15.1:0/267038577 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fea280cdc20 0x7fea2815ea00 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:38.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.888+0000 7fea2f269640 1 --2- 172.21.15.1:0/267038577 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fea280cd3e0 0x7fea281e69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:38.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.888+0000 7fea2f269640 1 --2- 172.21.15.1:0/267038577 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fea280c6f70 0x7fea28156c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:38.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.888+0000 7fea2f269640 1 -- 172.21.15.1:0/267038577 >> 172.21.15.1:0/267038577 conn(0x7fea2808e210 msgr2=0x7fea280d1750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:38.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.888+0000 7fea2f269640 1 -- 172.21.15.1:0/267038577 shutdown_connections 2024-05-04T02:20:38.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:38.888+0000 7fea2f269640 1 -- 172.21.15.1:0/267038577 wait complete. 2024-05-04T02:20:38.902 INFO:teuthology.run_tasks:Running task sequential... 2024-05-04T02:20:38.912 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-05-04T02:20:38.912 INFO:teuthology.task.sequential:In sequential, running task print... 2024-05-04T02:20:38.913 INFO:teuthology.task.print:Enabling mgr modules 2024-05-04T02:20:38.913 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-05-04T02:20:38.957 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-05-04T02:20:38.957 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-05-04T02:20:38.957 INFO:tasks.ceph_fuse:client.0 config is {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']} 2024-05-04T02:20:38.958 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-04T02:20:38.958 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-04T02:20:38.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T02:20:38.958 DEBUG:teuthology.orchestra.run.smithi001:> ip netns list 2024-05-04T02:20:38.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T02:20:38.974 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link delete ceph-brx 2024-05-04T02:20:39.040 INFO:teuthology.orchestra.run.smithi001.stderr:Cannot find device "ceph-brx" 2024-05-04T02:20:39.041 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-04T02:20:39.041 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-05-04T02:20:39.042 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-04T02:20:39.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:39.192+0000 7f0e1263b640 1 Processor -- start 2024-05-04T02:20:39.194 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:39.192+0000 7f0e1263b640 1 -- start start 2024-05-04T02:20:39.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:39.193+0000 7f0e1263b640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f0e0c15cfb0 0x7f0e0c167ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:39.195 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:39.193+0000 7f0e1263b640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e0c0cd6c0 con 0x7f0e0c0cde50 2024-05-04T02:20:39.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:39.193+0000 7f0e1263b640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e0c0cd980 con 0x7f0e0c0c7da0 2024-05-04T02:20:39.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:39.193+0000 7f0e1263b640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f0e0c0c7070 con 0x7f0e0c15cfb0 2024-05-04T02:20:39.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:39.194+0000 7f0e10bd8640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f0e0c15cfb0 0x7f0e0c167ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:39.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:39.194+0000 7f0e0b7fe640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f0e0c0c7da0 0x7f0e0c0cc590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.1:39046/0 (socket says 172.21.15.1:39046) 2024-05-04T02:20:39.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:39.194+0000 7f0e0b7fe640 1 -- 172.21.15.1:0/2578786480 learned_addr learned my addr 172.21.15.1:0/2578786480 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-05-04T02:20:39.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:39.197+0000 7f0e0affd640 1 -- 172.21.15.1:0/2578786480 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 551314367 0 0) 0x7f0e0c0cd980 con 0x7f0e0c0c7da0 2024-05-04T02:20:39.199 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:39.197+0000 7f0e0affd640 1 -- 172.21.15.1:0/2578786480 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0df4003520 con 0x7f0e0c0c7da0 2024-05-04T02:20:39.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:39.198+0000 7f0e10bd8640 1 -- 172.21.15.1:0/2578786480 >> v1:172.21.15.107:6789/0 conn(0x7f0e0c0c7da0 legacy=0x7f0e0c0cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:39.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:39.198+0000 7f0e10bd8640 1 -- 172.21.15.1:0/2578786480 >> v1:172.21.15.1:6789/0 conn(0x7f0e0c0cde50 legacy=0x7f0e0c06c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:39.200 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:39.198+0000 7f0e10bd8640 1 -- 172.21.15.1:0/2578786480 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e0c0c72c0 con 0x7f0e0c15cfb0 2024-05-04T02:20:39.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:39.203+0000 7f0e10bd8640 1 --2- 172.21.15.1:0/2578786480 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e0c15cfb0 0x7f0e0c167ec0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0e04009d90 tx=0x7f0e0402a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8b98d2138dd68cc server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:39.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:39.207+0000 7f0e0affd640 1 -- 172.21.15.1:0/2578786480 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e04037070 con 0x7f0e0c15cfb0 2024-05-04T02:20:39.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:39.207+0000 7f0e0affd640 1 -- 172.21.15.1:0/2578786480 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e04007740 con 0x7f0e0c15cfb0 2024-05-04T02:20:39.209 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:39.207+0000 7f0e0affd640 1 -- 172.21.15.1:0/2578786480 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e04007b10 con 0x7f0e0c15cfb0 2024-05-04T02:20:39.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:39.208+0000 7f0e1263b640 1 -- 172.21.15.1:0/2578786480 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e0c15cfb0 msgr2=0x7f0e0c167ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:39.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:39.208+0000 7f0e1263b640 1 --2- 172.21.15.1:0/2578786480 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e0c15cfb0 0x7f0e0c167ec0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0e04009d90 tx=0x7f0e0402a780 comp rx=0 tx=0).stop 2024-05-04T02:20:39.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:39.208+0000 7f0e1263b640 1 -- 172.21.15.1:0/2578786480 shutdown_connections 2024-05-04T02:20:39.210 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:39.208+0000 7f0e1263b640 1 --2- 172.21.15.1:0/2578786480 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e0c15cfb0 0x7f0e0c167ec0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:39.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:39.208+0000 7f0e1263b640 1 -- 172.21.15.1:0/2578786480 >> 172.21.15.1:0/2578786480 conn(0x7f0e0c0d2590 msgr2=0x7f0e0c0ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:39.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:39.208+0000 7f0e1263b640 1 -- 172.21.15.1:0/2578786480 shutdown_connections 2024-05-04T02:20:39.211 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:39.208+0000 7f0e1263b640 1 -- 172.21.15.1:0/2578786480 wait complete. 2024-05-04T02:20:39.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:39.210+0000 7f0e1263b640 1 Processor -- start 2024-05-04T02:20:39.212 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:39.210+0000 7f0e1263b640 1 -- start start 2024-05-04T02:20:39.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:39.211+0000 7f0e1263b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e0c0c7da0 0x7f0e0c158fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:39.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:39.211+0000 7f0e1263b640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0e0c15cfb0 0x7f0e0c0d0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:39.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:39.211+0000 7f0e1263b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e0c156e20 0x7f0e0c0b5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:39.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:39.211+0000 7f0e1263b640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f0e0c15d3c0 con 0x7f0e0c0c7da0 2024-05-04T02:20:39.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:39.211+0000 7f0e1263b640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f0e0c0c7880 con 0x7f0e0c156e20 2024-05-04T02:20:39.214 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:39.211+0000 7f0e1263b640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f0e0c156b40 con 0x7f0e0c15cfb0 2024-05-04T02:20:39.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:39.212+0000 7f0e0bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e0c0c7da0 0x7f0e0c158fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:39.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:39.212+0000 7f0e0b7fe640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0e0c15cfb0 0x7f0e0c0d0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:39.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:39.212+0000 7f0e0bfff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e0c0c7da0 0x7f0e0c158fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:41034/0 (socket says 172.21.15.1:41034) 2024-05-04T02:20:39.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:39.212+0000 7f0e0bfff640 1 -- 172.21.15.1:0/6250167 learned_addr learned my addr 172.21.15.1:0/6250167 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:20:39.215 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:39.212+0000 7f0e10bd8640 1 --2- 172.21.15.1:0/6250167 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e0c156e20 0x7f0e0c0b5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:39.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:39.216+0000 7f0e0bfff640 1 -- 172.21.15.1:0/6250167 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0e0c15cfb0 msgr2=0x7f0e0c0d0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:39.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:39.216+0000 7f0e0bfff640 1 --2- 172.21.15.1:0/6250167 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0e0c15cfb0 0x7f0e0c0d0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:39.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:39.216+0000 7f0e0bfff640 1 -- 172.21.15.1:0/6250167 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e0c156e20 msgr2=0x7f0e0c0b5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:39.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:39.216+0000 7f0e0bfff640 1 --2- 172.21.15.1:0/6250167 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e0c156e20 0x7f0e0c0b5320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:39.219 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:39.216+0000 7f0e0bfff640 1 -- 172.21.15.1:0/6250167 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e0c159c80 con 0x7f0e0c0c7da0 2024-05-04T02:20:39.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:39.219+0000 7f0e0bfff640 1 --2- 172.21.15.1:0/6250167 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e0c0c7da0 0x7f0e0c158fa0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc00c400 tx=0x7f0dfc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:39.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:39.223+0000 7f0e08ff9640 1 -- 172.21.15.1:0/6250167 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dfc017070 con 0x7f0e0c0c7da0 2024-05-04T02:20:39.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:39.223+0000 7f0e08ff9640 1 -- 172.21.15.1:0/6250167 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0dfc0052d0 con 0x7f0e0c0c7da0 2024-05-04T02:20:39.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:39.223+0000 7f0e1263b640 1 -- 172.21.15.1:0/6250167 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e0c1f58a0 con 0x7f0e0c0c7da0 2024-05-04T02:20:39.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:39.223+0000 7f0e08ff9640 1 -- 172.21.15.1:0/6250167 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dfc0037f0 con 0x7f0e0c0c7da0 2024-05-04T02:20:39.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:39.223+0000 7f0e1263b640 1 -- 172.21.15.1:0/6250167 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e0c1e73a0 con 0x7f0e0c0c7da0 2024-05-04T02:20:39.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:39.224+0000 7f0e1263b640 1 -- 172.21.15.1:0/6250167 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e0c069bc0 con 0x7f0e0c0c7da0 2024-05-04T02:20:39.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:39.246+0000 7f0e08ff9640 1 -- 172.21.15.1:0/6250167 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0dfc01a070 con 0x7f0e0c0c7da0 2024-05-04T02:20:39.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:39.247+0000 7f0e08ff9640 1 --2- 172.21.15.1:0/6250167 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f0df80762d0 0x7f0df80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:20:39.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:39.247+0000 7f0e0b7fe640 1 --2- 172.21.15.1:0/6250167 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f0df80762d0 0x7f0df80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:20:39.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:39.247+0000 7f0e0b7fe640 1 --2- 172.21.15.1:0/6250167 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f0df80762d0 0x7f0df80787e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c0b51e0 tx=0x7f0e00006aa0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:20:39.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:39.537+0000 7f0e08ff9640 1 -- 172.21.15.1:0/6250167 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f0dfc05c2c0 con 0x7f0e0c0c7da0 2024-05-04T02:20:39.540 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:39.537+0000 7f0e08ff9640 1 -- 172.21.15.1:0/6250167 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0dfc060030 con 0x7f0e0c0c7da0 2024-05-04T02:20:39.779 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:39.777+0000 7f0e1263b640 1 -- 172.21.15.1:0/6250167 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f0e0c0c6c40 con 0x7f0e0c0c7da0 2024-05-04T02:20:39.786 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:39.784+0000 7f0e08ff9640 1 -- 172.21.15.1:0/6250167 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+73 (secure 0 0 0) 0x7f0dfc064330 con 0x7f0e0c0c7da0 2024-05-04T02:20:39.786 INFO:teuthology.orchestra.run.smithi001.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-04T02:20:39.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:39.786+0000 7f0e1263b640 1 -- 172.21.15.1:0/6250167 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f0df80762d0 msgr2=0x7f0df80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:39.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:39.786+0000 7f0e1263b640 1 --2- 172.21.15.1:0/6250167 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f0df80762d0 0x7f0df80787e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c0b51e0 tx=0x7f0e00006aa0 comp rx=0 tx=0).stop 2024-05-04T02:20:39.788 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:39.786+0000 7f0e1263b640 1 -- 172.21.15.1:0/6250167 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e0c0c7da0 msgr2=0x7f0e0c158fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:20:39.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:39.786+0000 7f0e1263b640 1 --2- 172.21.15.1:0/6250167 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e0c0c7da0 0x7f0e0c158fa0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc00c400 tx=0x7f0dfc00c8c0 comp rx=0 tx=0).stop 2024-05-04T02:20:39.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:39.786+0000 7f0e1263b640 1 -- 172.21.15.1:0/6250167 shutdown_connections 2024-05-04T02:20:39.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:39.786+0000 7f0e1263b640 1 --2- 172.21.15.1:0/6250167 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f0df80762d0 0x7f0df80787e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:39.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:39.786+0000 7f0e1263b640 1 --2- 172.21.15.1:0/6250167 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f0e0c156e20 0x7f0e0c0b5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:39.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:39.786+0000 7f0e1263b640 1 --2- 172.21.15.1:0/6250167 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f0e0c15cfb0 0x7f0e0c0d0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:39.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:39.786+0000 7f0e1263b640 1 --2- 172.21.15.1:0/6250167 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f0e0c0c7da0 0x7f0e0c158fa0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:20:39.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:39.786+0000 7f0e1263b640 1 -- 172.21.15.1:0/6250167 >> 172.21.15.1:0/6250167 conn(0x7f0e0c0d2590 msgr2=0x7f0e0c06d910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:20:39.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:39.786+0000 7f0e1263b640 1 -- 172.21.15.1:0/6250167 shutdown_connections 2024-05-04T02:20:39.789 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:39.786+0000 7f0e1263b640 1 -- 172.21.15.1:0/6250167 wait complete. 2024-05-04T02:20:39.799 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-04T02:20:39.799 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-04T02:20:39.799 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi001.front.sepia.ceph.com 2024-05-04T02:20:39.800 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-04T02:20:39.800 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-04T02:20:39.800 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-04T02:20:39.800 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-04T02:20:39.800 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-04T02:20:39.800 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-04T02:20:39.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T02:20:39.800 DEBUG:teuthology.orchestra.run.smithi001:> ip addr 2024-05-04T02:20:39.815 INFO:teuthology.orchestra.run.smithi001.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-04T02:20:39.815 INFO:teuthology.orchestra.run.smithi001.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-04T02:20:39.815 INFO:teuthology.orchestra.run.smithi001.stdout: inet 127.0.0.1/8 scope host lo 2024-05-04T02:20:39.815 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2024-05-04T02:20:39.816 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 ::1/128 scope host 2024-05-04T02:20:39.816 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2024-05-04T02:20:39.816 INFO:teuthology.orchestra.run.smithi001.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-04T02:20:39.816 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:6b:f6:7a brd ff:ff:ff:ff:ff:ff 2024-05-04T02:20:39.816 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp7s0f0 2024-05-04T02:20:39.816 INFO:teuthology.orchestra.run.smithi001.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-04T02:20:39.816 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:6b:f6:7b brd ff:ff:ff:ff:ff:ff 2024-05-04T02:20:39.816 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp7s0f1 2024-05-04T02:20:39.816 INFO:teuthology.orchestra.run.smithi001.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-04T02:20:39.816 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:bd:15:e8 brd ff:ff:ff:ff:ff:ff 2024-05-04T02:20:39.816 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp1s0f0 2024-05-04T02:20:39.816 INFO:teuthology.orchestra.run.smithi001.stdout: inet 172.21.15.1/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-05-04T02:20:39.816 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft 42302sec preferred_lft 42302sec 2024-05-04T02:20:39.816 INFO:teuthology.orchestra.run.smithi001.stdout: inet6 fe80::ec4:7aff:febd:15e8/64 scope link noprefixroute 2024-05-04T02:20:39.816 INFO:teuthology.orchestra.run.smithi001.stdout: valid_lft forever preferred_lft forever 2024-05-04T02:20:39.817 INFO:teuthology.orchestra.run.smithi001.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-04T02:20:39.817 INFO:teuthology.orchestra.run.smithi001.stdout: link/ether 0c:c4:7a:bd:15:e9 brd ff:ff:ff:ff:ff:ff 2024-05-04T02:20:39.817 INFO:teuthology.orchestra.run.smithi001.stdout: altname enp1s0f1 2024-05-04T02:20:39.817 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-04T02:20:39.817 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-04T02:20:39.817 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2024-05-04T02:20:39.817 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link add name ceph-brx type bridge 2024-05-04T02:20:39.817 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip addr flush dev ceph-brx 2024-05-04T02:20:39.817 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link set ceph-brx up 2024-05-04T02:20:39.818 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-04T02:20:39.818 DEBUG:teuthology.orchestra.run.smithi001:> ') 2024-05-04T02:20:39.905 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-04T02:20:39.991 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-04T02:20:39.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T02:20:39.997 DEBUG:teuthology.orchestra.run.smithi001:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-04T02:20:40.021 INFO:teuthology.orchestra.run.smithi001.stdout:1 2024-05-04T02:20:40.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T02:20:40.023 DEBUG:teuthology.orchestra.run.smithi001:> route 2024-05-04T02:20:40.089 INFO:teuthology.orchestra.run.smithi001.stdout:Kernel IP routing table 2024-05-04T02:20:40.089 INFO:teuthology.orchestra.run.smithi001.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-04T02:20:40.089 INFO:teuthology.orchestra.run.smithi001.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-04T02:20:40.089 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-04T02:20:40.089 INFO:teuthology.orchestra.run.smithi001.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-04T02:20:40.090 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-04T02:20:40.090 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2024-05-04T02:20:40.090 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-04T02:20:40.090 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-04T02:20:40.090 DEBUG:teuthology.orchestra.run.smithi001:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-04T02:20:40.090 DEBUG:teuthology.orchestra.run.smithi001:> ') 2024-05-04T02:20:40.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-04T02:20:40.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-04T02:20:40.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T02:20:40.363 DEBUG:teuthology.orchestra.run.smithi001:> ip netns list 2024-05-04T02:20:40.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T02:20:40.379 DEBUG:teuthology.orchestra.run.smithi001:> ip netns list-id 2024-05-04T02:20:40.435 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-04T02:20:40.435 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2024-05-04T02:20:40.435 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-04T02:20:40.435 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-05-04T02:20:40.435 DEBUG:teuthology.orchestra.run.smithi001:> ') 2024-05-04T02:20:40.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-04T02:20:40.565 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-04T02:20:40.573 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-05-04T02:20:40.573 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-04T02:20:40.573 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2024-05-04T02:20:40.573 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-05-04T02:20:40.573 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-04T02:20:40.573 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-05-04T02:20:40.574 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-05-04T02:20:40.574 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-05-04T02:20:40.574 DEBUG:teuthology.orchestra.run.smithi001:> ') 2024-05-04T02:20:40.624 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-04T02:20:40.699 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-04T02:20:40.705 DEBUG:teuthology.orchestra.run.smithi001:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-04T02:20:40.705 DEBUG:teuthology.orchestra.run.smithi001:> set -e 2024-05-04T02:20:40.705 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link set brx.0 up 2024-05-04T02:20:40.705 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link set dev brx.0 master ceph-brx 2024-05-04T02:20:40.705 DEBUG:teuthology.orchestra.run.smithi001:> ') 2024-05-04T02:20:40.758 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-04T02:20:40.780 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-04T02:20:40.788 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']} 2024-05-04T02:20:40.788 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-04T02:20:40.788 DEBUG:teuthology.orchestra.run.smithi001:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-04T02:20:40.803 INFO:teuthology.orchestra.run.smithi001.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-04T02:20:40.804 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-04T02:20:40.804 DEBUG:teuthology.orchestra.run.smithi001:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-04T02:20:40.859 DEBUG:tasks.ceph_manager:running client.0 under valgrind with args ['sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/client.0.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-05-04T02:20:40.859 DEBUG:teuthology.orchestra.run.smithi001:> sudo modprobe fuse 2024-05-04T02:20:40.925 DEBUG:teuthology.orchestra.run.smithi001:> cat /proc/self/mounts | awk '{print $2}' 2024-05-04T02:20:40.980 INFO:teuthology.orchestra.run.smithi001.stdout:/proc 2024-05-04T02:20:40.981 INFO:teuthology.orchestra.run.smithi001.stdout:/sys 2024-05-04T02:20:40.981 INFO:teuthology.orchestra.run.smithi001.stdout:/dev 2024-05-04T02:20:40.981 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/security 2024-05-04T02:20:40.981 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/shm 2024-05-04T02:20:40.981 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/pts 2024-05-04T02:20:40.981 INFO:teuthology.orchestra.run.smithi001.stdout:/run 2024-05-04T02:20:40.981 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/cgroup 2024-05-04T02:20:40.981 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/pstore 2024-05-04T02:20:40.981 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/bpf 2024-05-04T02:20:40.981 INFO:teuthology.orchestra.run.smithi001.stdout:/ 2024-05-04T02:20:40.981 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/selinux 2024-05-04T02:20:40.981 INFO:teuthology.orchestra.run.smithi001.stdout:/proc/sys/fs/binfmt_misc 2024-05-04T02:20:40.981 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/mqueue 2024-05-04T02:20:40.981 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/hugepages 2024-05-04T02:20:40.982 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/debug 2024-05-04T02:20:40.982 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/tracing 2024-05-04T02:20:40.982 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/config 2024-05-04T02:20:40.982 INFO:teuthology.orchestra.run.smithi001.stdout:/run/credentials/systemd-sysusers.service 2024-05-04T02:20:40.982 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/fuse/connections 2024-05-04T02:20:40.982 INFO:teuthology.orchestra.run.smithi001.stdout:/run/credentials/systemd-sysctl.service 2024-05-04T02:20:40.982 INFO:teuthology.orchestra.run.smithi001.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-04T02:20:40.982 INFO:teuthology.orchestra.run.smithi001.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-04T02:20:40.982 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/nfs/rpc_pipefs 2024-05-04T02:20:40.982 INFO:teuthology.orchestra.run.smithi001.stdout:/run/user/1000 2024-05-04T02:20:40.982 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph 2024-05-04T02:20:40.982 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-0 2024-05-04T02:20:40.982 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-1 2024-05-04T02:20:40.983 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-2 2024-05-04T02:20:40.983 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-3 2024-05-04T02:20:40.983 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns 2024-05-04T02:20:40.983 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-04T02:20:40.983 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-04T02:20:40.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T02:20:40.983 DEBUG:teuthology.orchestra.run.smithi001:> ls /sys/fs/fuse/connections 2024-05-04T02:20:41.035 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-04T02:20:41.036 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/client.0.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-05-04T02:20:41.078 DEBUG:teuthology.orchestra.run.smithi001:> sudo modprobe fuse 2024-05-04T02:20:41.102 DEBUG:teuthology.orchestra.run.smithi001:> cat /proc/self/mounts | awk '{print $2}' 2024-05-04T02:20:41.158 INFO:teuthology.orchestra.run.smithi001.stdout:/proc 2024-05-04T02:20:41.159 INFO:teuthology.orchestra.run.smithi001.stdout:/sys 2024-05-04T02:20:41.159 INFO:teuthology.orchestra.run.smithi001.stdout:/dev 2024-05-04T02:20:41.159 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/security 2024-05-04T02:20:41.159 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/shm 2024-05-04T02:20:41.159 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/pts 2024-05-04T02:20:41.159 INFO:teuthology.orchestra.run.smithi001.stdout:/run 2024-05-04T02:20:41.159 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/cgroup 2024-05-04T02:20:41.159 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/pstore 2024-05-04T02:20:41.159 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/bpf 2024-05-04T02:20:41.159 INFO:teuthology.orchestra.run.smithi001.stdout:/ 2024-05-04T02:20:41.159 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/selinux 2024-05-04T02:20:41.159 INFO:teuthology.orchestra.run.smithi001.stdout:/proc/sys/fs/binfmt_misc 2024-05-04T02:20:41.159 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/mqueue 2024-05-04T02:20:41.160 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/hugepages 2024-05-04T02:20:41.160 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/debug 2024-05-04T02:20:41.160 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/tracing 2024-05-04T02:20:41.160 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/config 2024-05-04T02:20:41.160 INFO:teuthology.orchestra.run.smithi001.stdout:/run/credentials/systemd-sysusers.service 2024-05-04T02:20:41.160 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/fuse/connections 2024-05-04T02:20:41.160 INFO:teuthology.orchestra.run.smithi001.stdout:/run/credentials/systemd-sysctl.service 2024-05-04T02:20:41.160 INFO:teuthology.orchestra.run.smithi001.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-04T02:20:41.160 INFO:teuthology.orchestra.run.smithi001.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-04T02:20:41.160 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/nfs/rpc_pipefs 2024-05-04T02:20:41.160 INFO:teuthology.orchestra.run.smithi001.stdout:/run/user/1000 2024-05-04T02:20:41.160 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph 2024-05-04T02:20:41.160 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-0 2024-05-04T02:20:41.160 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-1 2024-05-04T02:20:41.161 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-2 2024-05-04T02:20:41.161 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-3 2024-05-04T02:20:41.161 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns 2024-05-04T02:20:41.161 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-04T02:20:41.161 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-04T02:20:41.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T02:20:41.162 DEBUG:teuthology.orchestra.run.smithi001:> ls /sys/fs/fuse/connections 2024-05-04T02:20:42.318 DEBUG:teuthology.orchestra.run.smithi001:> sudo modprobe fuse 2024-05-04T02:20:42.344 DEBUG:teuthology.orchestra.run.smithi001:> cat /proc/self/mounts | awk '{print $2}' 2024-05-04T02:20:42.400 INFO:teuthology.orchestra.run.smithi001.stdout:/proc 2024-05-04T02:20:42.400 INFO:teuthology.orchestra.run.smithi001.stdout:/sys 2024-05-04T02:20:42.400 INFO:teuthology.orchestra.run.smithi001.stdout:/dev 2024-05-04T02:20:42.400 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/security 2024-05-04T02:20:42.400 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/shm 2024-05-04T02:20:42.400 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/pts 2024-05-04T02:20:42.400 INFO:teuthology.orchestra.run.smithi001.stdout:/run 2024-05-04T02:20:42.400 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/cgroup 2024-05-04T02:20:42.400 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/pstore 2024-05-04T02:20:42.400 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/bpf 2024-05-04T02:20:42.401 INFO:teuthology.orchestra.run.smithi001.stdout:/ 2024-05-04T02:20:42.401 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/selinux 2024-05-04T02:20:42.401 INFO:teuthology.orchestra.run.smithi001.stdout:/proc/sys/fs/binfmt_misc 2024-05-04T02:20:42.401 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/mqueue 2024-05-04T02:20:42.401 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/hugepages 2024-05-04T02:20:42.401 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/debug 2024-05-04T02:20:42.401 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/tracing 2024-05-04T02:20:42.401 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/config 2024-05-04T02:20:42.401 INFO:teuthology.orchestra.run.smithi001.stdout:/run/credentials/systemd-sysusers.service 2024-05-04T02:20:42.401 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/fuse/connections 2024-05-04T02:20:42.401 INFO:teuthology.orchestra.run.smithi001.stdout:/run/credentials/systemd-sysctl.service 2024-05-04T02:20:42.401 INFO:teuthology.orchestra.run.smithi001.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-04T02:20:42.401 INFO:teuthology.orchestra.run.smithi001.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-04T02:20:42.402 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/nfs/rpc_pipefs 2024-05-04T02:20:42.402 INFO:teuthology.orchestra.run.smithi001.stdout:/run/user/1000 2024-05-04T02:20:42.402 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph 2024-05-04T02:20:42.402 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-0 2024-05-04T02:20:42.402 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-1 2024-05-04T02:20:42.402 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-2 2024-05-04T02:20:42.402 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-3 2024-05-04T02:20:42.402 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns 2024-05-04T02:20:42.402 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-04T02:20:42.402 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-04T02:20:42.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T02:20:42.403 DEBUG:teuthology.orchestra.run.smithi001:> ls /sys/fs/fuse/connections 2024-05-04T02:20:43.560 DEBUG:teuthology.orchestra.run.smithi001:> sudo modprobe fuse 2024-05-04T02:20:43.585 DEBUG:teuthology.orchestra.run.smithi001:> cat /proc/self/mounts | awk '{print $2}' 2024-05-04T02:20:43.641 INFO:teuthology.orchestra.run.smithi001.stdout:/proc 2024-05-04T02:20:43.641 INFO:teuthology.orchestra.run.smithi001.stdout:/sys 2024-05-04T02:20:43.641 INFO:teuthology.orchestra.run.smithi001.stdout:/dev 2024-05-04T02:20:43.641 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/security 2024-05-04T02:20:43.641 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/shm 2024-05-04T02:20:43.642 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/pts 2024-05-04T02:20:43.642 INFO:teuthology.orchestra.run.smithi001.stdout:/run 2024-05-04T02:20:43.642 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/cgroup 2024-05-04T02:20:43.642 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/pstore 2024-05-04T02:20:43.642 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/bpf 2024-05-04T02:20:43.642 INFO:teuthology.orchestra.run.smithi001.stdout:/ 2024-05-04T02:20:43.642 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/selinux 2024-05-04T02:20:43.642 INFO:teuthology.orchestra.run.smithi001.stdout:/proc/sys/fs/binfmt_misc 2024-05-04T02:20:43.642 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/mqueue 2024-05-04T02:20:43.642 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/hugepages 2024-05-04T02:20:43.642 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/debug 2024-05-04T02:20:43.642 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/tracing 2024-05-04T02:20:43.642 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/config 2024-05-04T02:20:43.643 INFO:teuthology.orchestra.run.smithi001.stdout:/run/credentials/systemd-sysusers.service 2024-05-04T02:20:43.643 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/fuse/connections 2024-05-04T02:20:43.643 INFO:teuthology.orchestra.run.smithi001.stdout:/run/credentials/systemd-sysctl.service 2024-05-04T02:20:43.643 INFO:teuthology.orchestra.run.smithi001.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-04T02:20:43.643 INFO:teuthology.orchestra.run.smithi001.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-04T02:20:43.643 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/nfs/rpc_pipefs 2024-05-04T02:20:43.643 INFO:teuthology.orchestra.run.smithi001.stdout:/run/user/1000 2024-05-04T02:20:43.643 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph 2024-05-04T02:20:43.643 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-0 2024-05-04T02:20:43.643 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-1 2024-05-04T02:20:43.643 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-2 2024-05-04T02:20:43.643 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-3 2024-05-04T02:20:43.643 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns 2024-05-04T02:20:43.643 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-04T02:20:43.644 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-04T02:20:43.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T02:20:43.644 DEBUG:teuthology.orchestra.run.smithi001:> ls /sys/fs/fuse/connections 2024-05-04T02:20:44.797 DEBUG:teuthology.orchestra.run.smithi001:> sudo modprobe fuse 2024-05-04T02:20:44.822 DEBUG:teuthology.orchestra.run.smithi001:> cat /proc/self/mounts | awk '{print $2}' 2024-05-04T02:20:44.879 INFO:teuthology.orchestra.run.smithi001.stdout:/proc 2024-05-04T02:20:44.879 INFO:teuthology.orchestra.run.smithi001.stdout:/sys 2024-05-04T02:20:44.879 INFO:teuthology.orchestra.run.smithi001.stdout:/dev 2024-05-04T02:20:44.879 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/security 2024-05-04T02:20:44.879 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/shm 2024-05-04T02:20:44.879 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/pts 2024-05-04T02:20:44.879 INFO:teuthology.orchestra.run.smithi001.stdout:/run 2024-05-04T02:20:44.880 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/cgroup 2024-05-04T02:20:44.880 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/pstore 2024-05-04T02:20:44.880 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/bpf 2024-05-04T02:20:44.880 INFO:teuthology.orchestra.run.smithi001.stdout:/ 2024-05-04T02:20:44.880 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/selinux 2024-05-04T02:20:44.880 INFO:teuthology.orchestra.run.smithi001.stdout:/proc/sys/fs/binfmt_misc 2024-05-04T02:20:44.880 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/mqueue 2024-05-04T02:20:44.880 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/hugepages 2024-05-04T02:20:44.880 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/debug 2024-05-04T02:20:44.880 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/tracing 2024-05-04T02:20:44.880 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/config 2024-05-04T02:20:44.880 INFO:teuthology.orchestra.run.smithi001.stdout:/run/credentials/systemd-sysusers.service 2024-05-04T02:20:44.881 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/fuse/connections 2024-05-04T02:20:44.881 INFO:teuthology.orchestra.run.smithi001.stdout:/run/credentials/systemd-sysctl.service 2024-05-04T02:20:44.881 INFO:teuthology.orchestra.run.smithi001.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-04T02:20:44.881 INFO:teuthology.orchestra.run.smithi001.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-04T02:20:44.881 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/nfs/rpc_pipefs 2024-05-04T02:20:44.881 INFO:teuthology.orchestra.run.smithi001.stdout:/run/user/1000 2024-05-04T02:20:44.881 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph 2024-05-04T02:20:44.881 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-0 2024-05-04T02:20:44.881 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-1 2024-05-04T02:20:44.881 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-2 2024-05-04T02:20:44.881 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-3 2024-05-04T02:20:44.881 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns 2024-05-04T02:20:44.881 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-04T02:20:44.881 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-04T02:20:44.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T02:20:44.882 DEBUG:teuthology.orchestra.run.smithi001:> ls /sys/fs/fuse/connections 2024-05-04T02:20:46.034 DEBUG:teuthology.orchestra.run.smithi001:> sudo modprobe fuse 2024-05-04T02:20:46.060 DEBUG:teuthology.orchestra.run.smithi001:> cat /proc/self/mounts | awk '{print $2}' 2024-05-04T02:20:46.117 INFO:teuthology.orchestra.run.smithi001.stdout:/proc 2024-05-04T02:20:46.117 INFO:teuthology.orchestra.run.smithi001.stdout:/sys 2024-05-04T02:20:46.117 INFO:teuthology.orchestra.run.smithi001.stdout:/dev 2024-05-04T02:20:46.117 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/security 2024-05-04T02:20:46.117 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/shm 2024-05-04T02:20:46.117 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/pts 2024-05-04T02:20:46.117 INFO:teuthology.orchestra.run.smithi001.stdout:/run 2024-05-04T02:20:46.117 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/cgroup 2024-05-04T02:20:46.118 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/pstore 2024-05-04T02:20:46.118 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/bpf 2024-05-04T02:20:46.118 INFO:teuthology.orchestra.run.smithi001.stdout:/ 2024-05-04T02:20:46.118 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/selinux 2024-05-04T02:20:46.118 INFO:teuthology.orchestra.run.smithi001.stdout:/proc/sys/fs/binfmt_misc 2024-05-04T02:20:46.118 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/mqueue 2024-05-04T02:20:46.118 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/hugepages 2024-05-04T02:20:46.118 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/debug 2024-05-04T02:20:46.118 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/tracing 2024-05-04T02:20:46.118 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/config 2024-05-04T02:20:46.118 INFO:teuthology.orchestra.run.smithi001.stdout:/run/credentials/systemd-sysusers.service 2024-05-04T02:20:46.118 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/fuse/connections 2024-05-04T02:20:46.118 INFO:teuthology.orchestra.run.smithi001.stdout:/run/credentials/systemd-sysctl.service 2024-05-04T02:20:46.119 INFO:teuthology.orchestra.run.smithi001.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-04T02:20:46.119 INFO:teuthology.orchestra.run.smithi001.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-04T02:20:46.119 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/nfs/rpc_pipefs 2024-05-04T02:20:46.119 INFO:teuthology.orchestra.run.smithi001.stdout:/run/user/1000 2024-05-04T02:20:46.119 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph 2024-05-04T02:20:46.119 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-0 2024-05-04T02:20:46.119 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-1 2024-05-04T02:20:46.119 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-2 2024-05-04T02:20:46.119 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-3 2024-05-04T02:20:46.119 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns 2024-05-04T02:20:46.119 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-04T02:20:46.119 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-04T02:20:46.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T02:20:46.120 DEBUG:teuthology.orchestra.run.smithi001:> ls /sys/fs/fuse/connections 2024-05-04T02:20:47.274 DEBUG:teuthology.orchestra.run.smithi001:> sudo modprobe fuse 2024-05-04T02:20:47.299 DEBUG:teuthology.orchestra.run.smithi001:> cat /proc/self/mounts | awk '{print $2}' 2024-05-04T02:20:47.355 INFO:teuthology.orchestra.run.smithi001.stdout:/proc 2024-05-04T02:20:47.355 INFO:teuthology.orchestra.run.smithi001.stdout:/sys 2024-05-04T02:20:47.355 INFO:teuthology.orchestra.run.smithi001.stdout:/dev 2024-05-04T02:20:47.355 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/security 2024-05-04T02:20:47.355 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/shm 2024-05-04T02:20:47.355 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/pts 2024-05-04T02:20:47.355 INFO:teuthology.orchestra.run.smithi001.stdout:/run 2024-05-04T02:20:47.355 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/cgroup 2024-05-04T02:20:47.355 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/pstore 2024-05-04T02:20:47.355 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/bpf 2024-05-04T02:20:47.355 INFO:teuthology.orchestra.run.smithi001.stdout:/ 2024-05-04T02:20:47.355 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/selinux 2024-05-04T02:20:47.356 INFO:teuthology.orchestra.run.smithi001.stdout:/proc/sys/fs/binfmt_misc 2024-05-04T02:20:47.356 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/mqueue 2024-05-04T02:20:47.356 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/hugepages 2024-05-04T02:20:47.356 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/debug 2024-05-04T02:20:47.356 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/tracing 2024-05-04T02:20:47.356 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/config 2024-05-04T02:20:47.356 INFO:teuthology.orchestra.run.smithi001.stdout:/run/credentials/systemd-sysusers.service 2024-05-04T02:20:47.356 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/fuse/connections 2024-05-04T02:20:47.356 INFO:teuthology.orchestra.run.smithi001.stdout:/run/credentials/systemd-sysctl.service 2024-05-04T02:20:47.356 INFO:teuthology.orchestra.run.smithi001.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-04T02:20:47.356 INFO:teuthology.orchestra.run.smithi001.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-04T02:20:47.356 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/nfs/rpc_pipefs 2024-05-04T02:20:47.356 INFO:teuthology.orchestra.run.smithi001.stdout:/run/user/1000 2024-05-04T02:20:47.356 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph 2024-05-04T02:20:47.357 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-0 2024-05-04T02:20:47.357 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-1 2024-05-04T02:20:47.357 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-2 2024-05-04T02:20:47.357 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-3 2024-05-04T02:20:47.357 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns 2024-05-04T02:20:47.357 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-04T02:20:47.357 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-04T02:20:47.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T02:20:47.357 DEBUG:teuthology.orchestra.run.smithi001:> ls /sys/fs/fuse/connections 2024-05-04T02:20:47.614 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi001.stderr:ceph-fuse[2024-05-04T02:20:47.495+0000 6782280 -1 init, newargv = 0xbcf5950 newargc=15 2024-05-04T02:20:47.618 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi001.stderr:41971]: starting ceph client 2024-05-04T02:20:48.511 DEBUG:teuthology.orchestra.run.smithi001:> sudo modprobe fuse 2024-05-04T02:20:48.536 DEBUG:teuthology.orchestra.run.smithi001:> cat /proc/self/mounts | awk '{print $2}' 2024-05-04T02:20:48.593 INFO:teuthology.orchestra.run.smithi001.stdout:/proc 2024-05-04T02:20:48.593 INFO:teuthology.orchestra.run.smithi001.stdout:/sys 2024-05-04T02:20:48.593 INFO:teuthology.orchestra.run.smithi001.stdout:/dev 2024-05-04T02:20:48.593 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/security 2024-05-04T02:20:48.593 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/shm 2024-05-04T02:20:48.593 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/pts 2024-05-04T02:20:48.593 INFO:teuthology.orchestra.run.smithi001.stdout:/run 2024-05-04T02:20:48.593 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/cgroup 2024-05-04T02:20:48.593 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/pstore 2024-05-04T02:20:48.594 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/bpf 2024-05-04T02:20:48.594 INFO:teuthology.orchestra.run.smithi001.stdout:/ 2024-05-04T02:20:48.594 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/selinux 2024-05-04T02:20:48.594 INFO:teuthology.orchestra.run.smithi001.stdout:/proc/sys/fs/binfmt_misc 2024-05-04T02:20:48.594 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/mqueue 2024-05-04T02:20:48.594 INFO:teuthology.orchestra.run.smithi001.stdout:/dev/hugepages 2024-05-04T02:20:48.594 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/debug 2024-05-04T02:20:48.594 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/tracing 2024-05-04T02:20:48.594 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/kernel/config 2024-05-04T02:20:48.594 INFO:teuthology.orchestra.run.smithi001.stdout:/run/credentials/systemd-sysusers.service 2024-05-04T02:20:48.594 INFO:teuthology.orchestra.run.smithi001.stdout:/sys/fs/fuse/connections 2024-05-04T02:20:48.594 INFO:teuthology.orchestra.run.smithi001.stdout:/run/credentials/systemd-sysctl.service 2024-05-04T02:20:48.594 INFO:teuthology.orchestra.run.smithi001.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-04T02:20:48.594 INFO:teuthology.orchestra.run.smithi001.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-04T02:20:48.595 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/nfs/rpc_pipefs 2024-05-04T02:20:48.595 INFO:teuthology.orchestra.run.smithi001.stdout:/run/user/1000 2024-05-04T02:20:48.595 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph 2024-05-04T02:20:48.595 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-0 2024-05-04T02:20:48.595 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-1 2024-05-04T02:20:48.595 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-2 2024-05-04T02:20:48.595 INFO:teuthology.orchestra.run.smithi001.stdout:/var/lib/ceph/osd/ceph-3 2024-05-04T02:20:48.595 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns 2024-05-04T02:20:48.595 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-04T02:20:48.595 INFO:teuthology.orchestra.run.smithi001.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-04T02:20:48.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T02:20:48.596 DEBUG:teuthology.orchestra.run.smithi001:> ls /sys/fs/fuse/connections 2024-05-04T02:20:48.603 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi001.stderr:ceph-fuse[41971]: starting fuse 2024-05-04T02:20:48.616 INFO:teuthology.orchestra.run.smithi001.stdout:43 2024-05-04T02:20:48.617 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-05-04T02:20:48.617 DEBUG:teuthology.orchestra.run.smithi001:> sudo stdin-killer -- python3 -c ' 2024-05-04T02:20:48.617 DEBUG:teuthology.orchestra.run.smithi001:> import glob 2024-05-04T02:20:48.617 DEBUG:teuthology.orchestra.run.smithi001:> import re 2024-05-04T02:20:48.617 DEBUG:teuthology.orchestra.run.smithi001:> import os 2024-05-04T02:20:48.617 DEBUG:teuthology.orchestra.run.smithi001:> import subprocess 2024-05-04T02:20:48.617 DEBUG:teuthology.orchestra.run.smithi001:> 2024-05-04T02:20:48.617 DEBUG:teuthology.orchestra.run.smithi001:> def _find_admin_socket(client_name): 2024-05-04T02:20:48.617 DEBUG:teuthology.orchestra.run.smithi001:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-05-04T02:20:48.617 DEBUG:teuthology.orchestra.run.smithi001:> files = glob.glob(asok_path) 2024-05-04T02:20:48.617 DEBUG:teuthology.orchestra.run.smithi001:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-05-04T02:20:48.617 DEBUG:teuthology.orchestra.run.smithi001:> 2024-05-04T02:20:48.618 DEBUG:teuthology.orchestra.run.smithi001:> # Given a non-glob path, it better be there 2024-05-04T02:20:48.618 DEBUG:teuthology.orchestra.run.smithi001:> if "*" not in asok_path: 2024-05-04T02:20:48.618 DEBUG:teuthology.orchestra.run.smithi001:> assert(len(files) == 1) 2024-05-04T02:20:48.618 DEBUG:teuthology.orchestra.run.smithi001:> return files[0] 2024-05-04T02:20:48.618 DEBUG:teuthology.orchestra.run.smithi001:> 2024-05-04T02:20:48.618 DEBUG:teuthology.orchestra.run.smithi001:> for f in files: 2024-05-04T02:20:48.618 DEBUG:teuthology.orchestra.run.smithi001:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-04T02:20:48.618 DEBUG:teuthology.orchestra.run.smithi001:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-04T02:20:48.618 DEBUG:teuthology.orchestra.run.smithi001:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-04T02:20:48.618 DEBUG:teuthology.orchestra.run.smithi001:> contents = proc_f.read() 2024-05-04T02:20:48.618 DEBUG:teuthology.orchestra.run.smithi001:> if mountpoint in contents: 2024-05-04T02:20:48.618 DEBUG:teuthology.orchestra.run.smithi001:> return f 2024-05-04T02:20:48.618 DEBUG:teuthology.orchestra.run.smithi001:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-04T02:20:48.618 DEBUG:teuthology.orchestra.run.smithi001:> 2024-05-04T02:20:48.619 DEBUG:teuthology.orchestra.run.smithi001:> print(_find_admin_socket("client.0")) 2024-05-04T02:20:48.619 DEBUG:teuthology.orchestra.run.smithi001:> ' 2024-05-04T02:20:48.738 INFO:teuthology.orchestra.run.smithi001.stdout:/var/run/ceph/ceph-client.0.41971.asok 2024-05-04T02:20:48.742 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:20:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-04T02:20:48.749 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.41971.asok 2024-05-04T02:20:48.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T02:20:48.749 DEBUG:teuthology.orchestra.run.smithi001:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.41971.asok status 2024-05-04T02:20:49.028 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-05-04T02:20:49.028 INFO:teuthology.orchestra.run.smithi001.stdout: "metadata": { 2024-05-04T02:20:49.028 INFO:teuthology.orchestra.run.smithi001.stdout: "ceph_sha1": "bd4e00a39d766328b458e4c953f4d722fed96a31", 2024-05-04T02:20:49.028 INFO:teuthology.orchestra.run.smithi001.stdout: "ceph_version": "ceph version 19.0.0-3522-gbd4e00a3 (bd4e00a39d766328b458e4c953f4d722fed96a31) squid (dev)", 2024-05-04T02:20:49.028 INFO:teuthology.orchestra.run.smithi001.stdout: "entity_id": "0", 2024-05-04T02:20:49.028 INFO:teuthology.orchestra.run.smithi001.stdout: "hostname": "smithi001", 2024-05-04T02:20:49.029 INFO:teuthology.orchestra.run.smithi001.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-05-04T02:20:49.029 INFO:teuthology.orchestra.run.smithi001.stdout: "pid": "41971", 2024-05-04T02:20:49.029 INFO:teuthology.orchestra.run.smithi001.stdout: "root": "/" 2024-05-04T02:20:49.029 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-05-04T02:20:49.029 INFO:teuthology.orchestra.run.smithi001.stdout: "dentry_count": 0, 2024-05-04T02:20:49.029 INFO:teuthology.orchestra.run.smithi001.stdout: "dentry_pinned_count": 0, 2024-05-04T02:20:49.029 INFO:teuthology.orchestra.run.smithi001.stdout: "id": 4537, 2024-05-04T02:20:49.029 INFO:teuthology.orchestra.run.smithi001.stdout: "inst": { 2024-05-04T02:20:49.029 INFO:teuthology.orchestra.run.smithi001.stdout: "name": { 2024-05-04T02:20:49.029 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "client", 2024-05-04T02:20:49.029 INFO:teuthology.orchestra.run.smithi001.stdout: "num": 4537 2024-05-04T02:20:49.029 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-05-04T02:20:49.029 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": { 2024-05-04T02:20:49.030 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v1", 2024-05-04T02:20:49.030 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.1:0", 2024-05-04T02:20:49.030 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 406915514 2024-05-04T02:20:49.030 INFO:teuthology.orchestra.run.smithi001.stdout: } 2024-05-04T02:20:49.030 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-05-04T02:20:49.030 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": { 2024-05-04T02:20:49.030 INFO:teuthology.orchestra.run.smithi001.stdout: "type": "v1", 2024-05-04T02:20:49.030 INFO:teuthology.orchestra.run.smithi001.stdout: "addr": "172.21.15.1:0", 2024-05-04T02:20:49.030 INFO:teuthology.orchestra.run.smithi001.stdout: "nonce": 406915514 2024-05-04T02:20:49.030 INFO:teuthology.orchestra.run.smithi001.stdout: }, 2024-05-04T02:20:49.030 INFO:teuthology.orchestra.run.smithi001.stdout: "inst_str": "client.4537 172.21.15.1:0/406915514", 2024-05-04T02:20:49.030 INFO:teuthology.orchestra.run.smithi001.stdout: "addr_str": "172.21.15.1:0/406915514", 2024-05-04T02:20:49.030 INFO:teuthology.orchestra.run.smithi001.stdout: "inode_count": 1, 2024-05-04T02:20:49.030 INFO:teuthology.orchestra.run.smithi001.stdout: "mds_epoch": 7, 2024-05-04T02:20:49.031 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_epoch": 23, 2024-05-04T02:20:49.031 INFO:teuthology.orchestra.run.smithi001.stdout: "osd_epoch_barrier": 0, 2024-05-04T02:20:49.031 INFO:teuthology.orchestra.run.smithi001.stdout: "blocklisted": false, 2024-05-04T02:20:49.031 INFO:teuthology.orchestra.run.smithi001.stdout: "fs_name": "cephfs" 2024-05-04T02:20:49.031 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-05-04T02:20:49.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T02:20:49.038 DEBUG:teuthology.orchestra.run.smithi001:> stat --file-system '--printf=%T 2024-05-04T02:20:49.038 DEBUG:teuthology.orchestra.run.smithi001:> ' -- /home/ubuntu/cephtest/mnt.0 2024-05-04T02:20:49.146 INFO:teuthology.orchestra.run.smithi001.stdout:fuseblk 2024-05-04T02:20:49.146 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-05-04T02:20:49.146 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T02:20:49.147 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-04T02:20:49.305 INFO:teuthology.run_tasks:Running task workunit... 2024-05-04T02:20:49.318 INFO:tasks.workunit:Pulling workunits from ref bd4e00a39d766328b458e4c953f4d722fed96a31 2024-05-04T02:20:49.318 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-05-04T02:20:49.318 INFO:tasks.workunit:timeout=3h 2024-05-04T02:20:49.318 INFO:tasks.workunit:cleanup=True 2024-05-04T02:20:49.319 DEBUG:teuthology.orchestra.run.smithi001:> stat -- /home/ubuntu/cephtest/mnt.0 2024-05-04T02:20:49.364 INFO:teuthology.orchestra.run.smithi001.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-05-04T02:20:49.364 INFO:teuthology.orchestra.run.smithi001.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-05-04T02:20:49.364 INFO:teuthology.orchestra.run.smithi001.stdout:Device: 2bh/43d Inode: 1 Links: 2 2024-05-04T02:20:49.365 INFO:teuthology.orchestra.run.smithi001.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-04T02:20:49.365 INFO:teuthology.orchestra.run.smithi001.stdout:Context: system_u:object_r:fusefs_t:s0 2024-05-04T02:20:49.365 INFO:teuthology.orchestra.run.smithi001.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-05-04T02:20:49.365 INFO:teuthology.orchestra.run.smithi001.stdout:Modify: 2024-05-04 02:20:17.132188211 +0000 2024-05-04T02:20:49.365 INFO:teuthology.orchestra.run.smithi001.stdout:Change: 2024-05-04 02:20:49.193090438 +0000 2024-05-04T02:20:49.365 INFO:teuthology.orchestra.run.smithi001.stdout: Birth: - 2024-05-04T02:20:49.365 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-05-04T02:20:49.365 DEBUG:teuthology.orchestra.run.smithi001:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-05-04T02:20:49.845 DEBUG:teuthology.orchestra.run.smithi001:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bd4e00a39d766328b458e4c953f4d722fed96a31 2024-05-04T02:20:49.861 INFO:tasks.workunit.client.0.smithi001.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-05-04T02:20:52.687 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:20:52.690 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:21:22.754 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:21:22.758 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:21:52.881 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:21:52.885 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:22:14.138 INFO:tasks.workunit.client.0.smithi001.stderr:Updating files: 93% (11454/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-05-04T02:22:14.539 INFO:tasks.workunit.client.0.smithi001.stderr:Note: switching to 'bd4e00a39d766328b458e4c953f4d722fed96a31'. 2024-05-04T02:22:14.539 INFO:tasks.workunit.client.0.smithi001.stderr: 2024-05-04T02:22:14.539 INFO:tasks.workunit.client.0.smithi001.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-05-04T02:22:14.539 INFO:tasks.workunit.client.0.smithi001.stderr:changes and commit them, and you can discard any commits you make in this 2024-05-04T02:22:14.539 INFO:tasks.workunit.client.0.smithi001.stderr:state without impacting any branches by switching back to a branch. 2024-05-04T02:22:14.539 INFO:tasks.workunit.client.0.smithi001.stderr: 2024-05-04T02:22:14.540 INFO:tasks.workunit.client.0.smithi001.stderr:If you want to create a new branch to retain commits you create, you may 2024-05-04T02:22:14.540 INFO:tasks.workunit.client.0.smithi001.stderr:do so (now or later) by using -c with the switch command. Example: 2024-05-04T02:22:14.540 INFO:tasks.workunit.client.0.smithi001.stderr: 2024-05-04T02:22:14.540 INFO:tasks.workunit.client.0.smithi001.stderr: git switch -c 2024-05-04T02:22:14.540 INFO:tasks.workunit.client.0.smithi001.stderr: 2024-05-04T02:22:14.540 INFO:tasks.workunit.client.0.smithi001.stderr:Or undo this operation with: 2024-05-04T02:22:14.540 INFO:tasks.workunit.client.0.smithi001.stderr: 2024-05-04T02:22:14.540 INFO:tasks.workunit.client.0.smithi001.stderr: git switch - 2024-05-04T02:22:14.540 INFO:tasks.workunit.client.0.smithi001.stderr: 2024-05-04T02:22:14.540 INFO:tasks.workunit.client.0.smithi001.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-05-04T02:22:14.540 INFO:tasks.workunit.client.0.smithi001.stderr: 2024-05-04T02:22:14.540 INFO:tasks.workunit.client.0.smithi001.stderr:HEAD is now at bd4e00a39d7 Merge PR #54433 into wip-pdonnell-testing-20240503.163550-debug 2024-05-04T02:22:14.545 DEBUG:teuthology.orchestra.run.smithi001:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-05-04T02:22:14.567 INFO:tasks.workunit.client.0.smithi001.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-05-04T02:22:14.568 INFO:tasks.workunit.client.0.smithi001.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-04T02:22:14.569 INFO:tasks.workunit.client.0.smithi001.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-05-04T02:22:15.081 INFO:tasks.workunit.client.0.smithi001.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-05-04T02:22:15.134 INFO:tasks.workunit.client.0.smithi001.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-05-04T02:22:15.176 INFO:tasks.workunit.client.0.smithi001.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-04T02:22:15.177 INFO:tasks.workunit.client.0.smithi001.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-04T02:22:15.177 INFO:tasks.workunit.client.0.smithi001.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-05-04T02:22:15.217 INFO:tasks.workunit.client.0.smithi001.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-04T02:22:15.221 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-05-04T02:22:15.221 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-05-04T02:22:15.277 INFO:tasks.workunit:Running workunits matching suites/dbench.sh on client.0... 2024-05-04T02:22:15.279 INFO:tasks.workunit:Running workunit suites/dbench.sh... 2024-05-04T02:22:15.279 DEBUG:teuthology.orchestra.run.smithi001:workunit test suites/dbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bd4e00a39d766328b458e4c953f4d722fed96a31 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh 2024-05-04T02:22:15.531 INFO:tasks.workunit.client.0.smithi001.stderr:+ dbench 1 2024-05-04T02:22:15.543 INFO:tasks.workunit.client.0.smithi001.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2024-05-04T02:22:15.543 INFO:tasks.workunit.client.0.smithi001.stdout: 2024-05-04T02:22:15.543 INFO:tasks.workunit.client.0.smithi001.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2024-05-04T02:22:15.543 INFO:tasks.workunit.client.0.smithi001.stdout:0 of 1 processes prepared for launch 0 sec 2024-05-04T02:22:15.644 INFO:tasks.workunit.client.0.smithi001.stdout:1 of 1 processes prepared for launch 0 sec 2024-05-04T02:22:15.644 INFO:tasks.workunit.client.0.smithi001.stdout:releasing clients 2024-05-04T02:22:16.644 INFO:tasks.workunit.client.0.smithi001.stdout: 0 12 0.00 MB/sec warmup 1 sec latency 244.283 ms 2024-05-04T02:22:17.644 INFO:tasks.workunit.client.0.smithi001.stdout: 1 91 2.10 MB/sec warmup 2 sec latency 253.599 ms 2024-05-04T02:22:18.644 INFO:tasks.workunit.client.0.smithi001.stdout: 1 139 2.01 MB/sec warmup 3 sec latency 189.329 ms 2024-05-04T02:22:19.644 INFO:tasks.workunit.client.0.smithi001.stdout: 1 181 1.83 MB/sec warmup 4 sec latency 191.417 ms 2024-05-04T02:22:20.645 INFO:tasks.workunit.client.0.smithi001.stdout: 1 215 1.67 MB/sec warmup 5 sec latency 204.165 ms 2024-05-04T02:22:21.644 INFO:tasks.workunit.client.0.smithi001.stdout: 1 255 1.61 MB/sec warmup 6 sec latency 201.854 ms 2024-05-04T02:22:22.644 INFO:tasks.workunit.client.0.smithi001.stdout: 1 297 1.57 MB/sec warmup 7 sec latency 227.095 ms 2024-05-04T02:22:23.176 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:22:23.178 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:22:23.644 INFO:tasks.workunit.client.0.smithi001.stdout: 1 331 1.50 MB/sec warmup 8 sec latency 237.060 ms 2024-05-04T02:22:24.644 INFO:tasks.workunit.client.0.smithi001.stdout: 1 357 1.42 MB/sec warmup 9 sec latency 343.210 ms 2024-05-04T02:22:25.644 INFO:tasks.workunit.client.0.smithi001.stdout: 1 395 1.40 MB/sec warmup 10 sec latency 230.451 ms 2024-05-04T02:22:26.645 INFO:tasks.workunit.client.0.smithi001.stdout: 1 429 1.38 MB/sec warmup 11 sec latency 341.842 ms 2024-05-04T02:22:27.644 INFO:tasks.workunit.client.0.smithi001.stdout: 1 461 1.35 MB/sec warmup 12 sec latency 364.705 ms 2024-05-04T02:22:28.644 INFO:tasks.workunit.client.0.smithi001.stdout: 1 493 1.32 MB/sec warmup 13 sec latency 318.423 ms 2024-05-04T02:22:29.644 INFO:tasks.workunit.client.0.smithi001.stdout: 1 522 1.29 MB/sec warmup 14 sec latency 214.454 ms 2024-05-04T02:22:30.645 INFO:tasks.workunit.client.0.smithi001.stdout: 1 609 1.40 MB/sec warmup 15 sec latency 365.953 ms 2024-05-04T02:22:31.644 INFO:tasks.workunit.client.0.smithi001.stdout: 1 640 1.32 MB/sec warmup 16 sec latency 467.672 ms 2024-05-04T02:22:32.645 INFO:tasks.workunit.client.0.smithi001.stdout: 1 649 1.24 MB/sec warmup 17 sec latency 455.559 ms 2024-05-04T02:22:33.645 INFO:tasks.workunit.client.0.smithi001.stdout: 1 655 1.17 MB/sec warmup 18 sec latency 378.998 ms 2024-05-04T02:22:34.645 INFO:tasks.workunit.client.0.smithi001.stdout: 1 682 1.11 MB/sec warmup 19 sec latency 387.607 ms 2024-05-04T02:22:35.645 INFO:tasks.workunit.client.0.smithi001.stdout: 1 710 1.06 MB/sec warmup 20 sec latency 360.859 ms 2024-05-04T02:22:36.645 INFO:tasks.workunit.client.0.smithi001.stdout: 1 744 1.02 MB/sec warmup 21 sec latency 362.403 ms 2024-05-04T02:22:37.645 INFO:tasks.workunit.client.0.smithi001.stdout: 1 771 0.97 MB/sec warmup 22 sec latency 350.299 ms 2024-05-04T02:22:38.645 INFO:tasks.workunit.client.0.smithi001.stdout: 1 804 0.93 MB/sec warmup 23 sec latency 291.308 ms 2024-05-04T02:22:39.645 INFO:tasks.workunit.client.0.smithi001.stdout: 1 815 0.90 MB/sec warmup 24 sec latency 390.630 ms 2024-05-04T02:22:40.645 INFO:tasks.workunit.client.0.smithi001.stdout: 1 853 0.86 MB/sec warmup 25 sec latency 389.621 ms 2024-05-04T02:22:41.645 INFO:tasks.workunit.client.0.smithi001.stdout: 1 862 0.83 MB/sec warmup 26 sec latency 363.125 ms 2024-05-04T02:22:42.645 INFO:tasks.workunit.client.0.smithi001.stdout: 1 880 0.80 MB/sec warmup 27 sec latency 365.495 ms 2024-05-04T02:22:43.645 INFO:tasks.workunit.client.0.smithi001.stdout: 1 904 0.77 MB/sec warmup 28 sec latency 346.503 ms 2024-05-04T02:22:44.646 INFO:tasks.workunit.client.0.smithi001.stdout: 1 928 0.75 MB/sec warmup 29 sec latency 359.320 ms 2024-05-04T02:22:45.645 INFO:tasks.workunit.client.0.smithi001.stdout: 1 931 0.73 MB/sec warmup 30 sec latency 378.693 ms 2024-05-04T02:22:46.645 INFO:tasks.workunit.client.0.smithi001.stdout: 1 942 0.70 MB/sec warmup 31 sec latency 359.938 ms 2024-05-04T02:22:47.645 INFO:tasks.workunit.client.0.smithi001.stdout: 1 981 0.68 MB/sec warmup 32 sec latency 313.653 ms 2024-05-04T02:22:48.646 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1027 0.69 MB/sec warmup 33 sec latency 339.126 ms 2024-05-04T02:22:49.645 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1038 0.67 MB/sec warmup 34 sec latency 359.887 ms 2024-05-04T02:22:50.645 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1048 0.65 MB/sec warmup 35 sec latency 333.749 ms 2024-05-04T02:22:51.645 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1074 0.64 MB/sec warmup 36 sec latency 358.439 ms 2024-05-04T02:22:52.646 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1099 0.62 MB/sec warmup 37 sec latency 329.418 ms 2024-05-04T02:22:53.229 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:22:53.232 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:22:53.646 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1117 0.60 MB/sec warmup 38 sec latency 363.296 ms 2024-05-04T02:22:54.646 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1149 0.59 MB/sec warmup 39 sec latency 219.794 ms 2024-05-04T02:22:55.646 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1168 0.58 MB/sec warmup 40 sec latency 352.042 ms 2024-05-04T02:22:56.646 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1172 0.56 MB/sec warmup 41 sec latency 360.615 ms 2024-05-04T02:22:57.646 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1200 0.55 MB/sec warmup 42 sec latency 217.612 ms 2024-05-04T02:22:58.646 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1225 0.54 MB/sec warmup 43 sec latency 330.430 ms 2024-05-04T02:22:59.646 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1248 0.52 MB/sec warmup 44 sec latency 345.086 ms 2024-05-04T02:23:00.646 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1278 0.51 MB/sec warmup 45 sec latency 365.524 ms 2024-05-04T02:23:01.646 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1284 0.50 MB/sec warmup 46 sec latency 401.934 ms 2024-05-04T02:23:02.646 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1377 0.55 MB/sec warmup 47 sec latency 357.692 ms 2024-05-04T02:23:03.646 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1385 0.54 MB/sec warmup 48 sec latency 336.900 ms 2024-05-04T02:23:04.646 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1398 0.53 MB/sec warmup 49 sec latency 356.898 ms 2024-05-04T02:23:05.646 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1426 0.52 MB/sec warmup 50 sec latency 324.165 ms 2024-05-04T02:23:06.646 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1448 0.51 MB/sec warmup 51 sec latency 278.063 ms 2024-05-04T02:23:07.646 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1474 0.50 MB/sec warmup 52 sec latency 355.459 ms 2024-05-04T02:23:08.647 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1490 0.49 MB/sec warmup 53 sec latency 330.878 ms 2024-05-04T02:23:09.647 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1516 0.48 MB/sec warmup 54 sec latency 358.745 ms 2024-05-04T02:23:10.646 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1530 0.47 MB/sec warmup 55 sec latency 354.491 ms 2024-05-04T02:23:11.647 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1556 0.47 MB/sec warmup 56 sec latency 361.377 ms 2024-05-04T02:23:12.647 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1588 0.46 MB/sec warmup 57 sec latency 98.051 ms 2024-05-04T02:23:13.647 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1606 0.45 MB/sec warmup 58 sec latency 329.326 ms 2024-05-04T02:23:14.647 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1617 0.44 MB/sec warmup 59 sec latency 452.918 ms 2024-05-04T02:23:15.647 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1643 0.44 MB/sec warmup 60 sec latency 356.583 ms 2024-05-04T02:23:16.647 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1662 0.43 MB/sec warmup 61 sec latency 349.494 ms 2024-05-04T02:23:17.647 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1698 0.42 MB/sec warmup 62 sec latency 319.472 ms 2024-05-04T02:23:18.650 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1717 0.42 MB/sec warmup 63 sec latency 318.574 ms 2024-05-04T02:23:19.647 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1772 0.41 MB/sec warmup 64 sec latency 223.505 ms 2024-05-04T02:23:20.647 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1806 0.41 MB/sec warmup 65 sec latency 317.382 ms 2024-05-04T02:23:21.650 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1826 0.40 MB/sec warmup 66 sec latency 360.487 ms 2024-05-04T02:23:22.647 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1841 0.39 MB/sec warmup 67 sec latency 341.812 ms 2024-05-04T02:23:23.374 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:23:23.377 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:23:23.647 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1862 0.39 MB/sec warmup 68 sec latency 360.220 ms 2024-05-04T02:23:24.647 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1871 0.38 MB/sec warmup 69 sec latency 355.678 ms 2024-05-04T02:23:25.647 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1903 0.38 MB/sec warmup 70 sec latency 343.562 ms 2024-05-04T02:23:26.648 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1920 0.37 MB/sec warmup 71 sec latency 357.618 ms 2024-05-04T02:23:27.648 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1973 0.37 MB/sec warmup 72 sec latency 321.112 ms 2024-05-04T02:23:28.648 INFO:tasks.workunit.client.0.smithi001.stdout: 1 1997 0.36 MB/sec warmup 73 sec latency 342.738 ms 2024-05-04T02:23:29.648 INFO:tasks.workunit.client.0.smithi001.stdout: 1 2034 0.36 MB/sec warmup 74 sec latency 331.439 ms 2024-05-04T02:23:30.648 INFO:tasks.workunit.client.0.smithi001.stdout: 1 2053 0.35 MB/sec warmup 75 sec latency 350.812 ms 2024-05-04T02:23:31.648 INFO:tasks.workunit.client.0.smithi001.stdout: 1 2061 0.35 MB/sec warmup 76 sec latency 330.010 ms 2024-05-04T02:23:32.648 INFO:tasks.workunit.client.0.smithi001.stdout: 1 2088 0.35 MB/sec warmup 77 sec latency 355.341 ms 2024-05-04T02:23:33.648 INFO:tasks.workunit.client.0.smithi001.stdout: 1 2096 0.34 MB/sec warmup 78 sec latency 403.829 ms 2024-05-04T02:23:34.648 INFO:tasks.workunit.client.0.smithi001.stdout: 1 2140 0.34 MB/sec warmup 79 sec latency 414.755 ms 2024-05-04T02:23:35.648 INFO:tasks.workunit.client.0.smithi001.stdout: 1 2173 0.33 MB/sec warmup 80 sec latency 376.431 ms 2024-05-04T02:23:36.648 INFO:tasks.workunit.client.0.smithi001.stdout: 1 2181 0.33 MB/sec warmup 81 sec latency 352.473 ms 2024-05-04T02:23:37.648 INFO:tasks.workunit.client.0.smithi001.stdout: 1 2202 0.33 MB/sec warmup 82 sec latency 363.088 ms 2024-05-04T02:23:38.648 INFO:tasks.workunit.client.0.smithi001.stdout: 1 2259 0.32 MB/sec warmup 83 sec latency 367.592 ms 2024-05-04T02:23:39.648 INFO:tasks.workunit.client.0.smithi001.stdout: 1 2299 0.33 MB/sec warmup 84 sec latency 340.967 ms 2024-05-04T02:23:40.648 INFO:tasks.workunit.client.0.smithi001.stdout: 1 2306 0.33 MB/sec warmup 85 sec latency 533.685 ms 2024-05-04T02:23:41.648 INFO:tasks.workunit.client.0.smithi001.stdout: 1 2324 0.32 MB/sec warmup 86 sec latency 391.886 ms 2024-05-04T02:23:42.649 INFO:tasks.workunit.client.0.smithi001.stdout: 1 2335 0.32 MB/sec warmup 87 sec latency 403.388 ms 2024-05-04T02:23:43.649 INFO:tasks.workunit.client.0.smithi001.stdout: 1 2358 0.32 MB/sec warmup 88 sec latency 330.148 ms 2024-05-04T02:23:44.649 INFO:tasks.workunit.client.0.smithi001.stdout: 1 2362 0.31 MB/sec warmup 89 sec latency 870.608 ms 2024-05-04T02:23:45.649 INFO:tasks.workunit.client.0.smithi001.stdout: 1 2367 0.31 MB/sec warmup 90 sec latency 363.619 ms 2024-05-04T02:23:46.649 INFO:tasks.workunit.client.0.smithi001.stdout: 1 2389 0.31 MB/sec warmup 91 sec latency 333.958 ms 2024-05-04T02:23:47.649 INFO:tasks.workunit.client.0.smithi001.stdout: 1 2403 0.30 MB/sec warmup 92 sec latency 332.569 ms 2024-05-04T02:23:48.649 INFO:tasks.workunit.client.0.smithi001.stdout: 1 2428 0.30 MB/sec warmup 93 sec latency 340.936 ms 2024-05-04T02:23:49.649 INFO:tasks.workunit.client.0.smithi001.stdout: 1 2434 0.30 MB/sec warmup 94 sec latency 390.169 ms 2024-05-04T02:23:50.649 INFO:tasks.workunit.client.0.smithi001.stdout: 1 2453 0.30 MB/sec warmup 95 sec latency 165.455 ms 2024-05-04T02:23:51.649 INFO:tasks.workunit.client.0.smithi001.stdout: 1 2484 0.30 MB/sec warmup 96 sec latency 328.819 ms 2024-05-04T02:23:52.649 INFO:tasks.workunit.client.0.smithi001.stdout: 1 2494 0.30 MB/sec warmup 97 sec latency 328.411 ms 2024-05-04T02:23:53.453 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:23:53.456 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:23:53.649 INFO:tasks.workunit.client.0.smithi001.stdout: 1 2549 0.29 MB/sec warmup 98 sec latency 353.715 ms 2024-05-04T02:23:54.649 INFO:tasks.workunit.client.0.smithi001.stdout: 1 2559 0.29 MB/sec warmup 99 sec latency 455.646 ms 2024-05-04T02:23:55.649 INFO:tasks.workunit.client.0.smithi001.stdout: 1 2577 0.29 MB/sec warmup 100 sec latency 346.025 ms 2024-05-04T02:23:56.649 INFO:tasks.workunit.client.0.smithi001.stdout: 1 2583 0.29 MB/sec warmup 101 sec latency 387.660 ms 2024-05-04T02:23:57.649 INFO:tasks.workunit.client.0.smithi001.stdout: 1 2604 0.28 MB/sec warmup 102 sec latency 316.489 ms 2024-05-04T02:23:58.650 INFO:tasks.workunit.client.0.smithi001.stdout: 1 2617 0.28 MB/sec warmup 103 sec latency 330.261 ms 2024-05-04T02:23:59.650 INFO:tasks.workunit.client.0.smithi001.stdout: 1 2655 0.29 MB/sec warmup 104 sec latency 340.766 ms 2024-05-04T02:24:00.650 INFO:tasks.workunit.client.0.smithi001.stdout: 1 2750 0.30 MB/sec warmup 105 sec latency 368.073 ms 2024-05-04T02:24:01.650 INFO:tasks.workunit.client.0.smithi001.stdout: 1 2764 0.30 MB/sec warmup 106 sec latency 343.452 ms 2024-05-04T02:24:02.650 INFO:tasks.workunit.client.0.smithi001.stdout: 1 2783 0.30 MB/sec warmup 107 sec latency 313.934 ms 2024-05-04T02:24:03.650 INFO:tasks.workunit.client.0.smithi001.stdout: 1 2880 0.30 MB/sec warmup 108 sec latency 338.527 ms 2024-05-04T02:24:04.650 INFO:tasks.workunit.client.0.smithi001.stdout: 1 2917 0.31 MB/sec warmup 109 sec latency 197.978 ms 2024-05-04T02:24:05.650 INFO:tasks.workunit.client.0.smithi001.stdout: 1 2938 0.30 MB/sec warmup 110 sec latency 219.470 ms 2024-05-04T02:24:06.650 INFO:tasks.workunit.client.0.smithi001.stdout: 1 2971 0.30 MB/sec warmup 111 sec latency 495.038 ms 2024-05-04T02:24:07.650 INFO:tasks.workunit.client.0.smithi001.stdout: 1 2984 0.30 MB/sec warmup 112 sec latency 385.642 ms 2024-05-04T02:24:08.650 INFO:tasks.workunit.client.0.smithi001.stdout: 1 3000 0.30 MB/sec warmup 113 sec latency 330.908 ms 2024-05-04T02:24:09.650 INFO:tasks.workunit.client.0.smithi001.stdout: 1 3024 0.29 MB/sec warmup 114 sec latency 243.515 ms 2024-05-04T02:24:10.650 INFO:tasks.workunit.client.0.smithi001.stdout: 1 3169 0.30 MB/sec warmup 115 sec latency 357.750 ms 2024-05-04T02:24:11.650 INFO:tasks.workunit.client.0.smithi001.stdout: 1 3189 0.30 MB/sec warmup 116 sec latency 325.982 ms 2024-05-04T02:24:12.650 INFO:tasks.workunit.client.0.smithi001.stdout: 1 3243 0.30 MB/sec warmup 117 sec latency 228.403 ms 2024-05-04T02:24:13.650 INFO:tasks.workunit.client.0.smithi001.stdout: 1 3273 0.30 MB/sec warmup 118 sec latency 352.670 ms 2024-05-04T02:24:14.650 INFO:tasks.workunit.client.0.smithi001.stdout: 1 3281 0.30 MB/sec warmup 119 sec latency 521.524 ms 2024-05-04T02:24:16.650 INFO:tasks.workunit.client.0.smithi001.stdout: 1 3290 0.00 MB/sec execute 1 sec latency 382.621 ms 2024-05-04T02:24:17.650 INFO:tasks.workunit.client.0.smithi001.stdout: 1 3292 0.00 MB/sec execute 2 sec latency 458.587 ms 2024-05-04T02:24:18.651 INFO:tasks.workunit.client.0.smithi001.stdout: 1 3294 0.00 MB/sec execute 3 sec latency 462.260 ms 2024-05-04T02:24:19.651 INFO:tasks.workunit.client.0.smithi001.stdout: 1 3299 0.00 MB/sec execute 4 sec latency 426.590 ms 2024-05-04T02:24:20.651 INFO:tasks.workunit.client.0.smithi001.stdout: 1 3306 0.00 MB/sec execute 5 sec latency 363.328 ms 2024-05-04T02:24:21.651 INFO:tasks.workunit.client.0.smithi001.stdout: 1 3309 0.00 MB/sec execute 6 sec latency 348.545 ms 2024-05-04T02:24:22.651 INFO:tasks.workunit.client.0.smithi001.stdout: 1 3312 0.00 MB/sec execute 7 sec latency 359.284 ms 2024-05-04T02:24:23.590 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:24:23.593 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:24:23.651 INFO:tasks.workunit.client.0.smithi001.stdout: 1 3316 0.00 MB/sec execute 8 sec latency 378.839 ms 2024-05-04T02:24:24.651 INFO:tasks.workunit.client.0.smithi001.stdout: 1 3319 0.00 MB/sec execute 9 sec latency 411.278 ms 2024-05-04T02:24:25.651 INFO:tasks.workunit.client.0.smithi001.stdout: 1 3323 0.00 MB/sec execute 10 sec latency 362.689 ms 2024-05-04T02:24:26.651 INFO:tasks.workunit.client.0.smithi001.stdout: 1 3325 0.00 MB/sec execute 11 sec latency 360.737 ms 2024-05-04T02:24:27.651 INFO:tasks.workunit.client.0.smithi001.stdout: 1 3330 0.00 MB/sec execute 12 sec latency 348.130 ms 2024-05-04T02:24:28.651 INFO:tasks.workunit.client.0.smithi001.stdout: 1 3333 0.00 MB/sec execute 13 sec latency 357.808 ms 2024-05-04T02:24:29.651 INFO:tasks.workunit.client.0.smithi001.stdout: 1 3336 0.00 MB/sec execute 14 sec latency 343.992 ms 2024-05-04T02:24:30.651 INFO:tasks.workunit.client.0.smithi001.stdout: 1 3353 0.00 MB/sec execute 15 sec latency 330.911 ms 2024-05-04T02:24:31.651 INFO:tasks.workunit.client.0.smithi001.stdout: 1 3377 0.01 MB/sec execute 16 sec latency 152.597 ms 2024-05-04T02:24:32.651 INFO:tasks.workunit.client.0.smithi001.stdout: 1 3393 0.01 MB/sec execute 17 sec latency 326.898 ms 2024-05-04T02:24:33.651 INFO:tasks.workunit.client.0.smithi001.stdout: 1 3494 0.17 MB/sec execute 18 sec latency 339.029 ms 2024-05-04T02:24:34.651 INFO:tasks.workunit.client.0.smithi001.stdout: 1 3530 0.16 MB/sec execute 19 sec latency 150.523 ms 2024-05-04T02:24:35.652 INFO:tasks.workunit.client.0.smithi001.stdout: 1 3550 0.15 MB/sec execute 20 sec latency 359.097 ms 2024-05-04T02:24:36.651 INFO:tasks.workunit.client.0.smithi001.stdout: 1 3562 0.15 MB/sec execute 21 sec latency 384.347 ms 2024-05-04T02:24:37.652 INFO:tasks.workunit.client.0.smithi001.stdout: 1 3587 0.14 MB/sec execute 22 sec latency 399.225 ms 2024-05-04T02:24:38.652 INFO:tasks.workunit.client.0.smithi001.stdout: 1 3628 0.14 MB/sec execute 23 sec latency 351.207 ms 2024-05-04T02:24:39.652 INFO:tasks.workunit.client.0.smithi001.stdout: 1 3644 0.14 MB/sec execute 24 sec latency 453.778 ms 2024-05-04T02:24:40.652 INFO:tasks.workunit.client.0.smithi001.stdout: 1 3672 0.13 MB/sec execute 25 sec latency 175.848 ms 2024-05-04T02:24:41.652 INFO:tasks.workunit.client.0.smithi001.stdout: 1 3686 0.13 MB/sec execute 26 sec latency 338.530 ms 2024-05-04T02:24:42.652 INFO:tasks.workunit.client.0.smithi001.stdout: 1 3707 0.13 MB/sec execute 27 sec latency 326.199 ms 2024-05-04T02:24:43.652 INFO:tasks.workunit.client.0.smithi001.stdout: 1 3758 0.16 MB/sec execute 28 sec latency 139.317 ms 2024-05-04T02:24:44.652 INFO:tasks.workunit.client.0.smithi001.stdout: 1 3772 0.15 MB/sec execute 29 sec latency 342.084 ms 2024-05-04T02:24:45.652 INFO:tasks.workunit.client.0.smithi001.stdout: 1 3785 0.15 MB/sec execute 30 sec latency 178.382 ms 2024-05-04T02:24:46.652 INFO:tasks.workunit.client.0.smithi001.stdout: 1 3795 0.14 MB/sec execute 31 sec latency 234.335 ms 2024-05-04T02:24:47.653 INFO:tasks.workunit.client.0.smithi001.stdout: 1 3806 0.14 MB/sec execute 32 sec latency 208.066 ms 2024-05-04T02:24:48.652 INFO:tasks.workunit.client.0.smithi001.stdout: 1 3821 0.13 MB/sec execute 33 sec latency 162.192 ms 2024-05-04T02:24:49.652 INFO:tasks.workunit.client.0.smithi001.stdout: 1 3836 0.13 MB/sec execute 34 sec latency 197.302 ms 2024-05-04T02:24:50.653 INFO:tasks.workunit.client.0.smithi001.stdout: 1 3851 0.13 MB/sec execute 35 sec latency 197.839 ms 2024-05-04T02:24:51.653 INFO:tasks.workunit.client.0.smithi001.stdout: 1 3864 0.12 MB/sec execute 36 sec latency 166.775 ms 2024-05-04T02:24:52.653 INFO:tasks.workunit.client.0.smithi001.stdout: 1 3876 0.12 MB/sec execute 37 sec latency 331.312 ms 2024-05-04T02:24:53.648 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:24:53.651 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:24:53.652 INFO:tasks.workunit.client.0.smithi001.stdout: 1 3896 0.12 MB/sec execute 38 sec latency 350.263 ms 2024-05-04T02:24:54.653 INFO:tasks.workunit.client.0.smithi001.stdout: 1 3903 0.12 MB/sec execute 39 sec latency 335.133 ms 2024-05-04T02:24:55.653 INFO:tasks.workunit.client.0.smithi001.stdout: 1 3924 0.12 MB/sec execute 40 sec latency 310.739 ms 2024-05-04T02:24:56.653 INFO:tasks.workunit.client.0.smithi001.stdout: 1 3937 0.12 MB/sec execute 41 sec latency 191.438 ms 2024-05-04T02:24:57.653 INFO:tasks.workunit.client.0.smithi001.stdout: 1 3947 0.11 MB/sec execute 42 sec latency 209.835 ms 2024-05-04T02:24:58.653 INFO:tasks.workunit.client.0.smithi001.stdout: 1 3961 0.11 MB/sec execute 43 sec latency 195.190 ms 2024-05-04T02:24:59.653 INFO:tasks.workunit.client.0.smithi001.stdout: 1 3975 0.11 MB/sec execute 44 sec latency 148.633 ms 2024-05-04T02:25:00.653 INFO:tasks.workunit.client.0.smithi001.stdout: 1 3990 0.10 MB/sec execute 45 sec latency 183.202 ms 2024-05-04T02:25:01.653 INFO:tasks.workunit.client.0.smithi001.stdout: 1 4005 0.10 MB/sec execute 46 sec latency 186.293 ms 2024-05-04T02:25:02.653 INFO:tasks.workunit.client.0.smithi001.stdout: 1 4021 0.10 MB/sec execute 47 sec latency 187.880 ms 2024-05-04T02:25:03.653 INFO:tasks.workunit.client.0.smithi001.stdout: 1 4031 0.10 MB/sec execute 48 sec latency 323.306 ms 2024-05-04T02:25:04.653 INFO:tasks.workunit.client.0.smithi001.stdout: 1 4038 0.10 MB/sec execute 49 sec latency 349.551 ms 2024-05-04T02:25:05.654 INFO:tasks.workunit.client.0.smithi001.stdout: 1 4058 0.09 MB/sec execute 50 sec latency 331.586 ms 2024-05-04T02:25:06.653 INFO:tasks.workunit.client.0.smithi001.stdout: 1 4071 0.09 MB/sec execute 51 sec latency 348.091 ms 2024-05-04T02:25:07.654 INFO:tasks.workunit.client.0.smithi001.stdout: 1 4093 0.09 MB/sec execute 52 sec latency 358.864 ms 2024-05-04T02:25:08.654 INFO:tasks.workunit.client.0.smithi001.stdout: 1 4114 0.09 MB/sec execute 53 sec latency 146.209 ms 2024-05-04T02:25:09.654 INFO:tasks.workunit.client.0.smithi001.stdout: 1 4129 0.09 MB/sec execute 54 sec latency 437.153 ms 2024-05-04T02:25:10.654 INFO:tasks.workunit.client.0.smithi001.stdout: 1 4153 0.09 MB/sec execute 55 sec latency 483.201 ms 2024-05-04T02:25:11.654 INFO:tasks.workunit.client.0.smithi001.stdout: 1 4173 0.08 MB/sec execute 56 sec latency 203.810 ms 2024-05-04T02:25:12.654 INFO:tasks.workunit.client.0.smithi001.stdout: 1 4180 0.08 MB/sec execute 57 sec latency 442.527 ms 2024-05-04T02:25:13.654 INFO:tasks.workunit.client.0.smithi001.stdout: 1 4186 0.08 MB/sec execute 58 sec latency 808.679 ms 2024-05-04T02:25:14.654 INFO:tasks.workunit.client.0.smithi001.stdout: 1 4217 0.08 MB/sec execute 59 sec latency 429.384 ms 2024-05-04T02:25:15.654 INFO:tasks.workunit.client.0.smithi001.stdout: 1 4227 0.08 MB/sec execute 60 sec latency 352.668 ms 2024-05-04T02:25:16.654 INFO:tasks.workunit.client.0.smithi001.stdout: 1 4254 0.08 MB/sec execute 61 sec latency 337.720 ms 2024-05-04T02:25:17.654 INFO:tasks.workunit.client.0.smithi001.stdout: 1 4283 0.08 MB/sec execute 62 sec latency 333.729 ms 2024-05-04T02:25:18.654 INFO:tasks.workunit.client.0.smithi001.stdout: 1 4317 0.08 MB/sec execute 63 sec latency 370.632 ms 2024-05-04T02:25:19.654 INFO:tasks.workunit.client.0.smithi001.stdout: 1 4349 0.08 MB/sec execute 64 sec latency 361.459 ms 2024-05-04T02:25:20.654 INFO:tasks.workunit.client.0.smithi001.stdout: 1 4383 0.08 MB/sec execute 65 sec latency 242.964 ms 2024-05-04T02:25:21.654 INFO:tasks.workunit.client.0.smithi001.stdout: 1 4388 0.08 MB/sec execute 66 sec latency 359.572 ms 2024-05-04T02:25:22.654 INFO:tasks.workunit.client.0.smithi001.stdout: 1 4423 0.08 MB/sec execute 67 sec latency 345.061 ms 2024-05-04T02:25:23.654 INFO:tasks.workunit.client.0.smithi001.stdout: 1 4433 0.08 MB/sec execute 68 sec latency 373.912 ms 2024-05-04T02:25:23.763 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:25:23.766 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:25:24.654 INFO:tasks.workunit.client.0.smithi001.stdout: 1 4462 0.08 MB/sec execute 69 sec latency 331.921 ms 2024-05-04T02:25:25.655 INFO:tasks.workunit.client.0.smithi001.stdout: 1 4496 0.08 MB/sec execute 70 sec latency 248.330 ms 2024-05-04T02:25:26.655 INFO:tasks.workunit.client.0.smithi001.stdout: 1 4500 0.08 MB/sec execute 71 sec latency 381.192 ms 2024-05-04T02:25:27.655 INFO:tasks.workunit.client.0.smithi001.stdout: 1 4506 0.08 MB/sec execute 72 sec latency 343.015 ms 2024-05-04T02:25:28.655 INFO:tasks.workunit.client.0.smithi001.stdout: 1 4538 0.08 MB/sec execute 73 sec latency 347.110 ms 2024-05-04T02:25:29.655 INFO:tasks.workunit.client.0.smithi001.stdout: 1 4563 0.08 MB/sec execute 74 sec latency 273.998 ms 2024-05-04T02:25:30.655 INFO:tasks.workunit.client.0.smithi001.stdout: 1 4602 0.09 MB/sec execute 75 sec latency 343.950 ms 2024-05-04T02:25:31.655 INFO:tasks.workunit.client.0.smithi001.stdout: 1 4615 0.09 MB/sec execute 76 sec latency 388.993 ms 2024-05-04T02:25:32.655 INFO:tasks.workunit.client.0.smithi001.stdout: 1 4628 0.09 MB/sec execute 77 sec latency 320.974 ms 2024-05-04T02:25:33.655 INFO:tasks.workunit.client.0.smithi001.stdout: 1 4656 0.09 MB/sec execute 78 sec latency 261.430 ms 2024-05-04T02:25:34.655 INFO:tasks.workunit.client.0.smithi001.stdout: 1 4681 0.09 MB/sec execute 79 sec latency 361.319 ms 2024-05-04T02:25:35.655 INFO:tasks.workunit.client.0.smithi001.stdout: 1 4706 0.08 MB/sec execute 80 sec latency 334.534 ms 2024-05-04T02:25:36.655 INFO:tasks.workunit.client.0.smithi001.stdout: 1 4729 0.08 MB/sec execute 81 sec latency 334.116 ms 2024-05-04T02:25:37.655 INFO:tasks.workunit.client.0.smithi001.stdout: 1 4736 0.08 MB/sec execute 82 sec latency 344.829 ms 2024-05-04T02:25:38.656 INFO:tasks.workunit.client.0.smithi001.stdout: 1 4747 0.08 MB/sec execute 83 sec latency 342.937 ms 2024-05-04T02:25:39.655 INFO:tasks.workunit.client.0.smithi001.stdout: 1 4780 0.08 MB/sec execute 84 sec latency 519.488 ms 2024-05-04T02:25:40.655 INFO:tasks.workunit.client.0.smithi001.stdout: 1 4810 0.08 MB/sec execute 85 sec latency 253.121 ms 2024-05-04T02:25:41.655 INFO:tasks.workunit.client.0.smithi001.stdout: 1 4843 0.08 MB/sec execute 86 sec latency 345.185 ms 2024-05-04T02:25:42.656 INFO:tasks.workunit.client.0.smithi001.stdout: 1 4847 0.08 MB/sec execute 87 sec latency 354.667 ms 2024-05-04T02:25:43.656 INFO:tasks.workunit.client.0.smithi001.stdout: 1 4942 0.11 MB/sec execute 88 sec latency 374.739 ms 2024-05-04T02:25:44.656 INFO:tasks.workunit.client.0.smithi001.stdout: 1 4947 0.11 MB/sec execute 89 sec latency 377.234 ms 2024-05-04T02:25:45.656 INFO:tasks.workunit.client.0.smithi001.stdout: 1 4963 0.11 MB/sec execute 90 sec latency 353.593 ms 2024-05-04T02:25:46.656 INFO:tasks.workunit.client.0.smithi001.stdout: 1 4983 0.11 MB/sec execute 91 sec latency 358.331 ms 2024-05-04T02:25:47.656 INFO:tasks.workunit.client.0.smithi001.stdout: 1 5012 0.11 MB/sec execute 92 sec latency 368.360 ms 2024-05-04T02:25:48.656 INFO:tasks.workunit.client.0.smithi001.stdout: 1 5031 0.11 MB/sec execute 93 sec latency 298.803 ms 2024-05-04T02:25:49.656 INFO:tasks.workunit.client.0.smithi001.stdout: 1 5051 0.10 MB/sec execute 94 sec latency 425.632 ms 2024-05-04T02:25:50.656 INFO:tasks.workunit.client.0.smithi001.stdout: 1 5065 0.10 MB/sec execute 95 sec latency 498.799 ms 2024-05-04T02:25:51.656 INFO:tasks.workunit.client.0.smithi001.stdout: 1 5092 0.10 MB/sec execute 96 sec latency 203.547 ms 2024-05-04T02:25:52.656 INFO:tasks.workunit.client.0.smithi001.stdout: 1 5118 0.10 MB/sec execute 97 sec latency 342.113 ms 2024-05-04T02:25:53.656 INFO:tasks.workunit.client.0.smithi001.stdout: 1 5135 0.10 MB/sec execute 98 sec latency 358.577 ms 2024-05-04T02:25:53.871 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:25:53.874 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:25:54.656 INFO:tasks.workunit.client.0.smithi001.stdout: 1 5154 0.10 MB/sec execute 99 sec latency 282.990 ms 2024-05-04T02:25:55.656 INFO:tasks.workunit.client.0.smithi001.stdout: 1 5175 0.10 MB/sec execute 100 sec latency 328.601 ms 2024-05-04T02:25:56.656 INFO:tasks.workunit.client.0.smithi001.stdout: 1 5199 0.10 MB/sec execute 101 sec latency 343.603 ms 2024-05-04T02:25:57.656 INFO:tasks.workunit.client.0.smithi001.stdout: 1 5209 0.10 MB/sec execute 102 sec latency 391.878 ms 2024-05-04T02:25:58.656 INFO:tasks.workunit.client.0.smithi001.stdout: 1 5251 0.10 MB/sec execute 103 sec latency 463.965 ms 2024-05-04T02:25:59.657 INFO:tasks.workunit.client.0.smithi001.stdout: 1 5266 0.10 MB/sec execute 104 sec latency 310.288 ms 2024-05-04T02:26:00.656 INFO:tasks.workunit.client.0.smithi001.stdout: 1 5317 0.10 MB/sec execute 105 sec latency 357.911 ms 2024-05-04T02:26:01.657 INFO:tasks.workunit.client.0.smithi001.stdout: 1 5342 0.09 MB/sec execute 106 sec latency 354.624 ms 2024-05-04T02:26:02.657 INFO:tasks.workunit.client.0.smithi001.stdout: 1 5377 0.09 MB/sec execute 107 sec latency 338.172 ms 2024-05-04T02:26:03.657 INFO:tasks.workunit.client.0.smithi001.stdout: 1 5391 0.09 MB/sec execute 108 sec latency 328.435 ms 2024-05-04T02:26:04.657 INFO:tasks.workunit.client.0.smithi001.stdout: 1 5406 0.09 MB/sec execute 109 sec latency 359.233 ms 2024-05-04T02:26:05.657 INFO:tasks.workunit.client.0.smithi001.stdout: 1 5427 0.09 MB/sec execute 110 sec latency 340.362 ms 2024-05-04T02:26:06.657 INFO:tasks.workunit.client.0.smithi001.stdout: 1 5443 0.09 MB/sec execute 111 sec latency 408.573 ms 2024-05-04T02:26:07.657 INFO:tasks.workunit.client.0.smithi001.stdout: 1 5468 0.09 MB/sec execute 112 sec latency 342.440 ms 2024-05-04T02:26:08.657 INFO:tasks.workunit.client.0.smithi001.stdout: 1 5485 0.09 MB/sec execute 113 sec latency 344.219 ms 2024-05-04T02:26:09.657 INFO:tasks.workunit.client.0.smithi001.stdout: 1 5538 0.09 MB/sec execute 114 sec latency 338.091 ms 2024-05-04T02:26:10.657 INFO:tasks.workunit.client.0.smithi001.stdout: 1 5562 0.09 MB/sec execute 115 sec latency 338.584 ms 2024-05-04T02:26:11.657 INFO:tasks.workunit.client.0.smithi001.stdout: 1 5597 0.09 MB/sec execute 116 sec latency 349.837 ms 2024-05-04T02:26:12.657 INFO:tasks.workunit.client.0.smithi001.stdout: 1 5614 0.09 MB/sec execute 117 sec latency 380.254 ms 2024-05-04T02:26:13.657 INFO:tasks.workunit.client.0.smithi001.stdout: 1 5623 0.09 MB/sec execute 118 sec latency 328.284 ms 2024-05-04T02:26:14.657 INFO:tasks.workunit.client.0.smithi001.stdout: 1 5643 0.09 MB/sec execute 119 sec latency 371.303 ms 2024-05-04T02:26:15.657 INFO:tasks.workunit.client.0.smithi001.stdout: 1 5658 0.09 MB/sec execute 120 sec latency 363.361 ms 2024-05-04T02:26:16.658 INFO:tasks.workunit.client.0.smithi001.stdout: 1 5702 0.09 MB/sec execute 121 sec latency 389.079 ms 2024-05-04T02:26:17.657 INFO:tasks.workunit.client.0.smithi001.stdout: 1 5735 0.09 MB/sec execute 122 sec latency 388.825 ms 2024-05-04T02:26:18.657 INFO:tasks.workunit.client.0.smithi001.stdout: 1 5744 0.09 MB/sec execute 123 sec latency 357.786 ms 2024-05-04T02:26:19.657 INFO:tasks.workunit.client.0.smithi001.stdout: 1 5765 0.08 MB/sec execute 124 sec latency 348.734 ms 2024-05-04T02:26:20.658 INFO:tasks.workunit.client.0.smithi001.stdout: 1 5823 0.08 MB/sec execute 125 sec latency 326.338 ms 2024-05-04T02:26:21.658 INFO:tasks.workunit.client.0.smithi001.stdout: 1 5863 0.09 MB/sec execute 126 sec latency 329.643 ms 2024-05-04T02:26:22.658 INFO:tasks.workunit.client.0.smithi001.stdout: 1 5867 0.09 MB/sec execute 127 sec latency 540.577 ms 2024-05-04T02:26:23.658 INFO:tasks.workunit.client.0.smithi001.stdout: 1 5884 0.09 MB/sec execute 128 sec latency 383.833 ms 2024-05-04T02:26:24.008 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:26:24.011 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:26:24.658 INFO:tasks.workunit.client.0.smithi001.stdout: 1 5897 0.09 MB/sec execute 129 sec latency 366.683 ms 2024-05-04T02:26:25.658 INFO:tasks.workunit.client.0.smithi001.stdout: 1 5921 0.09 MB/sec execute 130 sec latency 330.701 ms 2024-05-04T02:26:26.658 INFO:tasks.workunit.client.0.smithi001.stdout: 1 5924 0.09 MB/sec execute 131 sec latency 541.162 ms 2024-05-04T02:26:27.658 INFO:tasks.workunit.client.0.smithi001.stdout: 1 5931 0.09 MB/sec execute 132 sec latency 335.147 ms 2024-05-04T02:26:28.658 INFO:tasks.workunit.client.0.smithi001.stdout: 1 5954 0.09 MB/sec execute 133 sec latency 357.536 ms 2024-05-04T02:26:29.658 INFO:tasks.workunit.client.0.smithi001.stdout: 1 5970 0.09 MB/sec execute 134 sec latency 168.662 ms 2024-05-04T02:26:30.658 INFO:tasks.workunit.client.0.smithi001.stdout: 1 5991 0.09 MB/sec execute 135 sec latency 409.739 ms 2024-05-04T02:26:31.658 INFO:tasks.workunit.client.0.smithi001.stdout: 1 6000 0.09 MB/sec execute 136 sec latency 332.354 ms 2024-05-04T02:26:32.658 INFO:tasks.workunit.client.0.smithi001.stdout: 1 6026 0.09 MB/sec execute 137 sec latency 198.851 ms 2024-05-04T02:26:33.658 INFO:tasks.workunit.client.0.smithi001.stdout: 1 6052 0.09 MB/sec execute 138 sec latency 326.646 ms 2024-05-04T02:26:34.658 INFO:tasks.workunit.client.0.smithi001.stdout: 1 6061 0.09 MB/sec execute 139 sec latency 368.429 ms 2024-05-04T02:26:35.658 INFO:tasks.workunit.client.0.smithi001.stdout: 1 6109 0.09 MB/sec execute 140 sec latency 392.077 ms 2024-05-04T02:26:36.658 INFO:tasks.workunit.client.0.smithi001.stdout: 1 6120 0.09 MB/sec execute 141 sec latency 346.798 ms 2024-05-04T02:26:37.658 INFO:tasks.workunit.client.0.smithi001.stdout: 1 6139 0.09 MB/sec execute 142 sec latency 358.531 ms 2024-05-04T02:26:38.658 INFO:tasks.workunit.client.0.smithi001.stdout: 1 6158 0.09 MB/sec execute 143 sec latency 359.938 ms 2024-05-04T02:26:39.658 INFO:tasks.workunit.client.0.smithi001.stdout: 1 6167 0.09 MB/sec execute 144 sec latency 353.140 ms 2024-05-04T02:26:40.658 INFO:tasks.workunit.client.0.smithi001.stdout: 1 6176 0.09 MB/sec execute 145 sec latency 342.151 ms 2024-05-04T02:26:41.658 INFO:tasks.workunit.client.0.smithi001.stdout: 1 6275 0.11 MB/sec execute 146 sec latency 332.666 ms 2024-05-04T02:26:42.658 INFO:tasks.workunit.client.0.smithi001.stdout: 1 6316 0.11 MB/sec execute 147 sec latency 363.882 ms 2024-05-04T02:26:43.659 INFO:tasks.workunit.client.0.smithi001.stdout: 1 6331 0.11 MB/sec execute 148 sec latency 354.700 ms 2024-05-04T02:26:44.658 INFO:tasks.workunit.client.0.smithi001.stdout: 1 6427 0.11 MB/sec execute 149 sec latency 325.785 ms 2024-05-04T02:26:45.659 INFO:tasks.workunit.client.0.smithi001.stdout: 1 6456 0.11 MB/sec execute 150 sec latency 314.156 ms 2024-05-04T02:26:46.659 INFO:tasks.workunit.client.0.smithi001.stdout: 1 6486 0.11 MB/sec execute 151 sec latency 163.193 ms 2024-05-04T02:26:47.659 INFO:tasks.workunit.client.0.smithi001.stdout: 1 6521 0.11 MB/sec execute 152 sec latency 326.754 ms 2024-05-04T02:26:48.659 INFO:tasks.workunit.client.0.smithi001.stdout: 1 6531 0.11 MB/sec execute 153 sec latency 351.861 ms 2024-05-04T02:26:49.659 INFO:tasks.workunit.client.0.smithi001.stdout: 1 6549 0.11 MB/sec execute 154 sec latency 192.475 ms 2024-05-04T02:26:50.659 INFO:tasks.workunit.client.0.smithi001.stdout: 1 6571 0.11 MB/sec execute 155 sec latency 355.579 ms 2024-05-04T02:26:51.659 INFO:tasks.workunit.client.0.smithi001.stdout: 1 6722 0.11 MB/sec execute 156 sec latency 345.841 ms 2024-05-04T02:26:52.659 INFO:tasks.workunit.client.0.smithi001.stdout: 1 6737 0.11 MB/sec execute 157 sec latency 339.387 ms 2024-05-04T02:26:53.659 INFO:tasks.workunit.client.0.smithi001.stdout: 1 6764 0.11 MB/sec execute 158 sec latency 332.411 ms 2024-05-04T02:26:54.212 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:26:54.215 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:26:54.659 INFO:tasks.workunit.client.0.smithi001.stdout: 1 6822 0.12 MB/sec execute 159 sec latency 376.666 ms 2024-05-04T02:26:55.659 INFO:tasks.workunit.client.0.smithi001.stdout: 1 6835 0.12 MB/sec execute 160 sec latency 363.605 ms 2024-05-04T02:26:56.659 INFO:tasks.workunit.client.0.smithi001.stdout: 1 6839 0.12 MB/sec execute 161 sec latency 337.717 ms 2024-05-04T02:26:57.659 INFO:tasks.workunit.client.0.smithi001.stdout: 1 6841 0.12 MB/sec execute 162 sec latency 396.331 ms 2024-05-04T02:26:58.659 INFO:tasks.workunit.client.0.smithi001.stdout: 1 6846 0.12 MB/sec execute 163 sec latency 412.134 ms 2024-05-04T02:26:59.659 INFO:tasks.workunit.client.0.smithi001.stdout: 1 6848 0.12 MB/sec execute 164 sec latency 412.650 ms 2024-05-04T02:27:00.659 INFO:tasks.workunit.client.0.smithi001.stdout: 1 6854 0.12 MB/sec execute 165 sec latency 484.013 ms 2024-05-04T02:27:01.660 INFO:tasks.workunit.client.0.smithi001.stdout: 1 6861 0.12 MB/sec execute 166 sec latency 427.796 ms 2024-05-04T02:27:02.660 INFO:tasks.workunit.client.0.smithi001.stdout: 1 6864 0.11 MB/sec execute 167 sec latency 350.305 ms 2024-05-04T02:27:03.660 INFO:tasks.workunit.client.0.smithi001.stdout: 1 6867 0.11 MB/sec execute 168 sec latency 328.458 ms 2024-05-04T02:27:04.660 INFO:tasks.workunit.client.0.smithi001.stdout: 1 6872 0.11 MB/sec execute 169 sec latency 339.397 ms 2024-05-04T02:27:05.660 INFO:tasks.workunit.client.0.smithi001.stdout: 1 6875 0.11 MB/sec execute 170 sec latency 320.246 ms 2024-05-04T02:27:06.660 INFO:tasks.workunit.client.0.smithi001.stdout: 1 6878 0.11 MB/sec execute 171 sec latency 364.347 ms 2024-05-04T02:27:07.660 INFO:tasks.workunit.client.0.smithi001.stdout: 1 6881 0.11 MB/sec execute 172 sec latency 379.477 ms 2024-05-04T02:27:08.660 INFO:tasks.workunit.client.0.smithi001.stdout: 1 6886 0.11 MB/sec execute 173 sec latency 355.511 ms 2024-05-04T02:27:09.660 INFO:tasks.workunit.client.0.smithi001.stdout: 1 6889 0.11 MB/sec execute 174 sec latency 447.000 ms 2024-05-04T02:27:10.660 INFO:tasks.workunit.client.0.smithi001.stdout: 1 6892 0.11 MB/sec execute 175 sec latency 358.126 ms 2024-05-04T02:27:11.660 INFO:tasks.workunit.client.0.smithi001.stdout: 1 6915 0.11 MB/sec execute 176 sec latency 321.022 ms 2024-05-04T02:27:12.660 INFO:tasks.workunit.client.0.smithi001.stdout: 1 6933 0.11 MB/sec execute 177 sec latency 145.928 ms 2024-05-04T02:27:13.660 INFO:tasks.workunit.client.0.smithi001.stdout: 1 6949 0.11 MB/sec execute 178 sec latency 353.730 ms 2024-05-04T02:27:14.660 INFO:tasks.workunit.client.0.smithi001.stdout: 1 7054 0.12 MB/sec execute 179 sec latency 339.415 ms 2024-05-04T02:27:15.660 INFO:tasks.workunit.client.0.smithi001.stdout: 1 7082 0.12 MB/sec execute 180 sec latency 231.334 ms 2024-05-04T02:27:16.660 INFO:tasks.workunit.client.0.smithi001.stdout: 1 7108 0.12 MB/sec execute 181 sec latency 308.402 ms 2024-05-04T02:27:17.660 INFO:tasks.workunit.client.0.smithi001.stdout: 1 7123 0.12 MB/sec execute 182 sec latency 333.059 ms 2024-05-04T02:27:18.660 INFO:tasks.workunit.client.0.smithi001.stdout: 1 7135 0.12 MB/sec execute 183 sec latency 344.989 ms 2024-05-04T02:27:19.661 INFO:tasks.workunit.client.0.smithi001.stdout: 1 7185 0.12 MB/sec execute 184 sec latency 342.421 ms 2024-05-04T02:27:20.660 INFO:tasks.workunit.client.0.smithi001.stdout: 1 7209 0.12 MB/sec execute 185 sec latency 403.072 ms 2024-05-04T02:27:21.660 INFO:tasks.workunit.client.0.smithi001.stdout: 1 7219 0.12 MB/sec execute 186 sec latency 366.501 ms 2024-05-04T02:27:22.661 INFO:tasks.workunit.client.0.smithi001.stdout: 1 7234 0.12 MB/sec execute 187 sec latency 348.008 ms 2024-05-04T02:27:23.661 INFO:tasks.workunit.client.0.smithi001.stdout: 1 7260 0.12 MB/sec execute 188 sec latency 157.265 ms 2024-05-04T02:27:24.284 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:27:24.287 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:27:24.661 INFO:tasks.workunit.client.0.smithi001.stdout: 1 7302 0.12 MB/sec execute 189 sec latency 268.766 ms 2024-05-04T02:27:25.661 INFO:tasks.workunit.client.0.smithi001.stdout: 1 7320 0.12 MB/sec execute 190 sec latency 321.880 ms 2024-05-04T02:27:26.661 INFO:tasks.workunit.client.0.smithi001.stdout: 1 7334 0.12 MB/sec execute 191 sec latency 288.759 ms 2024-05-04T02:27:27.661 INFO:tasks.workunit.client.0.smithi001.stdout: 1 7341 0.12 MB/sec execute 192 sec latency 222.347 ms 2024-05-04T02:27:28.661 INFO:tasks.workunit.client.0.smithi001.stdout: 1 7356 0.12 MB/sec execute 193 sec latency 200.535 ms 2024-05-04T02:27:29.661 INFO:tasks.workunit.client.0.smithi001.stdout: 1 7368 0.12 MB/sec execute 194 sec latency 204.480 ms 2024-05-04T02:27:30.661 INFO:tasks.workunit.client.0.smithi001.stdout: 1 7383 0.12 MB/sec execute 195 sec latency 194.251 ms 2024-05-04T02:27:31.661 INFO:tasks.workunit.client.0.smithi001.stdout: 1 7397 0.12 MB/sec execute 196 sec latency 178.424 ms 2024-05-04T02:27:32.661 INFO:tasks.workunit.client.0.smithi001.stdout: 1 7413 0.12 MB/sec execute 197 sec latency 171.251 ms 2024-05-04T02:27:33.661 INFO:tasks.workunit.client.0.smithi001.stdout: 1 7422 0.12 MB/sec execute 198 sec latency 364.498 ms 2024-05-04T02:27:34.661 INFO:tasks.workunit.client.0.smithi001.stdout: 1 7440 0.12 MB/sec execute 199 sec latency 371.886 ms 2024-05-04T02:27:35.661 INFO:tasks.workunit.client.0.smithi001.stdout: 1 7458 0.12 MB/sec execute 200 sec latency 387.477 ms 2024-05-04T02:27:36.661 INFO:tasks.workunit.client.0.smithi001.stdout: 1 7471 0.12 MB/sec execute 201 sec latency 354.797 ms 2024-05-04T02:27:37.662 INFO:tasks.workunit.client.0.smithi001.stdout: 1 7482 0.12 MB/sec execute 202 sec latency 180.063 ms 2024-05-04T02:27:38.662 INFO:tasks.workunit.client.0.smithi001.stdout: 1 7495 0.12 MB/sec execute 203 sec latency 206.855 ms 2024-05-04T02:27:39.662 INFO:tasks.workunit.client.0.smithi001.stdout: 1 7507 0.12 MB/sec execute 204 sec latency 215.113 ms 2024-05-04T02:27:40.661 INFO:tasks.workunit.client.0.smithi001.stdout: 1 7522 0.12 MB/sec execute 205 sec latency 171.880 ms 2024-05-04T02:27:41.662 INFO:tasks.workunit.client.0.smithi001.stdout: 1 7537 0.12 MB/sec execute 206 sec latency 173.546 ms 2024-05-04T02:27:42.662 INFO:tasks.workunit.client.0.smithi001.stdout: 1 7553 0.12 MB/sec execute 207 sec latency 167.305 ms 2024-05-04T02:27:43.662 INFO:tasks.workunit.client.0.smithi001.stdout: 1 7567 0.11 MB/sec execute 208 sec latency 169.823 ms 2024-05-04T02:27:44.662 INFO:tasks.workunit.client.0.smithi001.stdout: 1 7576 0.11 MB/sec execute 209 sec latency 334.463 ms 2024-05-04T02:27:45.662 INFO:tasks.workunit.client.0.smithi001.stdout: 1 7585 0.11 MB/sec execute 210 sec latency 365.394 ms 2024-05-04T02:27:46.662 INFO:tasks.workunit.client.0.smithi001.stdout: 1 7603 0.11 MB/sec execute 211 sec latency 364.656 ms 2024-05-04T02:27:47.662 INFO:tasks.workunit.client.0.smithi001.stdout: 1 7615 0.11 MB/sec execute 212 sec latency 214.291 ms 2024-05-04T02:27:48.662 INFO:tasks.workunit.client.0.smithi001.stdout: 1 7637 0.11 MB/sec execute 213 sec latency 379.120 ms 2024-05-04T02:27:49.662 INFO:tasks.workunit.client.0.smithi001.stdout: 1 7654 0.11 MB/sec execute 214 sec latency 349.972 ms 2024-05-04T02:27:50.662 INFO:tasks.workunit.client.0.smithi001.stdout: 1 7678 0.11 MB/sec execute 215 sec latency 441.837 ms 2024-05-04T02:27:51.662 INFO:tasks.workunit.client.0.smithi001.stdout: 1 7699 0.11 MB/sec execute 216 sec latency 175.914 ms 2024-05-04T02:27:52.662 INFO:tasks.workunit.client.0.smithi001.stdout: 1 7715 0.11 MB/sec execute 217 sec latency 277.669 ms 2024-05-04T02:27:53.662 INFO:tasks.workunit.client.0.smithi001.stdout: 1 7721 0.11 MB/sec execute 218 sec latency 524.324 ms 2024-05-04T02:27:54.446 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:27:54.449 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:27:54.662 INFO:tasks.workunit.client.0.smithi001.stdout: 1 7753 0.11 MB/sec execute 219 sec latency 612.308 ms 2024-05-04T02:27:55.662 INFO:tasks.workunit.client.0.smithi001.stdout: 1 7766 0.11 MB/sec execute 220 sec latency 349.904 ms 2024-05-04T02:27:56.662 INFO:tasks.workunit.client.0.smithi001.stdout: 1 7783 0.11 MB/sec execute 221 sec latency 444.283 ms 2024-05-04T02:27:57.662 INFO:tasks.workunit.client.0.smithi001.stdout: 1 7812 0.11 MB/sec execute 222 sec latency 347.989 ms 2024-05-04T02:27:58.662 INFO:tasks.workunit.client.0.smithi001.stdout: 1 7842 0.11 MB/sec execute 223 sec latency 252.568 ms 2024-05-04T02:27:59.662 INFO:tasks.workunit.client.0.smithi001.stdout: 1 7859 0.11 MB/sec execute 224 sec latency 359.038 ms 2024-05-04T02:28:00.663 INFO:tasks.workunit.client.0.smithi001.stdout: 1 7892 0.11 MB/sec execute 225 sec latency 554.490 ms 2024-05-04T02:28:01.663 INFO:tasks.workunit.client.0.smithi001.stdout: 1 7926 0.11 MB/sec execute 226 sec latency 319.342 ms 2024-05-04T02:28:02.663 INFO:tasks.workunit.client.0.smithi001.stdout: 1 7935 0.11 MB/sec execute 227 sec latency 349.337 ms 2024-05-04T02:28:03.663 INFO:tasks.workunit.client.0.smithi001.stdout: 1 7966 0.11 MB/sec execute 228 sec latency 410.630 ms 2024-05-04T02:28:04.663 INFO:tasks.workunit.client.0.smithi001.stdout: 1 7975 0.11 MB/sec execute 229 sec latency 446.433 ms 2024-05-04T02:28:05.663 INFO:tasks.workunit.client.0.smithi001.stdout: 1 8009 0.11 MB/sec execute 230 sec latency 338.205 ms 2024-05-04T02:28:06.663 INFO:tasks.workunit.client.0.smithi001.stdout: 1 8039 0.11 MB/sec execute 231 sec latency 272.813 ms 2024-05-04T02:28:07.663 INFO:tasks.workunit.client.0.smithi001.stdout: 1 8043 0.11 MB/sec execute 232 sec latency 348.899 ms 2024-05-04T02:28:08.663 INFO:tasks.workunit.client.0.smithi001.stdout: 1 8053 0.11 MB/sec execute 233 sec latency 330.924 ms 2024-05-04T02:28:09.663 INFO:tasks.workunit.client.0.smithi001.stdout: 1 8081 0.11 MB/sec execute 234 sec latency 371.037 ms 2024-05-04T02:28:10.663 INFO:tasks.workunit.client.0.smithi001.stdout: 1 8109 0.11 MB/sec execute 235 sec latency 351.017 ms 2024-05-04T02:28:11.663 INFO:tasks.workunit.client.0.smithi001.stdout: 1 8144 0.11 MB/sec execute 236 sec latency 340.537 ms 2024-05-04T02:28:12.663 INFO:tasks.workunit.client.0.smithi001.stdout: 1 8157 0.11 MB/sec execute 237 sec latency 367.149 ms 2024-05-04T02:28:13.663 INFO:tasks.workunit.client.0.smithi001.stdout: 1 8170 0.11 MB/sec execute 238 sec latency 377.165 ms 2024-05-04T02:28:14.663 INFO:tasks.workunit.client.0.smithi001.stdout: 1 8198 0.11 MB/sec execute 239 sec latency 354.498 ms 2024-05-04T02:28:15.664 INFO:tasks.workunit.client.0.smithi001.stdout: 1 8223 0.11 MB/sec execute 240 sec latency 462.439 ms 2024-05-04T02:28:16.664 INFO:tasks.workunit.client.0.smithi001.stdout: 1 8252 0.11 MB/sec execute 241 sec latency 332.011 ms 2024-05-04T02:28:17.664 INFO:tasks.workunit.client.0.smithi001.stdout: 1 8271 0.11 MB/sec execute 242 sec latency 337.142 ms 2024-05-04T02:28:18.666 INFO:tasks.workunit.client.0.smithi001.stdout: 1 8278 0.11 MB/sec execute 243 sec latency 323.802 ms 2024-05-04T02:28:19.664 INFO:tasks.workunit.client.0.smithi001.stdout: 1 8289 0.11 MB/sec execute 244 sec latency 326.425 ms 2024-05-04T02:28:20.664 INFO:tasks.workunit.client.0.smithi001.stdout: 1 8322 0.11 MB/sec execute 245 sec latency 382.841 ms 2024-05-04T02:28:21.664 INFO:tasks.workunit.client.0.smithi001.stdout: 1 8352 0.11 MB/sec execute 246 sec latency 219.477 ms 2024-05-04T02:28:22.664 INFO:tasks.workunit.client.0.smithi001.stdout: 1 8385 0.11 MB/sec execute 247 sec latency 313.139 ms 2024-05-04T02:28:23.664 INFO:tasks.workunit.client.0.smithi001.stdout: 1 8390 0.10 MB/sec execute 248 sec latency 358.873 ms 2024-05-04T02:28:24.524 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:28:24.529 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:28:24.679 INFO:tasks.workunit.client.0.smithi001.stdout: 1 8485 0.12 MB/sec execute 249 sec latency 371.734 ms 2024-05-04T02:28:25.664 INFO:tasks.workunit.client.0.smithi001.stdout: 1 8490 0.12 MB/sec execute 250 sec latency 355.479 ms 2024-05-04T02:28:26.664 INFO:tasks.workunit.client.0.smithi001.stdout: 1 8505 0.12 MB/sec execute 251 sec latency 333.756 ms 2024-05-04T02:28:27.664 INFO:tasks.workunit.client.0.smithi001.stdout: 1 8526 0.11 MB/sec execute 252 sec latency 338.772 ms 2024-05-04T02:28:28.621 INFO:tasks.ceph.mon.a.smithi001.stderr:==00:00:09:01.978 35030== Warning: unimplemented fcntl command: 1036 2024-05-04T02:28:28.664 INFO:tasks.workunit.client.0.smithi001.stdout: 1 8555 0.11 MB/sec execute 253 sec latency 340.263 ms 2024-05-04T02:28:28.668 INFO:tasks.ceph.mon.b.smithi107.stderr:==00:00:09:01.996 34877== Warning: unimplemented fcntl command: 1036 2024-05-04T02:28:28.707 INFO:tasks.ceph.mon.a.smithi001.stderr:==00:00:09:02.063 35030== Warning: unimplemented fcntl command: 1036 2024-05-04T02:28:28.737 INFO:tasks.ceph.mon.b.smithi107.stderr:==00:00:09:02.064 34877== Warning: unimplemented fcntl command: 1036 2024-05-04T02:28:28.759 INFO:tasks.ceph.mon.c.smithi107.stderr:==00:00:09:02.087 34878== Warning: unimplemented fcntl command: 1036 2024-05-04T02:28:28.824 INFO:tasks.ceph.mon.c.smithi107.stderr:==00:00:09:02.151 34878== Warning: unimplemented fcntl command: 1036 2024-05-04T02:28:29.160 INFO:tasks.ceph.mon.a.smithi001.stderr:==00:00:09:02.516 35030== Warning: unimplemented fcntl command: 1036 2024-05-04T02:28:29.170 INFO:tasks.ceph.mon.b.smithi107.stderr:==00:00:09:02.498 34877== Warning: unimplemented fcntl command: 1036 2024-05-04T02:28:29.245 INFO:tasks.ceph.mon.c.smithi107.stderr:==00:00:09:02.572 34878== Warning: unimplemented fcntl command: 1036 2024-05-04T02:28:29.664 INFO:tasks.workunit.client.0.smithi001.stdout: 1 8572 0.11 MB/sec execute 254 sec latency 366.934 ms 2024-05-04T02:28:30.664 INFO:tasks.workunit.client.0.smithi001.stdout: 1 8594 0.11 MB/sec execute 255 sec latency 358.439 ms 2024-05-04T02:28:31.664 INFO:tasks.workunit.client.0.smithi001.stdout: 1 8608 0.11 MB/sec execute 256 sec latency 395.959 ms 2024-05-04T02:28:32.664 INFO:tasks.workunit.client.0.smithi001.stdout: 1 8633 0.11 MB/sec execute 257 sec latency 184.833 ms 2024-05-04T02:28:33.665 INFO:tasks.workunit.client.0.smithi001.stdout: 1 8660 0.11 MB/sec execute 258 sec latency 316.805 ms 2024-05-04T02:28:34.664 INFO:tasks.workunit.client.0.smithi001.stdout: 1 8676 0.11 MB/sec execute 259 sec latency 349.878 ms 2024-05-04T02:28:35.664 INFO:tasks.workunit.client.0.smithi001.stdout: 1 8697 0.11 MB/sec execute 260 sec latency 259.089 ms 2024-05-04T02:28:36.665 INFO:tasks.workunit.client.0.smithi001.stdout: 1 8718 0.11 MB/sec execute 261 sec latency 350.477 ms 2024-05-04T02:28:37.665 INFO:tasks.workunit.client.0.smithi001.stdout: 1 8736 0.11 MB/sec execute 262 sec latency 374.041 ms 2024-05-04T02:28:38.665 INFO:tasks.workunit.client.0.smithi001.stdout: 1 8752 0.11 MB/sec execute 263 sec latency 321.075 ms 2024-05-04T02:28:39.665 INFO:tasks.workunit.client.0.smithi001.stdout: 1 8794 0.11 MB/sec execute 264 sec latency 359.354 ms 2024-05-04T02:28:40.665 INFO:tasks.workunit.client.0.smithi001.stdout: 1 8809 0.11 MB/sec execute 265 sec latency 572.303 ms 2024-05-04T02:28:41.665 INFO:tasks.workunit.client.0.smithi001.stdout: 1 8841 0.11 MB/sec execute 266 sec latency 368.560 ms 2024-05-04T02:28:42.665 INFO:tasks.workunit.client.0.smithi001.stdout: 1 8881 0.11 MB/sec execute 267 sec latency 355.151 ms 2024-05-04T02:28:43.665 INFO:tasks.workunit.client.0.smithi001.stdout: 1 8914 0.11 MB/sec execute 268 sec latency 285.346 ms 2024-05-04T02:28:44.665 INFO:tasks.workunit.client.0.smithi001.stdout: 1 8934 0.11 MB/sec execute 269 sec latency 386.518 ms 2024-05-04T02:28:45.665 INFO:tasks.workunit.client.0.smithi001.stdout: 1 8949 0.11 MB/sec execute 270 sec latency 376.364 ms 2024-05-04T02:28:46.665 INFO:tasks.workunit.client.0.smithi001.stdout: 1 8971 0.11 MB/sec execute 271 sec latency 347.256 ms 2024-05-04T02:28:47.665 INFO:tasks.workunit.client.0.smithi001.stdout: 1 8992 0.11 MB/sec execute 272 sec latency 364.283 ms 2024-05-04T02:28:48.665 INFO:tasks.workunit.client.0.smithi001.stdout: 1 9017 0.11 MB/sec execute 273 sec latency 316.684 ms 2024-05-04T02:28:49.666 INFO:tasks.workunit.client.0.smithi001.stdout: 1 9029 0.11 MB/sec execute 274 sec latency 333.489 ms 2024-05-04T02:28:50.665 INFO:tasks.workunit.client.0.smithi001.stdout: 1 9082 0.11 MB/sec execute 275 sec latency 504.810 ms 2024-05-04T02:28:51.666 INFO:tasks.workunit.client.0.smithi001.stdout: 1 9106 0.11 MB/sec execute 276 sec latency 338.884 ms 2024-05-04T02:28:52.666 INFO:tasks.workunit.client.0.smithi001.stdout: 1 9141 0.11 MB/sec execute 277 sec latency 375.772 ms 2024-05-04T02:28:53.666 INFO:tasks.workunit.client.0.smithi001.stdout: 1 9159 0.11 MB/sec execute 278 sec latency 378.538 ms 2024-05-04T02:28:54.666 INFO:tasks.workunit.client.0.smithi001.stdout: 1 9167 0.11 MB/sec execute 279 sec latency 347.974 ms 2024-05-04T02:28:54.678 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:28:54.680 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:28:55.666 INFO:tasks.workunit.client.0.smithi001.stdout: 1 9194 0.11 MB/sec execute 280 sec latency 392.144 ms 2024-05-04T02:28:56.666 INFO:tasks.workunit.client.0.smithi001.stdout: 1 9208 0.11 MB/sec execute 281 sec latency 378.732 ms 2024-05-04T02:28:57.666 INFO:tasks.workunit.client.0.smithi001.stdout: 1 9251 0.10 MB/sec execute 282 sec latency 320.597 ms 2024-05-04T02:28:58.666 INFO:tasks.workunit.client.0.smithi001.stdout: 1 9279 0.10 MB/sec execute 283 sec latency 394.138 ms 2024-05-04T02:28:59.666 INFO:tasks.workunit.client.0.smithi001.stdout: 1 9287 0.10 MB/sec execute 284 sec latency 372.910 ms 2024-05-04T02:29:00.666 INFO:tasks.workunit.client.0.smithi001.stdout: 1 9311 0.10 MB/sec execute 285 sec latency 395.069 ms 2024-05-04T02:29:01.666 INFO:tasks.workunit.client.0.smithi001.stdout: 1 9367 0.10 MB/sec execute 286 sec latency 328.012 ms 2024-05-04T02:29:02.666 INFO:tasks.workunit.client.0.smithi001.stdout: 1 9407 0.11 MB/sec execute 287 sec latency 325.351 ms 2024-05-04T02:29:03.666 INFO:tasks.workunit.client.0.smithi001.stdout: 1 9411 0.11 MB/sec execute 288 sec latency 521.002 ms 2024-05-04T02:29:04.666 INFO:tasks.workunit.client.0.smithi001.stdout: 1 9431 0.11 MB/sec execute 289 sec latency 403.771 ms 2024-05-04T02:29:05.666 INFO:tasks.workunit.client.0.smithi001.stdout: 1 9444 0.11 MB/sec execute 290 sec latency 359.006 ms 2024-05-04T02:29:06.666 INFO:tasks.workunit.client.0.smithi001.stdout: 1 9465 0.11 MB/sec execute 291 sec latency 359.132 ms 2024-05-04T02:29:07.666 INFO:tasks.workunit.client.0.smithi001.stdout: 1 9468 0.11 MB/sec execute 292 sec latency 611.734 ms 2024-05-04T02:29:08.666 INFO:tasks.workunit.client.0.smithi001.stdout: 1 9475 0.11 MB/sec execute 293 sec latency 363.349 ms 2024-05-04T02:29:09.666 INFO:tasks.workunit.client.0.smithi001.stdout: 1 9495 0.10 MB/sec execute 294 sec latency 370.505 ms 2024-05-04T02:29:10.666 INFO:tasks.workunit.client.0.smithi001.stdout: 1 9511 0.10 MB/sec execute 295 sec latency 538.218 ms 2024-05-04T02:29:11.667 INFO:tasks.workunit.client.0.smithi001.stdout: 1 9532 0.10 MB/sec execute 296 sec latency 424.621 ms 2024-05-04T02:29:12.667 INFO:tasks.workunit.client.0.smithi001.stdout: 1 9540 0.10 MB/sec execute 297 sec latency 393.162 ms 2024-05-04T02:29:13.667 INFO:tasks.workunit.client.0.smithi001.stdout: 1 9557 0.10 MB/sec execute 298 sec latency 165.698 ms 2024-05-04T02:29:14.667 INFO:tasks.workunit.client.0.smithi001.stdout: 1 9593 0.11 MB/sec execute 299 sec latency 338.180 ms 2024-05-04T02:29:15.667 INFO:tasks.workunit.client.0.smithi001.stdout: 1 9598 0.11 MB/sec execute 300 sec latency 359.716 ms 2024-05-04T02:29:16.667 INFO:tasks.workunit.client.0.smithi001.stdout: 1 9651 0.11 MB/sec execute 301 sec latency 372.262 ms 2024-05-04T02:29:17.667 INFO:tasks.workunit.client.0.smithi001.stdout: 1 9661 0.11 MB/sec execute 302 sec latency 353.353 ms 2024-05-04T02:29:18.667 INFO:tasks.workunit.client.0.smithi001.stdout: 1 9682 0.11 MB/sec execute 303 sec latency 326.466 ms 2024-05-04T02:29:19.667 INFO:tasks.workunit.client.0.smithi001.stdout: 1 9685 0.10 MB/sec execute 304 sec latency 389.660 ms 2024-05-04T02:29:20.667 INFO:tasks.workunit.client.0.smithi001.stdout: 1 9705 0.10 MB/sec execute 305 sec latency 323.398 ms 2024-05-04T02:29:21.667 INFO:tasks.workunit.client.0.smithi001.stdout: 1 9719 0.10 MB/sec execute 306 sec latency 368.859 ms 2024-05-04T02:29:22.667 INFO:tasks.workunit.client.0.smithi001.stdout: 1 9724 0.10 MB/sec execute 307 sec latency 362.004 ms 2024-05-04T02:29:23.667 INFO:tasks.workunit.client.0.smithi001.stdout: 1 9846 0.11 MB/sec execute 308 sec latency 327.316 ms 2024-05-04T02:29:24.667 INFO:tasks.workunit.client.0.smithi001.stdout: 1 9863 0.11 MB/sec execute 309 sec latency 347.598 ms 2024-05-04T02:29:24.737 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:29:24.740 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:29:25.667 INFO:tasks.workunit.client.0.smithi001.stdout: 1 9880 0.11 MB/sec execute 310 sec latency 306.590 ms 2024-05-04T02:29:26.667 INFO:tasks.workunit.client.0.smithi001.stdout: 1 9979 0.11 MB/sec execute 311 sec latency 311.178 ms 2024-05-04T02:29:27.667 INFO:tasks.workunit.client.0.smithi001.stdout: 1 10016 0.12 MB/sec execute 312 sec latency 167.375 ms 2024-05-04T02:29:28.667 INFO:tasks.workunit.client.0.smithi001.stdout: 1 10037 0.12 MB/sec execute 313 sec latency 232.660 ms 2024-05-04T02:29:29.668 INFO:tasks.workunit.client.0.smithi001.stdout: 1 10073 0.12 MB/sec execute 314 sec latency 334.583 ms 2024-05-04T02:29:30.668 INFO:tasks.workunit.client.0.smithi001.stdout: 1 10083 0.12 MB/sec execute 315 sec latency 638.923 ms 2024-05-04T02:29:31.668 INFO:tasks.workunit.client.0.smithi001.stdout: 1 10099 0.12 MB/sec execute 316 sec latency 335.279 ms 2024-05-04T02:29:32.668 INFO:tasks.workunit.client.0.smithi001.stdout: 1 10123 0.11 MB/sec execute 317 sec latency 254.782 ms 2024-05-04T02:29:33.668 INFO:tasks.workunit.client.0.smithi001.stdout: 1 10267 0.12 MB/sec execute 318 sec latency 366.807 ms 2024-05-04T02:29:34.668 INFO:tasks.workunit.client.0.smithi001.stdout: 1 10287 0.12 MB/sec execute 319 sec latency 214.806 ms 2024-05-04T02:29:35.668 INFO:tasks.workunit.client.0.smithi001.stdout: 1 10311 0.12 MB/sec execute 320 sec latency 388.515 ms 2024-05-04T02:29:36.668 INFO:tasks.workunit.client.0.smithi001.stdout: 1 10367 0.12 MB/sec execute 321 sec latency 342.653 ms 2024-05-04T02:29:37.668 INFO:tasks.workunit.client.0.smithi001.stdout: 1 10381 0.12 MB/sec execute 322 sec latency 351.912 ms 2024-05-04T02:29:38.668 INFO:tasks.workunit.client.0.smithi001.stdout: 1 10384 0.12 MB/sec execute 323 sec latency 405.686 ms 2024-05-04T02:29:39.668 INFO:tasks.workunit.client.0.smithi001.stdout: 1 10389 0.12 MB/sec execute 324 sec latency 370.029 ms 2024-05-04T02:29:40.668 INFO:tasks.workunit.client.0.smithi001.stdout: 1 10391 0.12 MB/sec execute 325 sec latency 587.383 ms 2024-05-04T02:29:41.668 INFO:tasks.workunit.client.0.smithi001.stdout: 1 10394 0.12 MB/sec execute 326 sec latency 480.943 ms 2024-05-04T02:29:42.668 INFO:tasks.workunit.client.0.smithi001.stdout: 1 10398 0.12 MB/sec execute 327 sec latency 387.126 ms 2024-05-04T02:29:43.669 INFO:tasks.workunit.client.0.smithi001.stdout: 1 10406 0.12 MB/sec execute 328 sec latency 347.281 ms 2024-05-04T02:29:44.669 INFO:tasks.workunit.client.0.smithi001.stdout: 1 10409 0.12 MB/sec execute 329 sec latency 356.159 ms 2024-05-04T02:29:45.669 INFO:tasks.workunit.client.0.smithi001.stdout: 1 10412 0.12 MB/sec execute 330 sec latency 341.983 ms 2024-05-04T02:29:46.669 INFO:tasks.workunit.client.0.smithi001.stdout: 1 10416 0.12 MB/sec execute 331 sec latency 330.161 ms 2024-05-04T02:29:47.669 INFO:tasks.workunit.client.0.smithi001.stdout: 1 10419 0.12 MB/sec execute 332 sec latency 371.030 ms 2024-05-04T02:29:48.669 INFO:tasks.workunit.client.0.smithi001.stdout: 1 10423 0.11 MB/sec execute 333 sec latency 335.567 ms 2024-05-04T02:29:49.669 INFO:tasks.workunit.client.0.smithi001.stdout: 1 10425 0.11 MB/sec execute 334 sec latency 414.780 ms 2024-05-04T02:29:50.671 INFO:tasks.workunit.client.0.smithi001.stdout: 1 10430 0.11 MB/sec execute 335 sec latency 447.573 ms 2024-05-04T02:29:51.669 INFO:tasks.workunit.client.0.smithi001.stdout: 1 10433 0.11 MB/sec execute 336 sec latency 364.559 ms 2024-05-04T02:29:52.669 INFO:tasks.workunit.client.0.smithi001.stdout: 1 10436 0.11 MB/sec execute 337 sec latency 359.048 ms 2024-05-04T02:29:53.669 INFO:tasks.workunit.client.0.smithi001.stdout: 1 10459 0.11 MB/sec execute 338 sec latency 331.762 ms 2024-05-04T02:29:54.669 INFO:tasks.workunit.client.0.smithi001.stdout: 1 10477 0.11 MB/sec execute 339 sec latency 153.720 ms 2024-05-04T02:29:54.873 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:29:54.876 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:29:55.669 INFO:tasks.workunit.client.0.smithi001.stdout: 1 10493 0.11 MB/sec execute 340 sec latency 365.538 ms 2024-05-04T02:29:56.670 INFO:tasks.workunit.client.0.smithi001.stdout: 1 10599 0.12 MB/sec execute 341 sec latency 317.667 ms 2024-05-04T02:29:57.669 INFO:tasks.workunit.client.0.smithi001.stdout: 1 10627 0.12 MB/sec execute 342 sec latency 147.901 ms 2024-05-04T02:29:58.669 INFO:tasks.workunit.client.0.smithi001.stdout: 1 10647 0.12 MB/sec execute 343 sec latency 318.688 ms 2024-05-04T02:29:59.670 INFO:tasks.workunit.client.0.smithi001.stdout: 1 10659 0.12 MB/sec execute 344 sec latency 396.470 ms 2024-05-04T02:30:00.670 INFO:tasks.workunit.client.0.smithi001.stdout: 1 10679 0.12 MB/sec execute 345 sec latency 389.457 ms 2024-05-04T02:30:01.670 INFO:tasks.workunit.client.0.smithi001.stdout: 1 10720 0.12 MB/sec execute 346 sec latency 357.127 ms 2024-05-04T02:30:02.670 INFO:tasks.workunit.client.0.smithi001.stdout: 1 10736 0.12 MB/sec execute 347 sec latency 377.975 ms 2024-05-04T02:30:03.670 INFO:tasks.workunit.client.0.smithi001.stdout: 1 10763 0.12 MB/sec execute 348 sec latency 207.576 ms 2024-05-04T02:30:04.670 INFO:tasks.workunit.client.0.smithi001.stdout: 1 10776 0.12 MB/sec execute 349 sec latency 367.358 ms 2024-05-04T02:30:05.670 INFO:tasks.workunit.client.0.smithi001.stdout: 1 10797 0.12 MB/sec execute 350 sec latency 349.114 ms 2024-05-04T02:30:06.670 INFO:tasks.workunit.client.0.smithi001.stdout: 1 10848 0.12 MB/sec execute 351 sec latency 145.809 ms 2024-05-04T02:30:07.670 INFO:tasks.workunit.client.0.smithi001.stdout: 1 10863 0.12 MB/sec execute 352 sec latency 351.162 ms 2024-05-04T02:30:08.670 INFO:tasks.workunit.client.0.smithi001.stdout: 1 10878 0.12 MB/sec execute 353 sec latency 239.736 ms 2024-05-04T02:30:09.670 INFO:tasks.workunit.client.0.smithi001.stdout: 1 10886 0.12 MB/sec execute 354 sec latency 224.358 ms 2024-05-04T02:30:10.670 INFO:tasks.workunit.client.0.smithi001.stdout: 1 10895 0.12 MB/sec execute 355 sec latency 392.707 ms 2024-05-04T02:30:11.670 INFO:tasks.workunit.client.0.smithi001.stdout: 1 10910 0.12 MB/sec execute 356 sec latency 161.900 ms 2024-05-04T02:30:12.670 INFO:tasks.workunit.client.0.smithi001.stdout: 1 10926 0.12 MB/sec execute 357 sec latency 195.963 ms 2024-05-04T02:30:13.670 INFO:tasks.workunit.client.0.smithi001.stdout: 1 10938 0.12 MB/sec execute 358 sec latency 267.755 ms 2024-05-04T02:30:14.671 INFO:tasks.workunit.client.0.smithi001.stdout: 1 10954 0.12 MB/sec execute 359 sec latency 168.967 ms 2024-05-04T02:30:15.671 INFO:tasks.workunit.client.0.smithi001.stdout: 1 10966 0.12 MB/sec execute 360 sec latency 321.777 ms 2024-05-04T02:30:16.671 INFO:tasks.workunit.client.0.smithi001.stdout: 1 10985 0.12 MB/sec execute 361 sec latency 356.710 ms 2024-05-04T02:30:17.671 INFO:tasks.workunit.client.0.smithi001.stdout: 1 10990 0.12 MB/sec execute 362 sec latency 363.046 ms 2024-05-04T02:30:18.671 INFO:tasks.workunit.client.0.smithi001.stdout: 1 11011 0.12 MB/sec execute 363 sec latency 328.518 ms 2024-05-04T02:30:19.671 INFO:tasks.workunit.client.0.smithi001.stdout: 1 11026 0.12 MB/sec execute 364 sec latency 187.272 ms 2024-05-04T02:30:20.671 INFO:tasks.workunit.client.0.smithi001.stdout: 1 11033 0.12 MB/sec execute 365 sec latency 400.121 ms 2024-05-04T02:30:21.671 INFO:tasks.workunit.client.0.smithi001.stdout: 1 11045 0.12 MB/sec execute 366 sec latency 197.108 ms 2024-05-04T02:30:22.671 INFO:tasks.workunit.client.0.smithi001.stdout: 1 11060 0.12 MB/sec execute 367 sec latency 158.420 ms 2024-05-04T02:30:23.671 INFO:tasks.workunit.client.0.smithi001.stdout: 1 11076 0.12 MB/sec execute 368 sec latency 163.055 ms 2024-05-04T02:30:24.671 INFO:tasks.workunit.client.0.smithi001.stdout: 1 11091 0.12 MB/sec execute 369 sec latency 175.304 ms 2024-05-04T02:30:24.927 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:30:24.929 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:30:25.671 INFO:tasks.workunit.client.0.smithi001.stdout: 1 11105 0.12 MB/sec execute 370 sec latency 171.559 ms 2024-05-04T02:30:26.671 INFO:tasks.workunit.client.0.smithi001.stdout: 1 11117 0.12 MB/sec execute 371 sec latency 296.780 ms 2024-05-04T02:30:27.671 INFO:tasks.workunit.client.0.smithi001.stdout: 1 11125 0.12 MB/sec execute 372 sec latency 362.873 ms 2024-05-04T02:30:28.671 INFO:tasks.workunit.client.0.smithi001.stdout: 1 11137 0.12 MB/sec execute 373 sec latency 301.251 ms 2024-05-04T02:30:29.671 INFO:tasks.workunit.client.0.smithi001.stdout: 1 11153 0.11 MB/sec execute 374 sec latency 351.729 ms 2024-05-04T02:30:30.671 INFO:tasks.workunit.client.0.smithi001.stdout: 1 11172 0.11 MB/sec execute 375 sec latency 356.607 ms 2024-05-04T02:30:31.671 INFO:tasks.workunit.client.0.smithi001.stdout: 1 11192 0.11 MB/sec execute 376 sec latency 340.921 ms 2024-05-04T02:30:32.671 INFO:tasks.workunit.client.0.smithi001.stdout: 1 11213 0.11 MB/sec execute 377 sec latency 165.155 ms 2024-05-04T02:30:33.671 INFO:tasks.workunit.client.0.smithi001.stdout: 1 11239 0.11 MB/sec execute 378 sec latency 105.857 ms 2024-05-04T02:30:34.671 INFO:tasks.workunit.client.0.smithi001.stdout: 1 11259 0.11 MB/sec execute 379 sec latency 188.391 ms 2024-05-04T02:30:35.672 INFO:tasks.workunit.client.0.smithi001.stdout: 1 11262 0.11 MB/sec execute 380 sec latency 683.562 ms 2024-05-04T02:30:36.671 INFO:tasks.workunit.client.0.smithi001.stdout: 1 11270 0.11 MB/sec execute 381 sec latency 376.906 ms 2024-05-04T02:30:37.672 INFO:tasks.workunit.client.0.smithi001.stdout: 1 11305 0.11 MB/sec execute 382 sec latency 455.688 ms 2024-05-04T02:30:38.672 INFO:tasks.workunit.client.0.smithi001.stdout: 1 11314 0.11 MB/sec execute 383 sec latency 530.801 ms 2024-05-04T02:30:39.672 INFO:tasks.workunit.client.0.smithi001.stdout: 1 11341 0.11 MB/sec execute 384 sec latency 367.410 ms 2024-05-04T02:30:40.672 INFO:tasks.workunit.client.0.smithi001.stdout: 1 11359 0.11 MB/sec execute 385 sec latency 508.847 ms 2024-05-04T02:30:41.672 INFO:tasks.workunit.client.0.smithi001.stdout: 1 11393 0.11 MB/sec execute 386 sec latency 246.350 ms 2024-05-04T02:30:42.672 INFO:tasks.workunit.client.0.smithi001.stdout: 1 11422 0.11 MB/sec execute 387 sec latency 351.713 ms 2024-05-04T02:30:43.672 INFO:tasks.workunit.client.0.smithi001.stdout: 1 11451 0.11 MB/sec execute 388 sec latency 250.590 ms 2024-05-04T02:30:44.672 INFO:tasks.workunit.client.0.smithi001.stdout: 1 11473 0.11 MB/sec execute 389 sec latency 325.679 ms 2024-05-04T02:30:45.672 INFO:tasks.workunit.client.0.smithi001.stdout: 1 11504 0.11 MB/sec execute 390 sec latency 391.134 ms 2024-05-04T02:30:46.672 INFO:tasks.workunit.client.0.smithi001.stdout: 1 11518 0.11 MB/sec execute 391 sec latency 381.280 ms 2024-05-04T02:30:47.672 INFO:tasks.workunit.client.0.smithi001.stdout: 1 11539 0.11 MB/sec execute 392 sec latency 354.051 ms 2024-05-04T02:30:48.672 INFO:tasks.workunit.client.0.smithi001.stdout: 1 11562 0.11 MB/sec execute 393 sec latency 355.855 ms 2024-05-04T02:30:49.672 INFO:tasks.workunit.client.0.smithi001.stdout: 1 11587 0.11 MB/sec execute 394 sec latency 307.865 ms 2024-05-04T02:30:50.673 INFO:tasks.workunit.client.0.smithi001.stdout: 1 11590 0.11 MB/sec execute 395 sec latency 518.392 ms 2024-05-04T02:30:51.672 INFO:tasks.workunit.client.0.smithi001.stdout: 1 11600 0.11 MB/sec execute 396 sec latency 368.665 ms 2024-05-04T02:30:52.673 INFO:tasks.workunit.client.0.smithi001.stdout: 1 11638 0.11 MB/sec execute 397 sec latency 373.092 ms 2024-05-04T02:30:53.673 INFO:tasks.workunit.client.0.smithi001.stdout: 1 11685 0.11 MB/sec execute 398 sec latency 312.771 ms 2024-05-04T02:30:54.673 INFO:tasks.workunit.client.0.smithi001.stdout: 1 11698 0.11 MB/sec execute 399 sec latency 331.939 ms 2024-05-04T02:30:55.064 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:30:55.067 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:30:55.673 INFO:tasks.workunit.client.0.smithi001.stdout: 1 11705 0.11 MB/sec execute 400 sec latency 337.639 ms 2024-05-04T02:30:56.673 INFO:tasks.workunit.client.0.smithi001.stdout: 1 11738 0.11 MB/sec execute 401 sec latency 333.498 ms 2024-05-04T02:30:57.673 INFO:tasks.workunit.client.0.smithi001.stdout: 1 11757 0.11 MB/sec execute 402 sec latency 315.248 ms 2024-05-04T02:30:58.673 INFO:tasks.workunit.client.0.smithi001.stdout: 1 11784 0.11 MB/sec execute 403 sec latency 347.075 ms 2024-05-04T02:30:59.673 INFO:tasks.workunit.client.0.smithi001.stdout: 1 11814 0.11 MB/sec execute 404 sec latency 214.368 ms 2024-05-04T02:31:00.673 INFO:tasks.workunit.client.0.smithi001.stdout: 1 11825 0.11 MB/sec execute 405 sec latency 486.900 ms 2024-05-04T02:31:01.673 INFO:tasks.workunit.client.0.smithi001.stdout: 1 11832 0.11 MB/sec execute 406 sec latency 354.980 ms 2024-05-04T02:31:02.673 INFO:tasks.workunit.client.0.smithi001.stdout: 1 11860 0.11 MB/sec execute 407 sec latency 250.721 ms 2024-05-04T02:31:03.673 INFO:tasks.workunit.client.0.smithi001.stdout: 1 11887 0.11 MB/sec execute 408 sec latency 342.628 ms 2024-05-04T02:31:04.673 INFO:tasks.workunit.client.0.smithi001.stdout: 1 11907 0.11 MB/sec execute 409 sec latency 354.578 ms 2024-05-04T02:31:05.673 INFO:tasks.workunit.client.0.smithi001.stdout: 1 11936 0.11 MB/sec execute 410 sec latency 353.048 ms 2024-05-04T02:31:06.673 INFO:tasks.workunit.client.0.smithi001.stdout: 1 11940 0.11 MB/sec execute 411 sec latency 367.254 ms 2024-05-04T02:31:07.673 INFO:tasks.workunit.client.0.smithi001.stdout: 1 12033 0.12 MB/sec execute 412 sec latency 361.884 ms 2024-05-04T02:31:08.673 INFO:tasks.workunit.client.0.smithi001.stdout: 1 12041 0.12 MB/sec execute 413 sec latency 335.763 ms 2024-05-04T02:31:09.673 INFO:tasks.workunit.client.0.smithi001.stdout: 1 12059 0.12 MB/sec execute 414 sec latency 361.568 ms 2024-05-04T02:31:10.674 INFO:tasks.workunit.client.0.smithi001.stdout: 1 12084 0.12 MB/sec execute 415 sec latency 314.954 ms 2024-05-04T02:31:11.674 INFO:tasks.workunit.client.0.smithi001.stdout: 1 12105 0.12 MB/sec execute 416 sec latency 339.717 ms 2024-05-04T02:31:12.674 INFO:tasks.workunit.client.0.smithi001.stdout: 1 12137 0.12 MB/sec execute 417 sec latency 341.885 ms 2024-05-04T02:31:13.674 INFO:tasks.workunit.client.0.smithi001.stdout: 1 12146 0.11 MB/sec execute 418 sec latency 358.120 ms 2024-05-04T02:31:14.674 INFO:tasks.workunit.client.0.smithi001.stdout: 1 12172 0.11 MB/sec execute 419 sec latency 364.511 ms 2024-05-04T02:31:15.587 INFO:tasks.ceph.mon.a.smithi001.stderr:==00:00:11:48.943 35030== Warning: unimplemented fcntl command: 1036 2024-05-04T02:31:15.591 INFO:tasks.ceph.mon.a.smithi001.stderr:==00:00:11:48.947 35030== Warning: unimplemented fcntl command: 1036 2024-05-04T02:31:15.607 INFO:tasks.ceph.mon.b.smithi107.stderr:==00:00:11:48.935 34877== Warning: unimplemented fcntl command: 1036 2024-05-04T02:31:15.610 INFO:tasks.ceph.mon.b.smithi107.stderr:==00:00:11:48.937 34877== Warning: unimplemented fcntl command: 1036 2024-05-04T02:31:15.611 INFO:tasks.ceph.mon.c.smithi107.stderr:==00:00:11:48.938 34878== Warning: unimplemented fcntl command: 1036 2024-05-04T02:31:15.613 INFO:tasks.ceph.mon.c.smithi107.stderr:==00:00:11:48.941 34878== Warning: unimplemented fcntl command: 1036 2024-05-04T02:31:15.674 INFO:tasks.workunit.client.0.smithi001.stdout: 1 12186 0.11 MB/sec execute 420 sec latency 321.152 ms 2024-05-04T02:31:15.692 INFO:tasks.ceph.mon.a.smithi001.stderr:==00:00:11:49.049 35030== Warning: unimplemented fcntl command: 1036 2024-05-04T02:31:15.711 INFO:tasks.ceph.mon.b.smithi107.stderr:==00:00:11:49.038 34877== Warning: unimplemented fcntl command: 1036 2024-05-04T02:31:15.714 INFO:tasks.ceph.mon.c.smithi107.stderr:==00:00:11:49.041 34878== Warning: unimplemented fcntl command: 1036 2024-05-04T02:31:16.674 INFO:tasks.workunit.client.0.smithi001.stdout: 1 12210 0.11 MB/sec execute 421 sec latency 390.801 ms 2024-05-04T02:31:17.674 INFO:tasks.workunit.client.0.smithi001.stdout: 1 12242 0.11 MB/sec execute 422 sec latency 421.280 ms 2024-05-04T02:31:18.674 INFO:tasks.workunit.client.0.smithi001.stdout: 1 12261 0.11 MB/sec execute 423 sec latency 323.388 ms 2024-05-04T02:31:19.674 INFO:tasks.workunit.client.0.smithi001.stdout: 1 12272 0.11 MB/sec execute 424 sec latency 360.009 ms 2024-05-04T02:31:20.674 INFO:tasks.workunit.client.0.smithi001.stdout: 1 12298 0.11 MB/sec execute 425 sec latency 452.313 ms 2024-05-04T02:31:21.674 INFO:tasks.workunit.client.0.smithi001.stdout: 1 12317 0.11 MB/sec execute 426 sec latency 356.155 ms 2024-05-04T02:31:22.674 INFO:tasks.workunit.client.0.smithi001.stdout: 1 12353 0.11 MB/sec execute 427 sec latency 340.131 ms 2024-05-04T02:31:23.674 INFO:tasks.workunit.client.0.smithi001.stdout: 1 12362 0.11 MB/sec execute 428 sec latency 346.129 ms 2024-05-04T02:31:24.674 INFO:tasks.workunit.client.0.smithi001.stdout: 1 12427 0.11 MB/sec execute 429 sec latency 354.970 ms 2024-05-04T02:31:25.139 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:31:25.141 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:31:25.674 INFO:tasks.workunit.client.0.smithi001.stdout: 1 12461 0.11 MB/sec execute 430 sec latency 350.475 ms 2024-05-04T02:31:26.675 INFO:tasks.workunit.client.0.smithi001.stdout: 1 12478 0.11 MB/sec execute 431 sec latency 379.591 ms 2024-05-04T02:31:27.675 INFO:tasks.workunit.client.0.smithi001.stdout: 1 12496 0.11 MB/sec execute 432 sec latency 342.325 ms 2024-05-04T02:31:28.677 INFO:tasks.workunit.client.0.smithi001.stdout: 1 12514 0.11 MB/sec execute 433 sec latency 347.941 ms 2024-05-04T02:31:29.675 INFO:tasks.workunit.client.0.smithi001.stdout: 1 12527 0.11 MB/sec execute 434 sec latency 333.718 ms 2024-05-04T02:31:30.675 INFO:tasks.workunit.client.0.smithi001.stdout: 1 12556 0.11 MB/sec execute 435 sec latency 542.135 ms 2024-05-04T02:31:31.675 INFO:tasks.workunit.client.0.smithi001.stdout: 1 12570 0.11 MB/sec execute 436 sec latency 356.575 ms 2024-05-04T02:31:32.675 INFO:tasks.workunit.client.0.smithi001.stdout: 1 12623 0.11 MB/sec execute 437 sec latency 363.425 ms 2024-05-04T02:31:33.675 INFO:tasks.workunit.client.0.smithi001.stdout: 1 12647 0.11 MB/sec execute 438 sec latency 337.111 ms 2024-05-04T02:31:34.675 INFO:tasks.workunit.client.0.smithi001.stdout: 1 12688 0.11 MB/sec execute 439 sec latency 343.466 ms 2024-05-04T02:31:35.675 INFO:tasks.workunit.client.0.smithi001.stdout: 1 12706 0.11 MB/sec execute 440 sec latency 378.693 ms 2024-05-04T02:31:36.677 INFO:tasks.workunit.client.0.smithi001.stdout: 1 12715 0.11 MB/sec execute 441 sec latency 338.777 ms 2024-05-04T02:31:37.675 INFO:tasks.workunit.client.0.smithi001.stdout: 1 12736 0.11 MB/sec execute 442 sec latency 395.154 ms 2024-05-04T02:31:38.675 INFO:tasks.workunit.client.0.smithi001.stdout: 1 12748 0.11 MB/sec execute 443 sec latency 373.825 ms 2024-05-04T02:31:39.675 INFO:tasks.workunit.client.0.smithi001.stdout: 1 12793 0.11 MB/sec execute 444 sec latency 408.447 ms 2024-05-04T02:31:40.675 INFO:tasks.workunit.client.0.smithi001.stdout: 1 12807 0.11 MB/sec execute 445 sec latency 378.247 ms 2024-05-04T02:31:41.675 INFO:tasks.workunit.client.0.smithi001.stdout: 1 12830 0.11 MB/sec execute 446 sec latency 367.357 ms 2024-05-04T02:31:42.675 INFO:tasks.workunit.client.0.smithi001.stdout: 1 12852 0.11 MB/sec execute 447 sec latency 372.748 ms 2024-05-04T02:31:43.675 INFO:tasks.workunit.client.0.smithi001.stdout: 1 12887 0.11 MB/sec execute 448 sec latency 339.700 ms 2024-05-04T02:31:44.676 INFO:tasks.workunit.client.0.smithi001.stdout: 1 12949 0.11 MB/sec execute 449 sec latency 333.181 ms 2024-05-04T02:31:45.676 INFO:tasks.workunit.client.0.smithi001.stdout: 1 12960 0.11 MB/sec execute 450 sec latency 377.766 ms 2024-05-04T02:31:46.676 INFO:tasks.workunit.client.0.smithi001.stdout: 1 12978 0.11 MB/sec execute 451 sec latency 369.831 ms 2024-05-04T02:31:47.676 INFO:tasks.workunit.client.0.smithi001.stdout: 1 12989 0.11 MB/sec execute 452 sec latency 361.023 ms 2024-05-04T02:31:48.676 INFO:tasks.workunit.client.0.smithi001.stdout: 1 13012 0.11 MB/sec execute 453 sec latency 346.605 ms 2024-05-04T02:31:49.676 INFO:tasks.workunit.client.0.smithi001.stdout: 1 13016 0.11 MB/sec execute 454 sec latency 572.468 ms 2024-05-04T02:31:50.676 INFO:tasks.workunit.client.0.smithi001.stdout: 1 13021 0.11 MB/sec execute 455 sec latency 555.732 ms 2024-05-04T02:31:51.676 INFO:tasks.workunit.client.0.smithi001.stdout: 1 13045 0.11 MB/sec execute 456 sec latency 318.344 ms 2024-05-04T02:31:52.676 INFO:tasks.workunit.client.0.smithi001.stdout: 1 13060 0.11 MB/sec execute 457 sec latency 345.572 ms 2024-05-04T02:31:53.677 INFO:tasks.workunit.client.0.smithi001.stdout: 1 13082 0.11 MB/sec execute 458 sec latency 351.066 ms 2024-05-04T02:31:54.676 INFO:tasks.workunit.client.0.smithi001.stdout: 1 13088 0.11 MB/sec execute 459 sec latency 325.190 ms 2024-05-04T02:31:55.215 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:31:55.218 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:31:55.676 INFO:tasks.workunit.client.0.smithi001.stdout: 1 13107 0.11 MB/sec execute 460 sec latency 163.558 ms 2024-05-04T02:31:56.677 INFO:tasks.workunit.client.0.smithi001.stdout: 1 13138 0.11 MB/sec execute 461 sec latency 315.075 ms 2024-05-04T02:31:57.677 INFO:tasks.workunit.client.0.smithi001.stdout: 1 13148 0.11 MB/sec execute 462 sec latency 370.287 ms 2024-05-04T02:31:58.677 INFO:tasks.workunit.client.0.smithi001.stdout: 1 13201 0.11 MB/sec execute 463 sec latency 391.198 ms 2024-05-04T02:31:59.677 INFO:tasks.workunit.client.0.smithi001.stdout: 1 13211 0.11 MB/sec execute 464 sec latency 345.286 ms 2024-05-04T02:32:00.677 INFO:tasks.workunit.client.0.smithi001.stdout: 1 13228 0.11 MB/sec execute 465 sec latency 378.121 ms 2024-05-04T02:32:01.677 INFO:tasks.workunit.client.0.smithi001.stdout: 1 13235 0.11 MB/sec execute 466 sec latency 335.249 ms 2024-05-04T02:32:02.677 INFO:tasks.workunit.client.0.smithi001.stdout: 1 13255 0.11 MB/sec execute 467 sec latency 319.301 ms 2024-05-04T02:32:03.677 INFO:tasks.workunit.client.0.smithi001.stdout: 1 13269 0.11 MB/sec execute 468 sec latency 332.460 ms 2024-05-04T02:32:04.677 INFO:tasks.workunit.client.0.smithi001.stdout: 1 13285 0.11 MB/sec execute 469 sec latency 357.690 ms 2024-05-04T02:32:05.677 INFO:tasks.workunit.client.0.smithi001.stdout: 1 13397 0.11 MB/sec execute 470 sec latency 364.220 ms 2024-05-04T02:32:06.677 INFO:tasks.workunit.client.0.smithi001.stdout: 1 13412 0.11 MB/sec execute 471 sec latency 367.809 ms 2024-05-04T02:32:07.677 INFO:tasks.workunit.client.0.smithi001.stdout: 1 13431 0.11 MB/sec execute 472 sec latency 215.394 ms 2024-05-04T02:32:08.677 INFO:tasks.workunit.client.0.smithi001.stdout: 1 13530 0.11 MB/sec execute 473 sec latency 344.136 ms 2024-05-04T02:32:09.677 INFO:tasks.workunit.client.0.smithi001.stdout: 1 13556 0.12 MB/sec execute 474 sec latency 175.865 ms 2024-05-04T02:32:10.677 INFO:tasks.workunit.client.0.smithi001.stdout: 1 13588 0.12 MB/sec execute 475 sec latency 210.236 ms 2024-05-04T02:32:11.677 INFO:tasks.workunit.client.0.smithi001.stdout: 1 13619 0.12 MB/sec execute 476 sec latency 360.653 ms 2024-05-04T02:32:12.677 INFO:tasks.workunit.client.0.smithi001.stdout: 1 13632 0.12 MB/sec execute 477 sec latency 445.707 ms 2024-05-04T02:32:13.678 INFO:tasks.workunit.client.0.smithi001.stdout: 1 13646 0.12 MB/sec execute 478 sec latency 326.685 ms 2024-05-04T02:32:14.678 INFO:tasks.workunit.client.0.smithi001.stdout: 1 13674 0.12 MB/sec execute 479 sec latency 224.980 ms 2024-05-04T02:32:15.678 INFO:tasks.workunit.client.0.smithi001.stdout: 1 13818 0.12 MB/sec execute 480 sec latency 355.132 ms 2024-05-04T02:32:16.678 INFO:tasks.workunit.client.0.smithi001.stdout: 1 13838 0.12 MB/sec execute 481 sec latency 245.212 ms 2024-05-04T02:32:17.678 INFO:tasks.workunit.client.0.smithi001.stdout: 1 13874 0.12 MB/sec execute 482 sec latency 335.595 ms 2024-05-04T02:32:18.678 INFO:tasks.workunit.client.0.smithi001.stdout: 1 13917 0.12 MB/sec execute 483 sec latency 346.776 ms 2024-05-04T02:32:19.678 INFO:tasks.workunit.client.0.smithi001.stdout: 1 13930 0.12 MB/sec execute 484 sec latency 368.417 ms 2024-05-04T02:32:20.678 INFO:tasks.workunit.client.0.smithi001.stdout: 1 13934 0.12 MB/sec execute 485 sec latency 450.100 ms 2024-05-04T02:32:21.678 INFO:tasks.workunit.client.0.smithi001.stdout: 1 13939 0.12 MB/sec execute 486 sec latency 426.417 ms 2024-05-04T02:32:22.678 INFO:tasks.workunit.client.0.smithi001.stdout: 1 13941 0.12 MB/sec execute 487 sec latency 482.850 ms 2024-05-04T02:32:23.678 INFO:tasks.workunit.client.0.smithi001.stdout: 1 13943 0.12 MB/sec execute 488 sec latency 480.812 ms 2024-05-04T02:32:24.678 INFO:tasks.workunit.client.0.smithi001.stdout: 1 13948 0.12 MB/sec execute 489 sec latency 401.601 ms 2024-05-04T02:32:25.459 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:32:25.462 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:32:25.678 INFO:tasks.workunit.client.0.smithi001.stdout: 1 13955 0.12 MB/sec execute 490 sec latency 349.016 ms 2024-05-04T02:32:26.678 INFO:tasks.workunit.client.0.smithi001.stdout: 1 13958 0.12 MB/sec execute 491 sec latency 390.783 ms 2024-05-04T02:32:27.678 INFO:tasks.workunit.client.0.smithi001.stdout: 1 13961 0.12 MB/sec execute 492 sec latency 367.363 ms 2024-05-04T02:32:28.678 INFO:tasks.workunit.client.0.smithi001.stdout: 1 13965 0.12 MB/sec execute 493 sec latency 346.253 ms 2024-05-04T02:32:29.678 INFO:tasks.workunit.client.0.smithi001.stdout: 1 13968 0.12 MB/sec execute 494 sec latency 353.887 ms 2024-05-04T02:32:30.678 INFO:tasks.workunit.client.0.smithi001.stdout: 1 13972 0.12 MB/sec execute 495 sec latency 426.657 ms 2024-05-04T02:32:31.679 INFO:tasks.workunit.client.0.smithi001.stdout: 1 13975 0.12 MB/sec execute 496 sec latency 325.738 ms 2024-05-04T02:32:32.679 INFO:tasks.workunit.client.0.smithi001.stdout: 1 13979 0.12 MB/sec execute 497 sec latency 346.295 ms 2024-05-04T02:32:33.679 INFO:tasks.workunit.client.0.smithi001.stdout: 1 13982 0.12 MB/sec execute 498 sec latency 334.182 ms 2024-05-04T02:32:34.679 INFO:tasks.workunit.client.0.smithi001.stdout: 1 13986 0.12 MB/sec execute 499 sec latency 345.359 ms 2024-05-04T02:32:35.679 INFO:tasks.workunit.client.0.smithi001.stdout: 1 14002 0.11 MB/sec execute 500 sec latency 356.551 ms 2024-05-04T02:32:36.679 INFO:tasks.workunit.client.0.smithi001.stdout: 1 14026 0.11 MB/sec execute 501 sec latency 147.157 ms 2024-05-04T02:32:37.679 INFO:tasks.workunit.client.0.smithi001.stdout: 1 14042 0.11 MB/sec execute 502 sec latency 329.462 ms 2024-05-04T02:32:38.679 INFO:tasks.workunit.client.0.smithi001.stdout: 1 14142 0.12 MB/sec execute 503 sec latency 335.350 ms 2024-05-04T02:32:39.679 INFO:tasks.workunit.client.0.smithi001.stdout: 1 14177 0.12 MB/sec execute 504 sec latency 132.861 ms 2024-05-04T02:32:40.679 INFO:tasks.workunit.client.0.smithi001.stdout: 1 14197 0.12 MB/sec execute 505 sec latency 356.813 ms 2024-05-04T02:32:41.679 INFO:tasks.workunit.client.0.smithi001.stdout: 1 14209 0.12 MB/sec execute 506 sec latency 362.833 ms 2024-05-04T02:32:42.679 INFO:tasks.workunit.client.0.smithi001.stdout: 1 14230 0.12 MB/sec execute 507 sec latency 390.656 ms 2024-05-04T02:32:43.680 INFO:tasks.workunit.client.0.smithi001.stdout: 1 14275 0.12 MB/sec execute 508 sec latency 373.080 ms 2024-05-04T02:32:44.680 INFO:tasks.workunit.client.0.smithi001.stdout: 1 14286 0.12 MB/sec execute 509 sec latency 439.032 ms 2024-05-04T02:32:45.680 INFO:tasks.workunit.client.0.smithi001.stdout: 1 14313 0.12 MB/sec execute 510 sec latency 262.023 ms 2024-05-04T02:32:46.680 INFO:tasks.workunit.client.0.smithi001.stdout: 1 14326 0.12 MB/sec execute 511 sec latency 354.471 ms 2024-05-04T02:32:47.680 INFO:tasks.workunit.client.0.smithi001.stdout: 1 14347 0.12 MB/sec execute 512 sec latency 342.779 ms 2024-05-04T02:32:48.680 INFO:tasks.workunit.client.0.smithi001.stdout: 1 14397 0.12 MB/sec execute 513 sec latency 146.994 ms 2024-05-04T02:32:49.680 INFO:tasks.workunit.client.0.smithi001.stdout: 1 14412 0.12 MB/sec execute 514 sec latency 345.584 ms 2024-05-04T02:32:50.680 INFO:tasks.workunit.client.0.smithi001.stdout: 1 14428 0.12 MB/sec execute 515 sec latency 206.571 ms 2024-05-04T02:32:51.680 INFO:tasks.workunit.client.0.smithi001.stdout: 1 14435 0.12 MB/sec execute 516 sec latency 214.402 ms 2024-05-04T02:32:52.680 INFO:tasks.workunit.client.0.smithi001.stdout: 1 14447 0.12 MB/sec execute 517 sec latency 228.447 ms 2024-05-04T02:32:53.680 INFO:tasks.workunit.client.0.smithi001.stdout: 1 14463 0.12 MB/sec execute 518 sec latency 167.653 ms 2024-05-04T02:32:54.680 INFO:tasks.workunit.client.0.smithi001.stdout: 1 14477 0.12 MB/sec execute 519 sec latency 182.262 ms 2024-05-04T02:32:55.588 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:32:55.590 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:32:55.680 INFO:tasks.workunit.client.0.smithi001.stdout: 1 14491 0.12 MB/sec execute 520 sec latency 171.865 ms 2024-05-04T02:32:56.680 INFO:tasks.workunit.client.0.smithi001.stdout: 1 14507 0.12 MB/sec execute 521 sec latency 184.202 ms 2024-05-04T02:32:57.680 INFO:tasks.workunit.client.0.smithi001.stdout: 1 14515 0.12 MB/sec execute 522 sec latency 380.704 ms 2024-05-04T02:32:58.680 INFO:tasks.workunit.client.0.smithi001.stdout: 1 14535 0.12 MB/sec execute 523 sec latency 349.138 ms 2024-05-04T02:32:59.680 INFO:tasks.workunit.client.0.smithi001.stdout: 1 14541 0.12 MB/sec execute 524 sec latency 368.914 ms 2024-05-04T02:33:00.680 INFO:tasks.workunit.client.0.smithi001.stdout: 1 14560 0.12 MB/sec execute 525 sec latency 343.068 ms 2024-05-04T02:33:01.680 INFO:tasks.workunit.client.0.smithi001.stdout: 1 14575 0.12 MB/sec execute 526 sec latency 196.408 ms 2024-05-04T02:33:02.681 INFO:tasks.workunit.client.0.smithi001.stdout: 1 14583 0.12 MB/sec execute 527 sec latency 226.373 ms 2024-05-04T02:33:03.681 INFO:tasks.workunit.client.0.smithi001.stdout: 1 14597 0.12 MB/sec execute 528 sec latency 200.841 ms 2024-05-04T02:33:04.681 INFO:tasks.workunit.client.0.smithi001.stdout: 1 14610 0.12 MB/sec execute 529 sec latency 162.637 ms 2024-05-04T02:33:05.681 INFO:tasks.workunit.client.0.smithi001.stdout: 1 14624 0.12 MB/sec execute 530 sec latency 214.827 ms 2024-05-04T02:33:06.681 INFO:tasks.workunit.client.0.smithi001.stdout: 1 14639 0.12 MB/sec execute 531 sec latency 151.093 ms 2024-05-04T02:33:07.681 INFO:tasks.workunit.client.0.smithi001.stdout: 1 14654 0.12 MB/sec execute 532 sec latency 164.702 ms 2024-05-04T02:33:08.681 INFO:tasks.workunit.client.0.smithi001.stdout: 1 14666 0.12 MB/sec execute 533 sec latency 286.639 ms 2024-05-04T02:33:09.681 INFO:tasks.workunit.client.0.smithi001.stdout: 1 14674 0.12 MB/sec execute 534 sec latency 365.117 ms 2024-05-04T02:33:10.681 INFO:tasks.workunit.client.0.smithi001.stdout: 1 14686 0.12 MB/sec execute 535 sec latency 330.375 ms 2024-05-04T02:33:11.681 INFO:tasks.workunit.client.0.smithi001.stdout: 1 14702 0.12 MB/sec execute 536 sec latency 371.241 ms 2024-05-04T02:33:12.681 INFO:tasks.workunit.client.0.smithi001.stdout: 1 14721 0.12 MB/sec execute 537 sec latency 328.894 ms 2024-05-04T02:33:13.681 INFO:tasks.workunit.client.0.smithi001.stdout: 1 14739 0.12 MB/sec execute 538 sec latency 341.769 ms 2024-05-04T02:33:14.681 INFO:tasks.workunit.client.0.smithi001.stdout: 1 14759 0.12 MB/sec execute 539 sec latency 156.176 ms 2024-05-04T02:33:15.682 INFO:tasks.workunit.client.0.smithi001.stdout: 1 14775 0.12 MB/sec execute 540 sec latency 462.803 ms 2024-05-04T02:33:16.681 INFO:tasks.workunit.client.0.smithi001.stdout: 1 14797 0.11 MB/sec execute 541 sec latency 185.252 ms 2024-05-04T02:33:17.681 INFO:tasks.workunit.client.0.smithi001.stdout: 1 14810 0.11 MB/sec execute 542 sec latency 364.848 ms 2024-05-04T02:33:18.682 INFO:tasks.workunit.client.0.smithi001.stdout: 1 14817 0.11 MB/sec execute 543 sec latency 451.599 ms 2024-05-04T02:33:19.682 INFO:tasks.workunit.client.0.smithi001.stdout: 1 14852 0.11 MB/sec execute 544 sec latency 802.728 ms 2024-05-04T02:33:20.682 INFO:tasks.workunit.client.0.smithi001.stdout: 1 14861 0.11 MB/sec execute 545 sec latency 421.731 ms 2024-05-04T02:33:21.682 INFO:tasks.workunit.client.0.smithi001.stdout: 1 14888 0.11 MB/sec execute 546 sec latency 371.333 ms 2024-05-04T02:33:22.682 INFO:tasks.workunit.client.0.smithi001.stdout: 1 14912 0.11 MB/sec execute 547 sec latency 354.700 ms 2024-05-04T02:33:23.682 INFO:tasks.workunit.client.0.smithi001.stdout: 1 14949 0.11 MB/sec execute 548 sec latency 256.305 ms 2024-05-04T02:33:24.682 INFO:tasks.workunit.client.0.smithi001.stdout: 1 14976 0.11 MB/sec execute 549 sec latency 344.379 ms 2024-05-04T02:33:25.682 INFO:tasks.workunit.client.0.smithi001.stdout: 1 15001 0.11 MB/sec execute 550 sec latency 271.831 ms 2024-05-04T02:33:25.816 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:33:25.819 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:33:26.682 INFO:tasks.workunit.client.0.smithi001.stdout: 1 15021 0.11 MB/sec execute 551 sec latency 331.667 ms 2024-05-04T02:33:27.682 INFO:tasks.workunit.client.0.smithi001.stdout: 1 15052 0.11 MB/sec execute 552 sec latency 350.123 ms 2024-05-04T02:33:28.682 INFO:tasks.workunit.client.0.smithi001.stdout: 1 15067 0.11 MB/sec execute 553 sec latency 396.754 ms 2024-05-04T02:33:29.682 INFO:tasks.workunit.client.0.smithi001.stdout: 1 15086 0.11 MB/sec execute 554 sec latency 387.882 ms 2024-05-04T02:33:30.682 INFO:tasks.workunit.client.0.smithi001.stdout: 1 15109 0.11 MB/sec execute 555 sec latency 346.410 ms 2024-05-04T02:33:31.682 INFO:tasks.workunit.client.0.smithi001.stdout: 1 15134 0.11 MB/sec execute 556 sec latency 330.220 ms 2024-05-04T02:33:32.682 INFO:tasks.workunit.client.0.smithi001.stdout: 1 15139 0.11 MB/sec execute 557 sec latency 349.445 ms 2024-05-04T02:33:33.682 INFO:tasks.workunit.client.0.smithi001.stdout: 1 15162 0.11 MB/sec execute 558 sec latency 333.054 ms 2024-05-04T02:33:34.682 INFO:tasks.workunit.client.0.smithi001.stdout: 1 15195 0.11 MB/sec execute 559 sec latency 243.839 ms 2024-05-04T02:33:35.685 INFO:tasks.workunit.client.0.smithi001.stdout: 1 15232 0.11 MB/sec execute 560 sec latency 550.832 ms 2024-05-04T02:33:36.684 INFO:tasks.workunit.client.0.smithi001.stdout: 1 15245 0.11 MB/sec execute 561 sec latency 356.024 ms 2024-05-04T02:33:37.682 INFO:tasks.workunit.client.0.smithi001.stdout: 1 15252 0.11 MB/sec execute 562 sec latency 357.448 ms 2024-05-04T02:33:38.683 INFO:tasks.workunit.client.0.smithi001.stdout: 1 15285 0.11 MB/sec execute 563 sec latency 321.626 ms 2024-05-04T02:33:39.683 INFO:tasks.workunit.client.0.smithi001.stdout: 1 15304 0.11 MB/sec execute 564 sec latency 329.671 ms 2024-05-04T02:33:40.683 INFO:tasks.workunit.client.0.smithi001.stdout: 1 15321 0.11 MB/sec execute 565 sec latency 369.670 ms 2024-05-04T02:33:41.683 INFO:tasks.workunit.client.0.smithi001.stdout: 1 15360 0.11 MB/sec execute 566 sec latency 210.707 ms 2024-05-04T02:33:42.683 INFO:tasks.workunit.client.0.smithi001.stdout: 1 15371 0.11 MB/sec execute 567 sec latency 368.023 ms 2024-05-04T02:33:43.683 INFO:tasks.workunit.client.0.smithi001.stdout: 1 15378 0.11 MB/sec execute 568 sec latency 324.061 ms 2024-05-04T02:33:44.683 INFO:tasks.workunit.client.0.smithi001.stdout: 1 15406 0.11 MB/sec execute 569 sec latency 194.831 ms 2024-05-04T02:33:45.683 INFO:tasks.workunit.client.0.smithi001.stdout: 1 15427 0.11 MB/sec execute 570 sec latency 561.916 ms 2024-05-04T02:33:46.683 INFO:tasks.workunit.client.0.smithi001.stdout: 1 15451 0.11 MB/sec execute 571 sec latency 321.424 ms 2024-05-04T02:33:47.683 INFO:tasks.workunit.client.0.smithi001.stdout: 1 15480 0.11 MB/sec execute 572 sec latency 358.477 ms 2024-05-04T02:33:48.683 INFO:tasks.workunit.client.0.smithi001.stdout: 1 15486 0.11 MB/sec execute 573 sec latency 348.947 ms 2024-05-04T02:33:49.683 INFO:tasks.workunit.client.0.smithi001.stdout: 1 15579 0.12 MB/sec execute 574 sec latency 357.617 ms 2024-05-04T02:33:50.683 INFO:tasks.workunit.client.0.smithi001.stdout: 1 15587 0.12 MB/sec execute 575 sec latency 356.133 ms 2024-05-04T02:33:51.683 INFO:tasks.workunit.client.0.smithi001.stdout: 1 15605 0.12 MB/sec execute 576 sec latency 369.052 ms 2024-05-04T02:33:52.683 INFO:tasks.workunit.client.0.smithi001.stdout: 1 15628 0.12 MB/sec execute 577 sec latency 314.943 ms 2024-05-04T02:33:53.683 INFO:tasks.workunit.client.0.smithi001.stdout: 1 15650 0.12 MB/sec execute 578 sec latency 297.227 ms 2024-05-04T02:33:54.683 INFO:tasks.workunit.client.0.smithi001.stdout: 1 15673 0.12 MB/sec execute 579 sec latency 379.767 ms 2024-05-04T02:33:55.683 INFO:tasks.workunit.client.0.smithi001.stdout: 1 15691 0.12 MB/sec execute 580 sec latency 352.262 ms 2024-05-04T02:33:55.871 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:33:55.874 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:33:56.683 INFO:tasks.workunit.client.0.smithi001.stdout: 1 15714 0.12 MB/sec execute 581 sec latency 349.017 ms 2024-05-04T02:33:57.684 INFO:tasks.workunit.client.0.smithi001.stdout: 1 15732 0.12 MB/sec execute 582 sec latency 362.886 ms 2024-05-04T02:33:58.683 INFO:tasks.workunit.client.0.smithi001.stdout: 1 15756 0.12 MB/sec execute 583 sec latency 354.917 ms 2024-05-04T02:33:59.684 INFO:tasks.workunit.client.0.smithi001.stdout: 1 15785 0.12 MB/sec execute 584 sec latency 402.356 ms 2024-05-04T02:34:00.684 INFO:tasks.workunit.client.0.smithi001.stdout: 1 15807 0.12 MB/sec execute 585 sec latency 324.652 ms 2024-05-04T02:34:01.684 INFO:tasks.workunit.client.0.smithi001.stdout: 1 15817 0.11 MB/sec execute 586 sec latency 347.717 ms 2024-05-04T02:34:02.684 INFO:tasks.workunit.client.0.smithi001.stdout: 1 15842 0.11 MB/sec execute 587 sec latency 352.599 ms 2024-05-04T02:34:03.684 INFO:tasks.workunit.client.0.smithi001.stdout: 1 15854 0.11 MB/sec execute 588 sec latency 363.888 ms 2024-05-04T02:34:04.684 INFO:tasks.workunit.client.0.smithi001.stdout: 1 15890 0.11 MB/sec execute 589 sec latency 343.390 ms 2024-05-04T02:34:05.684 INFO:tasks.workunit.client.0.smithi001.stdout: 1 15907 0.11 MB/sec execute 590 sec latency 371.780 ms 2024-05-04T02:34:06.684 INFO:tasks.workunit.client.0.smithi001.stdout: 1 15970 0.11 MB/sec execute 591 sec latency 354.878 ms 2024-05-04T02:34:07.684 INFO:tasks.workunit.client.0.smithi001.stdout: 1 16002 0.11 MB/sec execute 592 sec latency 347.509 ms 2024-05-04T02:34:08.684 INFO:tasks.workunit.client.0.smithi001.stdout: 1 16022 0.11 MB/sec execute 593 sec latency 354.239 ms 2024-05-04T02:34:09.684 INFO:tasks.workunit.client.0.smithi001.stdout: 1 16035 0.11 MB/sec execute 594 sec latency 350.756 ms 2024-05-04T02:34:10.684 INFO:tasks.workunit.client.0.smithi001.stdout: 1 16058 0.11 MB/sec execute 595 sec latency 328.072 ms 2024-05-04T02:34:11.684 INFO:tasks.workunit.client.0.smithi001.stdout: 1 16068 0.11 MB/sec execute 596 sec latency 358.819 ms 2024-05-04T02:34:12.684 INFO:tasks.workunit.client.0.smithi001.stdout: 1 16099 0.11 MB/sec execute 597 sec latency 332.386 ms 2024-05-04T02:34:13.684 INFO:tasks.workunit.client.0.smithi001.stdout: 1 16113 0.11 MB/sec execute 598 sec latency 360.630 ms 2024-05-04T02:34:14.684 INFO:tasks.workunit.client.0.smithi001.stdout: 1 16155 0.11 MB/sec execute 599 sec latency 362.323 ms 2024-05-04T02:34:15.684 INFO:tasks.workunit.client.0.smithi001.stdout: 1 cleanup 600 sec 2024-05-04T02:34:16.684 INFO:tasks.workunit.client.0.smithi001.stdout: 1 cleanup 601 sec 2024-05-04T02:34:17.684 INFO:tasks.workunit.client.0.smithi001.stdout: 1 cleanup 602 sec 2024-05-04T02:34:18.684 INFO:tasks.workunit.client.0.smithi001.stdout: 1 cleanup 603 sec 2024-05-04T02:34:19.684 INFO:tasks.workunit.client.0.smithi001.stdout: 1 cleanup 604 sec 2024-05-04T02:34:20.684 INFO:tasks.workunit.client.0.smithi001.stdout: 1 cleanup 605 sec 2024-05-04T02:34:21.684 INFO:tasks.workunit.client.0.smithi001.stdout: 1 cleanup 606 sec 2024-05-04T02:34:22.685 INFO:tasks.workunit.client.0.smithi001.stdout: 1 cleanup 607 sec 2024-05-04T02:34:23.684 INFO:tasks.workunit.client.0.smithi001.stdout: 1 cleanup 608 sec 2024-05-04T02:34:24.203 INFO:tasks.workunit.client.0.smithi001.stdout: 0 cleanup 609 sec 2024-05-04T02:34:24.203 INFO:tasks.workunit.client.0.smithi001.stdout: 2024-05-04T02:34:24.203 INFO:tasks.workunit.client.0.smithi001.stdout: Operation Count AvgLat MaxLat 2024-05-04T02:34:24.203 INFO:tasks.workunit.client.0.smithi001.stdout: ---------------------------------------- 2024-05-04T02:34:24.203 INFO:tasks.workunit.client.0.smithi001.stdout: NTCreateX 2292 71.891 400.112 2024-05-04T02:34:24.203 INFO:tasks.workunit.client.0.smithi001.stdout: Close 1678 1.319 15.315 2024-05-04T02:34:24.203 INFO:tasks.workunit.client.0.smithi001.stdout: Rename 93 200.608 572.295 2024-05-04T02:34:24.203 INFO:tasks.workunit.client.0.smithi001.stdout: Unlink 474 83.636 683.553 2024-05-04T02:34:24.203 INFO:tasks.workunit.client.0.smithi001.stdout: Qpathinfo 2060 38.180 612.301 2024-05-04T02:34:24.203 INFO:tasks.workunit.client.0.smithi001.stdout: Qfileinfo 342 1.057 1.667 2024-05-04T02:34:24.204 INFO:tasks.workunit.client.0.smithi001.stdout: Qfsinfo 376 11.172 148.875 2024-05-04T02:34:24.204 INFO:tasks.workunit.client.0.smithi001.stdout: Sfileinfo 184 12.953 22.489 2024-05-04T02:34:24.204 INFO:tasks.workunit.client.0.smithi001.stdout: Find 795 346.139 808.674 2024-05-04T02:34:24.204 INFO:tasks.workunit.client.0.smithi001.stdout: WriteX 1082 4.431 138.708 2024-05-04T02:34:24.204 INFO:tasks.workunit.client.0.smithi001.stdout: ReadX 3341 0.030 2.635 2024-05-04T02:34:24.204 INFO:tasks.workunit.client.0.smithi001.stdout: LockX 6 17.460 20.220 2024-05-04T02:34:24.204 INFO:tasks.workunit.client.0.smithi001.stdout: UnlockX 6 15.772 18.472 2024-05-04T02:34:24.204 INFO:tasks.workunit.client.0.smithi001.stdout: Flush 163 55.362 194.014 2024-05-04T02:34:24.204 INFO:tasks.workunit.client.0.smithi001.stdout: 2024-05-04T02:34:24.204 INFO:tasks.workunit.client.0.smithi001.stdout:Throughput 0.112829 MB/sec 1 clients 1 procs max_latency=808.679 ms 2024-05-04T02:34:24.205 INFO:tasks.workunit.client.0.smithi001.stderr:+ dbench 10 2024-05-04T02:34:24.205 INFO:tasks.workunit.client.0.smithi001.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2024-05-04T02:34:24.205 INFO:tasks.workunit.client.0.smithi001.stdout: 2024-05-04T02:34:24.205 INFO:tasks.workunit.client.0.smithi001.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2024-05-04T02:34:24.205 INFO:tasks.workunit.client.0.smithi001.stdout:8 of 10 processes prepared for launch 0 sec 2024-05-04T02:34:24.304 INFO:tasks.workunit.client.0.smithi001.stdout:10 of 10 processes prepared for launch 0 sec 2024-05-04T02:34:24.304 INFO:tasks.workunit.client.0.smithi001.stdout:releasing clients 2024-05-04T02:34:25.304 INFO:tasks.workunit.client.0.smithi001.stdout: 0 2 0.00 MB/sec warmup 1 sec latency 999.848 ms 2024-05-04T02:34:25.948 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:34:25.950 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:34:26.304 INFO:tasks.workunit.client.0.smithi001.stdout: 1 5 0.43 MB/sec warmup 2 sec latency 1999.894 ms 2024-05-04T02:34:27.304 INFO:tasks.workunit.client.0.smithi001.stdout: 2 11 0.90 MB/sec warmup 3 sec latency 2491.695 ms 2024-05-04T02:34:28.304 INFO:tasks.workunit.client.0.smithi001.stdout: 3 20 1.41 MB/sec warmup 4 sec latency 533.375 ms 2024-05-04T02:34:29.304 INFO:tasks.workunit.client.0.smithi001.stdout: 5 32 2.28 MB/sec warmup 5 sec latency 772.047 ms 2024-05-04T02:34:30.304 INFO:tasks.workunit.client.0.smithi001.stdout: 10 49 3.33 MB/sec warmup 6 sec latency 905.848 ms 2024-05-04T02:34:31.304 INFO:tasks.workunit.client.0.smithi001.stdout: 10 63 3.86 MB/sec warmup 7 sec latency 835.247 ms 2024-05-04T02:34:32.304 INFO:tasks.workunit.client.0.smithi001.stdout: 10 77 4.32 MB/sec warmup 8 sec latency 817.071 ms 2024-05-04T02:34:33.304 INFO:tasks.workunit.client.0.smithi001.stdout: 10 91 4.62 MB/sec warmup 9 sec latency 884.131 ms 2024-05-04T02:34:34.304 INFO:tasks.workunit.client.0.smithi001.stdout: 10 105 4.82 MB/sec warmup 10 sec latency 957.030 ms 2024-05-04T02:34:35.304 INFO:tasks.workunit.client.0.smithi001.stdout: 10 116 4.88 MB/sec warmup 11 sec latency 1057.813 ms 2024-05-04T02:34:36.305 INFO:tasks.workunit.client.0.smithi001.stdout: 10 120 4.56 MB/sec warmup 12 sec latency 1170.125 ms 2024-05-04T02:34:37.304 INFO:tasks.workunit.client.0.smithi001.stdout: 10 126 4.35 MB/sec warmup 13 sec latency 1301.020 ms 2024-05-04T02:34:38.305 INFO:tasks.workunit.client.0.smithi001.stdout: 10 131 4.17 MB/sec warmup 14 sec latency 1455.621 ms 2024-05-04T02:34:39.304 INFO:tasks.workunit.client.0.smithi001.stdout: 10 138 4.02 MB/sec warmup 15 sec latency 1341.262 ms 2024-05-04T02:34:40.304 INFO:tasks.workunit.client.0.smithi001.stdout: 10 141 3.83 MB/sec warmup 16 sec latency 1502.019 ms 2024-05-04T02:34:41.305 INFO:tasks.workunit.client.0.smithi001.stdout: 10 147 3.70 MB/sec warmup 17 sec latency 1589.675 ms 2024-05-04T02:34:42.305 INFO:tasks.workunit.client.0.smithi001.stdout: 10 151 3.56 MB/sec warmup 18 sec latency 1397.555 ms 2024-05-04T02:34:43.305 INFO:tasks.workunit.client.0.smithi001.stdout: 10 159 3.50 MB/sec warmup 19 sec latency 1291.817 ms 2024-05-04T02:34:44.305 INFO:tasks.workunit.client.0.smithi001.stdout: 10 164 3.40 MB/sec warmup 20 sec latency 1426.034 ms 2024-05-04T02:34:45.305 INFO:tasks.workunit.client.0.smithi001.stdout: 10 166 3.26 MB/sec warmup 21 sec latency 1856.875 ms 2024-05-04T02:34:46.305 INFO:tasks.workunit.client.0.smithi001.stdout: 10 171 3.19 MB/sec warmup 22 sec latency 1926.715 ms 2024-05-04T02:34:47.305 INFO:tasks.workunit.client.0.smithi001.stdout: 10 176 3.12 MB/sec warmup 23 sec latency 1633.249 ms 2024-05-04T02:34:48.305 INFO:tasks.workunit.client.0.smithi001.stdout: 10 182 3.06 MB/sec warmup 24 sec latency 1469.238 ms 2024-05-04T02:34:49.305 INFO:tasks.workunit.client.0.smithi001.stdout: 10 188 3.01 MB/sec warmup 25 sec latency 1548.782 ms 2024-05-04T02:34:50.305 INFO:tasks.workunit.client.0.smithi001.stdout: 10 193 2.97 MB/sec warmup 26 sec latency 1368.278 ms 2024-05-04T02:34:51.305 INFO:tasks.workunit.client.0.smithi001.stdout: 10 199 2.92 MB/sec warmup 27 sec latency 1717.881 ms 2024-05-04T02:34:52.305 INFO:tasks.workunit.client.0.smithi001.stdout: 10 204 2.87 MB/sec warmup 28 sec latency 1384.717 ms 2024-05-04T02:34:53.305 INFO:tasks.workunit.client.0.smithi001.stdout: 10 207 2.80 MB/sec warmup 29 sec latency 1689.720 ms 2024-05-04T02:34:54.305 INFO:tasks.workunit.client.0.smithi001.stdout: 10 213 2.77 MB/sec warmup 30 sec latency 1690.913 ms 2024-05-04T02:34:55.305 INFO:tasks.workunit.client.0.smithi001.stdout: 10 219 2.75 MB/sec warmup 31 sec latency 1483.387 ms 2024-05-04T02:34:56.068 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:34:56.071 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:34:56.305 INFO:tasks.workunit.client.0.smithi001.stdout: 10 222 2.69 MB/sec warmup 32 sec latency 1634.744 ms 2024-05-04T02:34:57.305 INFO:tasks.workunit.client.0.smithi001.stdout: 10 227 2.65 MB/sec warmup 33 sec latency 2001.092 ms 2024-05-04T02:34:58.305 INFO:tasks.workunit.client.0.smithi001.stdout: 10 234 2.64 MB/sec warmup 34 sec latency 1398.570 ms 2024-05-04T02:34:59.306 INFO:tasks.workunit.client.0.smithi001.stdout: 10 240 2.63 MB/sec warmup 35 sec latency 1966.429 ms 2024-05-04T02:35:00.306 INFO:tasks.workunit.client.0.smithi001.stdout: 10 242 2.57 MB/sec warmup 36 sec latency 2058.969 ms 2024-05-04T02:35:01.306 INFO:tasks.workunit.client.0.smithi001.stdout: 10 247 2.55 MB/sec warmup 37 sec latency 2115.004 ms 2024-05-04T02:35:02.306 INFO:tasks.workunit.client.0.smithi001.stdout: 10 250 2.50 MB/sec warmup 38 sec latency 2693.141 ms 2024-05-04T02:35:03.306 INFO:tasks.workunit.client.0.smithi001.stdout: 10 256 2.49 MB/sec warmup 39 sec latency 2183.197 ms 2024-05-04T02:35:04.306 INFO:tasks.workunit.client.0.smithi001.stdout: 10 262 2.47 MB/sec warmup 40 sec latency 1818.966 ms 2024-05-04T02:35:05.306 INFO:tasks.workunit.client.0.smithi001.stdout: 10 264 2.43 MB/sec warmup 41 sec latency 2109.466 ms 2024-05-04T02:35:06.306 INFO:tasks.workunit.client.0.smithi001.stdout: 10 269 2.41 MB/sec warmup 42 sec latency 2132.417 ms 2024-05-04T02:35:07.306 INFO:tasks.workunit.client.0.smithi001.stdout: 10 275 2.40 MB/sec warmup 43 sec latency 2342.135 ms 2024-05-04T02:35:08.306 INFO:tasks.workunit.client.0.smithi001.stdout: 10 280 2.38 MB/sec warmup 44 sec latency 1602.137 ms 2024-05-04T02:35:09.306 INFO:tasks.workunit.client.0.smithi001.stdout: 10 285 2.36 MB/sec warmup 45 sec latency 1818.685 ms 2024-05-04T02:35:10.306 INFO:tasks.workunit.client.0.smithi001.stdout: 10 290 2.34 MB/sec warmup 46 sec latency 1812.597 ms 2024-05-04T02:35:11.306 INFO:tasks.workunit.client.0.smithi001.stdout: 10 293 2.31 MB/sec warmup 47 sec latency 2572.070 ms 2024-05-04T02:35:12.306 INFO:tasks.workunit.client.0.smithi001.stdout: 10 299 2.30 MB/sec warmup 48 sec latency 2779.330 ms 2024-05-04T02:35:13.306 INFO:tasks.workunit.client.0.smithi001.stdout: 10 301 2.26 MB/sec warmup 49 sec latency 1556.598 ms 2024-05-04T02:35:14.306 INFO:tasks.workunit.client.0.smithi001.stdout: 10 306 2.25 MB/sec warmup 50 sec latency 1573.622 ms 2024-05-04T02:35:15.306 INFO:tasks.workunit.client.0.smithi001.stdout: 10 314 2.25 MB/sec warmup 51 sec latency 1374.330 ms 2024-05-04T02:35:16.306 INFO:tasks.workunit.client.0.smithi001.stdout: 10 316 2.22 MB/sec warmup 52 sec latency 1824.201 ms 2024-05-04T02:35:17.306 INFO:tasks.workunit.client.0.smithi001.stdout: 10 324 2.23 MB/sec warmup 53 sec latency 1893.294 ms 2024-05-04T02:35:18.306 INFO:tasks.workunit.client.0.smithi001.stdout: 10 327 2.20 MB/sec warmup 54 sec latency 1461.641 ms 2024-05-04T02:35:19.306 INFO:tasks.workunit.client.0.smithi001.stdout: 10 332 2.19 MB/sec warmup 55 sec latency 1679.462 ms 2024-05-04T02:35:20.307 INFO:tasks.workunit.client.0.smithi001.stdout: 10 338 2.18 MB/sec warmup 56 sec latency 1143.407 ms 2024-05-04T02:35:21.306 INFO:tasks.workunit.client.0.smithi001.stdout: 10 342 2.17 MB/sec warmup 57 sec latency 1658.933 ms 2024-05-04T02:35:22.306 INFO:tasks.workunit.client.0.smithi001.stdout: 10 347 2.16 MB/sec warmup 58 sec latency 1957.643 ms 2024-05-04T02:35:23.306 INFO:tasks.workunit.client.0.smithi001.stdout: 10 351 2.14 MB/sec warmup 59 sec latency 1639.141 ms 2024-05-04T02:35:24.307 INFO:tasks.workunit.client.0.smithi001.stdout: 10 355 2.12 MB/sec warmup 60 sec latency 1971.768 ms 2024-05-04T02:35:24.966 INFO:tasks.ceph.mon.a.smithi001.stderr:==00:00:15:58.322 35030== Warning: unimplemented fcntl command: 1036 2024-05-04T02:35:24.972 INFO:tasks.ceph.mon.a.smithi001.stderr:==00:00:15:58.329 35030== Warning: unimplemented fcntl command: 1036 2024-05-04T02:35:25.051 INFO:tasks.ceph.mon.b.smithi107.stderr:==00:00:15:58.378 34877== Warning: unimplemented fcntl command: 1036 2024-05-04T02:35:25.053 INFO:tasks.ceph.mon.c.smithi107.stderr:==00:00:15:58.381 34878== Warning: unimplemented fcntl command: 1036 2024-05-04T02:35:25.055 INFO:tasks.ceph.mon.c.smithi107.stderr:==00:00:15:58.383 34878== Warning: unimplemented fcntl command: 1036 2024-05-04T02:35:25.057 INFO:tasks.ceph.mon.b.smithi107.stderr:==00:00:15:58.385 34877== Warning: unimplemented fcntl command: 1036 2024-05-04T02:35:25.140 INFO:tasks.ceph.mon.a.smithi001.stderr:==00:00:15:58.497 35030== Warning: unimplemented fcntl command: 1036 2024-05-04T02:35:25.157 INFO:tasks.ceph.mon.c.smithi107.stderr:==00:00:15:58.485 34878== Warning: unimplemented fcntl command: 1036 2024-05-04T02:35:25.167 INFO:tasks.ceph.mon.b.smithi107.stderr:==00:00:15:58.495 34877== Warning: unimplemented fcntl command: 1036 2024-05-04T02:35:25.306 INFO:tasks.workunit.client.0.smithi001.stdout: 10 363 2.13 MB/sec warmup 61 sec latency 1981.613 ms 2024-05-04T02:35:26.173 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:35:26.176 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:35:26.307 INFO:tasks.workunit.client.0.smithi001.stdout: 10 365 2.11 MB/sec warmup 62 sec latency 1450.365 ms 2024-05-04T02:35:27.307 INFO:tasks.workunit.client.0.smithi001.stdout: 10 371 2.10 MB/sec warmup 63 sec latency 1768.345 ms 2024-05-04T02:35:28.307 INFO:tasks.workunit.client.0.smithi001.stdout: 10 376 2.10 MB/sec warmup 64 sec latency 1556.723 ms 2024-05-04T02:35:29.307 INFO:tasks.workunit.client.0.smithi001.stdout: 10 381 2.09 MB/sec warmup 65 sec latency 1560.304 ms 2024-05-04T02:35:30.307 INFO:tasks.workunit.client.0.smithi001.stdout: 10 387 2.09 MB/sec warmup 66 sec latency 1923.637 ms 2024-05-04T02:35:31.307 INFO:tasks.workunit.client.0.smithi001.stdout: 10 391 2.08 MB/sec warmup 67 sec latency 2032.556 ms 2024-05-04T02:35:32.307 INFO:tasks.workunit.client.0.smithi001.stdout: 10 396 2.07 MB/sec warmup 68 sec latency 1958.316 ms 2024-05-04T02:35:33.307 INFO:tasks.workunit.client.0.smithi001.stdout: 10 399 2.05 MB/sec warmup 69 sec latency 2500.718 ms 2024-05-04T02:35:34.307 INFO:tasks.workunit.client.0.smithi001.stdout: 10 405 2.05 MB/sec warmup 70 sec latency 1838.088 ms 2024-05-04T02:35:35.307 INFO:tasks.workunit.client.0.smithi001.stdout: 10 410 2.05 MB/sec warmup 71 sec latency 1984.759 ms 2024-05-04T02:35:36.307 INFO:tasks.workunit.client.0.smithi001.stdout: 10 416 2.04 MB/sec warmup 72 sec latency 1775.330 ms 2024-05-04T02:35:37.307 INFO:tasks.workunit.client.0.smithi001.stdout: 10 419 2.03 MB/sec warmup 73 sec latency 2175.934 ms 2024-05-04T02:35:38.307 INFO:tasks.workunit.client.0.smithi001.stdout: 10 425 2.03 MB/sec warmup 74 sec latency 2116.553 ms 2024-05-04T02:35:39.307 INFO:tasks.workunit.client.0.smithi001.stdout: 10 431 2.03 MB/sec warmup 75 sec latency 1928.481 ms 2024-05-04T02:35:40.307 INFO:tasks.workunit.client.0.smithi001.stdout: 10 435 2.02 MB/sec warmup 76 sec latency 1980.947 ms 2024-05-04T02:35:41.307 INFO:tasks.workunit.client.0.smithi001.stdout: 10 439 2.01 MB/sec warmup 77 sec latency 1852.765 ms 2024-05-04T02:35:42.307 INFO:tasks.workunit.client.0.smithi001.stdout: 10 441 1.99 MB/sec warmup 78 sec latency 2657.321 ms 2024-05-04T02:35:43.308 INFO:tasks.workunit.client.0.smithi001.stdout: 10 447 1.99 MB/sec warmup 79 sec latency 2419.172 ms 2024-05-04T02:35:44.307 INFO:tasks.workunit.client.0.smithi001.stdout: 10 451 1.98 MB/sec warmup 80 sec latency 1684.451 ms 2024-05-04T02:35:45.308 INFO:tasks.workunit.client.0.smithi001.stdout: 10 457 1.98 MB/sec warmup 81 sec latency 1799.762 ms 2024-05-04T02:35:46.308 INFO:tasks.workunit.client.0.smithi001.stdout: 10 459 1.97 MB/sec warmup 82 sec latency 1920.621 ms 2024-05-04T02:35:47.308 INFO:tasks.workunit.client.0.smithi001.stdout: 10 465 1.96 MB/sec warmup 83 sec latency 2259.944 ms 2024-05-04T02:35:48.308 INFO:tasks.workunit.client.0.smithi001.stdout: 10 470 1.96 MB/sec warmup 84 sec latency 2179.328 ms 2024-05-04T02:35:49.308 INFO:tasks.workunit.client.0.smithi001.stdout: 10 474 1.95 MB/sec warmup 85 sec latency 1836.725 ms 2024-05-04T02:35:50.308 INFO:tasks.workunit.client.0.smithi001.stdout: 10 479 1.95 MB/sec warmup 86 sec latency 1993.068 ms 2024-05-04T02:35:51.308 INFO:tasks.workunit.client.0.smithi001.stdout: 10 486 1.95 MB/sec warmup 87 sec latency 2016.833 ms 2024-05-04T02:35:52.308 INFO:tasks.workunit.client.0.smithi001.stdout: 10 488 1.94 MB/sec warmup 88 sec latency 2146.549 ms 2024-05-04T02:35:53.308 INFO:tasks.workunit.client.0.smithi001.stdout: 10 491 1.93 MB/sec warmup 89 sec latency 2523.773 ms 2024-05-04T02:35:54.308 INFO:tasks.workunit.client.0.smithi001.stdout: 10 496 1.93 MB/sec warmup 90 sec latency 2928.993 ms 2024-05-04T02:35:55.308 INFO:tasks.workunit.client.0.smithi001.stdout: 10 504 1.93 MB/sec warmup 91 sec latency 2587.542 ms 2024-05-04T02:35:56.228 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:35:56.231 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:35:56.308 INFO:tasks.workunit.client.0.smithi001.stdout: 10 513 1.95 MB/sec warmup 92 sec latency 2030.087 ms 2024-05-04T02:35:57.308 INFO:tasks.workunit.client.0.smithi001.stdout: 10 515 1.93 MB/sec warmup 93 sec latency 1784.396 ms 2024-05-04T02:35:58.308 INFO:tasks.workunit.client.0.smithi001.stdout: 10 524 1.94 MB/sec warmup 94 sec latency 2713.498 ms 2024-05-04T02:35:59.308 INFO:tasks.workunit.client.0.smithi001.stdout: 10 528 1.93 MB/sec warmup 95 sec latency 3713.593 ms 2024-05-04T02:36:00.308 INFO:tasks.workunit.client.0.smithi001.stdout: 10 532 1.92 MB/sec warmup 96 sec latency 4080.467 ms 2024-05-04T02:36:01.308 INFO:tasks.workunit.client.0.smithi001.stdout: 10 538 1.92 MB/sec warmup 97 sec latency 2932.657 ms 2024-05-04T02:36:02.308 INFO:tasks.workunit.client.0.smithi001.stdout: 10 545 1.94 MB/sec warmup 98 sec latency 1652.185 ms 2024-05-04T02:36:03.308 INFO:tasks.workunit.client.0.smithi001.stdout: 10 556 1.94 MB/sec warmup 99 sec latency 1999.475 ms 2024-05-04T02:36:04.308 INFO:tasks.workunit.client.0.smithi001.stdout: 10 579 2.01 MB/sec warmup 100 sec latency 2999.501 ms 2024-05-04T02:36:05.308 INFO:tasks.workunit.client.0.smithi001.stdout: 10 595 2.04 MB/sec warmup 101 sec latency 3350.975 ms 2024-05-04T02:36:06.309 INFO:tasks.workunit.client.0.smithi001.stdout: 10 605 2.06 MB/sec warmup 102 sec latency 1882.791 ms 2024-05-04T02:36:07.309 INFO:tasks.workunit.client.0.smithi001.stdout: 10 606 2.04 MB/sec warmup 103 sec latency 2551.764 ms 2024-05-04T02:36:08.309 INFO:tasks.workunit.client.0.smithi001.stdout: 10 611 2.02 MB/sec warmup 104 sec latency 3376.883 ms 2024-05-04T02:36:09.309 INFO:tasks.workunit.client.0.smithi001.stdout: 10 615 2.00 MB/sec warmup 105 sec latency 3159.731 ms 2024-05-04T02:36:10.309 INFO:tasks.workunit.client.0.smithi001.stdout: 10 616 1.98 MB/sec warmup 106 sec latency 3095.155 ms 2024-05-04T02:36:11.309 INFO:tasks.workunit.client.0.smithi001.stdout: 10 618 1.96 MB/sec warmup 107 sec latency 3258.816 ms 2024-05-04T02:36:12.309 INFO:tasks.workunit.client.0.smithi001.stdout: 10 619 1.94 MB/sec warmup 108 sec latency 3556.481 ms 2024-05-04T02:36:13.309 INFO:tasks.workunit.client.0.smithi001.stdout: 10 620 1.93 MB/sec warmup 109 sec latency 3233.510 ms 2024-05-04T02:36:14.309 INFO:tasks.workunit.client.0.smithi001.stdout: 10 631 1.91 MB/sec warmup 110 sec latency 2993.755 ms 2024-05-04T02:36:15.309 INFO:tasks.workunit.client.0.smithi001.stdout: 10 642 1.90 MB/sec warmup 111 sec latency 2750.999 ms 2024-05-04T02:36:16.309 INFO:tasks.workunit.client.0.smithi001.stdout: 10 645 1.88 MB/sec warmup 112 sec latency 2784.857 ms 2024-05-04T02:36:17.309 INFO:tasks.workunit.client.0.smithi001.stdout: 10 646 1.86 MB/sec warmup 113 sec latency 3448.765 ms 2024-05-04T02:36:18.309 INFO:tasks.workunit.client.0.smithi001.stdout: 10 646 1.85 MB/sec warmup 114 sec latency 3429.536 ms 2024-05-04T02:36:19.309 INFO:tasks.workunit.client.0.smithi001.stdout: 10 646 1.83 MB/sec warmup 115 sec latency 3256.192 ms 2024-05-04T02:36:20.309 INFO:tasks.workunit.client.0.smithi001.stdout: 10 649 1.82 MB/sec warmup 116 sec latency 2619.538 ms 2024-05-04T02:36:21.310 INFO:tasks.workunit.client.0.smithi001.stdout: 10 654 1.80 MB/sec warmup 117 sec latency 2777.000 ms 2024-05-04T02:36:22.309 INFO:tasks.workunit.client.0.smithi001.stdout: 10 656 1.79 MB/sec warmup 118 sec latency 3461.410 ms 2024-05-04T02:36:23.310 INFO:tasks.workunit.client.0.smithi001.stdout: 10 658 1.77 MB/sec warmup 119 sec latency 2257.010 ms 2024-05-04T02:36:25.310 INFO:tasks.workunit.client.0.smithi001.stdout: 10 659 0.00 MB/sec execute 1 sec latency 3218.857 ms 2024-05-04T02:36:26.284 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:36:26.287 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:36:26.310 INFO:tasks.workunit.client.0.smithi001.stdout: 10 664 0.19 MB/sec execute 2 sec latency 2886.919 ms 2024-05-04T02:36:27.310 INFO:tasks.workunit.client.0.smithi001.stdout: 10 668 0.18 MB/sec execute 3 sec latency 2945.841 ms 2024-05-04T02:36:28.310 INFO:tasks.workunit.client.0.smithi001.stdout: 10 679 0.23 MB/sec execute 4 sec latency 3311.170 ms 2024-05-04T02:36:29.310 INFO:tasks.workunit.client.0.smithi001.stdout: 10 684 0.20 MB/sec execute 5 sec latency 1469.498 ms 2024-05-04T02:36:30.310 INFO:tasks.workunit.client.0.smithi001.stdout: 10 686 0.16 MB/sec execute 6 sec latency 2132.726 ms 2024-05-04T02:36:31.310 INFO:tasks.workunit.client.0.smithi001.stdout: 10 687 0.14 MB/sec execute 7 sec latency 2762.276 ms 2024-05-04T02:36:32.310 INFO:tasks.workunit.client.0.smithi001.stdout: 10 689 0.15 MB/sec execute 8 sec latency 3182.885 ms 2024-05-04T02:36:33.310 INFO:tasks.workunit.client.0.smithi001.stdout: 10 692 0.13 MB/sec execute 9 sec latency 3269.433 ms 2024-05-04T02:36:34.310 INFO:tasks.workunit.client.0.smithi001.stdout: 10 697 0.12 MB/sec execute 10 sec latency 2921.807 ms 2024-05-04T02:36:35.310 INFO:tasks.workunit.client.0.smithi001.stdout: 10 705 0.12 MB/sec execute 11 sec latency 2631.547 ms 2024-05-04T02:36:36.310 INFO:tasks.workunit.client.0.smithi001.stdout: 10 710 0.12 MB/sec execute 12 sec latency 2169.745 ms 2024-05-04T02:36:37.310 INFO:tasks.workunit.client.0.smithi001.stdout: 10 713 0.11 MB/sec execute 13 sec latency 2499.284 ms 2024-05-04T02:36:38.310 INFO:tasks.workunit.client.0.smithi001.stdout: 10 717 0.10 MB/sec execute 14 sec latency 3103.944 ms 2024-05-04T02:36:39.310 INFO:tasks.workunit.client.0.smithi001.stdout: 10 719 0.10 MB/sec execute 15 sec latency 2987.806 ms 2024-05-04T02:36:40.310 INFO:tasks.workunit.client.0.smithi001.stdout: 10 723 0.12 MB/sec execute 16 sec latency 3987.833 ms 2024-05-04T02:36:41.310 INFO:tasks.workunit.client.0.smithi001.stdout: 10 730 0.13 MB/sec execute 17 sec latency 4651.745 ms 2024-05-04T02:36:42.311 INFO:tasks.workunit.client.0.smithi001.stdout: 10 735 0.13 MB/sec execute 18 sec latency 4219.459 ms 2024-05-04T02:36:43.310 INFO:tasks.workunit.client.0.smithi001.stdout: 10 744 0.13 MB/sec execute 19 sec latency 1773.842 ms 2024-05-04T02:36:44.310 INFO:tasks.workunit.client.0.smithi001.stdout: 10 750 0.12 MB/sec execute 20 sec latency 2773.867 ms 2024-05-04T02:36:45.311 INFO:tasks.workunit.client.0.smithi001.stdout: 10 751 0.11 MB/sec execute 21 sec latency 3393.292 ms 2024-05-04T02:36:46.311 INFO:tasks.workunit.client.0.smithi001.stdout: 10 752 0.11 MB/sec execute 22 sec latency 2573.213 ms 2024-05-04T02:36:47.311 INFO:tasks.workunit.client.0.smithi001.stdout: 10 754 0.11 MB/sec execute 23 sec latency 3573.303 ms 2024-05-04T02:36:48.311 INFO:tasks.workunit.client.0.smithi001.stdout: 10 757 0.11 MB/sec execute 24 sec latency 4227.426 ms 2024-05-04T02:36:49.311 INFO:tasks.workunit.client.0.smithi001.stdout: 10 761 0.11 MB/sec execute 25 sec latency 3800.332 ms 2024-05-04T02:36:50.311 INFO:tasks.workunit.client.0.smithi001.stdout: 10 762 0.10 MB/sec execute 26 sec latency 2323.344 ms 2024-05-04T02:36:50.551 INFO:tasks.ceph.mon.a.smithi001.stderr:==00:00:17:23.908 35030== Warning: unimplemented fcntl command: 1036 2024-05-04T02:36:50.562 INFO:tasks.ceph.mon.a.smithi001.stderr:==00:00:17:23.919 35030== Warning: unimplemented fcntl command: 1036 2024-05-04T02:36:50.605 INFO:tasks.ceph.mon.a.smithi001.stderr:==00:00:17:23.962 35030== Warning: unimplemented fcntl command: 1036 2024-05-04T02:36:50.635 INFO:tasks.ceph.mon.b.smithi107.stderr:==00:00:17:23.963 34877== Warning: unimplemented fcntl command: 1036 2024-05-04T02:36:50.637 INFO:tasks.ceph.mon.c.smithi107.stderr:==00:00:17:23.965 34878== Warning: unimplemented fcntl command: 1036 2024-05-04T02:36:50.644 INFO:tasks.ceph.mon.b.smithi107.stderr:==00:00:17:23.972 34877== Warning: unimplemented fcntl command: 1036 2024-05-04T02:36:50.648 INFO:tasks.ceph.mon.c.smithi107.stderr:==00:00:17:23.976 34878== Warning: unimplemented fcntl command: 1036 2024-05-04T02:36:50.684 INFO:tasks.ceph.mon.b.smithi107.stderr:==00:00:17:24.012 34877== Warning: unimplemented fcntl command: 1036 2024-05-04T02:36:50.687 INFO:tasks.ceph.mon.c.smithi107.stderr:==00:00:17:24.015 34878== Warning: unimplemented fcntl command: 1036 2024-05-04T02:36:51.311 INFO:tasks.workunit.client.0.smithi001.stdout: 10 763 0.10 MB/sec execute 27 sec latency 2946.561 ms 2024-05-04T02:36:52.311 INFO:tasks.workunit.client.0.smithi001.stdout: 10 778 0.11 MB/sec execute 28 sec latency 2866.506 ms 2024-05-04T02:36:53.311 INFO:tasks.workunit.client.0.smithi001.stdout: 10 781 0.11 MB/sec execute 29 sec latency 1546.338 ms 2024-05-04T02:36:54.311 INFO:tasks.workunit.client.0.smithi001.stdout: 10 787 0.10 MB/sec execute 30 sec latency 1882.204 ms 2024-05-04T02:36:55.311 INFO:tasks.workunit.client.0.smithi001.stdout: 10 789 0.10 MB/sec execute 31 sec latency 1661.872 ms 2024-05-04T02:36:56.311 INFO:tasks.workunit.client.0.smithi001.stdout: 10 790 0.10 MB/sec execute 32 sec latency 2661.987 ms 2024-05-04T02:36:56.428 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:36:56.431 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:36:57.311 INFO:tasks.workunit.client.0.smithi001.stdout: 10 792 0.10 MB/sec execute 33 sec latency 3572.641 ms 2024-05-04T02:36:58.313 INFO:tasks.workunit.client.0.smithi001.stdout: 10 799 0.11 MB/sec execute 34 sec latency 3243.583 ms 2024-05-04T02:36:59.312 INFO:tasks.workunit.client.0.smithi001.stdout: 10 806 0.11 MB/sec execute 35 sec latency 3267.364 ms 2024-05-04T02:37:00.312 INFO:tasks.workunit.client.0.smithi001.stdout: 10 815 0.11 MB/sec execute 36 sec latency 2726.571 ms 2024-05-04T02:37:01.312 INFO:tasks.workunit.client.0.smithi001.stdout: 10 820 0.11 MB/sec execute 37 sec latency 2408.501 ms 2024-05-04T02:37:02.312 INFO:tasks.workunit.client.0.smithi001.stdout: 10 820 0.11 MB/sec execute 38 sec latency 2750.048 ms 2024-05-04T02:37:03.312 INFO:tasks.workunit.client.0.smithi001.stdout: 10 820 0.11 MB/sec execute 39 sec latency 3317.223 ms 2024-05-04T02:37:04.312 INFO:tasks.workunit.client.0.smithi001.stdout: 10 821 0.10 MB/sec execute 40 sec latency 3340.522 ms 2024-05-04T02:37:05.312 INFO:tasks.workunit.client.0.smithi001.stdout: 10 822 0.10 MB/sec execute 41 sec latency 2788.497 ms 2024-05-04T02:37:06.312 INFO:tasks.workunit.client.0.smithi001.stdout: 10 823 0.10 MB/sec execute 42 sec latency 2575.872 ms 2024-05-04T02:37:07.312 INFO:tasks.workunit.client.0.smithi001.stdout: 10 825 0.10 MB/sec execute 43 sec latency 2830.730 ms 2024-05-04T02:37:08.312 INFO:tasks.workunit.client.0.smithi001.stdout: 10 830 0.10 MB/sec execute 44 sec latency 2007.797 ms 2024-05-04T02:37:09.312 INFO:tasks.workunit.client.0.smithi001.stdout: 10 830 0.09 MB/sec execute 45 sec latency 3007.821 ms 2024-05-04T02:37:10.312 INFO:tasks.workunit.client.0.smithi001.stdout: 10 833 0.09 MB/sec execute 46 sec latency 3037.070 ms 2024-05-04T02:37:11.312 INFO:tasks.workunit.client.0.smithi001.stdout: 10 835 0.09 MB/sec execute 47 sec latency 2167.216 ms 2024-05-04T02:37:12.312 INFO:tasks.workunit.client.0.smithi001.stdout: 10 845 0.10 MB/sec execute 48 sec latency 2227.933 ms 2024-05-04T02:37:13.312 INFO:tasks.workunit.client.0.smithi001.stdout: 10 859 0.10 MB/sec execute 49 sec latency 2430.212 ms 2024-05-04T02:37:14.312 INFO:tasks.workunit.client.0.smithi001.stdout: 10 859 0.10 MB/sec execute 50 sec latency 2502.128 ms 2024-05-04T02:37:15.312 INFO:tasks.workunit.client.0.smithi001.stdout: 10 860 0.10 MB/sec execute 51 sec latency 2905.008 ms 2024-05-04T02:37:16.312 INFO:tasks.workunit.client.0.smithi001.stdout: 10 863 0.10 MB/sec execute 52 sec latency 2826.462 ms 2024-05-04T02:37:17.312 INFO:tasks.workunit.client.0.smithi001.stdout: 10 864 0.10 MB/sec execute 53 sec latency 2988.462 ms 2024-05-04T02:37:18.312 INFO:tasks.workunit.client.0.smithi001.stdout: 10 866 0.10 MB/sec execute 54 sec latency 3225.962 ms 2024-05-04T02:37:19.312 INFO:tasks.workunit.client.0.smithi001.stdout: 10 871 0.10 MB/sec execute 55 sec latency 3402.572 ms 2024-05-04T02:37:20.313 INFO:tasks.workunit.client.0.smithi001.stdout: 10 875 0.10 MB/sec execute 56 sec latency 1519.133 ms 2024-05-04T02:37:21.313 INFO:tasks.workunit.client.0.smithi001.stdout: 10 876 0.09 MB/sec execute 57 sec latency 2519.230 ms 2024-05-04T02:37:22.313 INFO:tasks.workunit.client.0.smithi001.stdout: 10 876 0.09 MB/sec execute 58 sec latency 3519.299 ms 2024-05-04T02:37:23.313 INFO:tasks.workunit.client.0.smithi001.stdout: 10 878 0.09 MB/sec execute 59 sec latency 3878.381 ms 2024-05-04T02:37:24.313 INFO:tasks.workunit.client.0.smithi001.stdout: 10 880 0.09 MB/sec execute 60 sec latency 3487.175 ms 2024-05-04T02:37:25.313 INFO:tasks.workunit.client.0.smithi001.stdout: 10 886 0.10 MB/sec execute 61 sec latency 3189.852 ms 2024-05-04T02:37:26.313 INFO:tasks.workunit.client.0.smithi001.stdout: 10 891 0.10 MB/sec execute 62 sec latency 3057.358 ms 2024-05-04T02:37:26.480 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:37:26.483 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:37:27.313 INFO:tasks.workunit.client.0.smithi001.stdout: 10 893 0.10 MB/sec execute 63 sec latency 3151.359 ms 2024-05-04T02:37:28.313 INFO:tasks.workunit.client.0.smithi001.stdout: 10 894 0.10 MB/sec execute 64 sec latency 3717.058 ms 2024-05-04T02:37:29.313 INFO:tasks.workunit.client.0.smithi001.stdout: 10 901 0.10 MB/sec execute 65 sec latency 2972.907 ms 2024-05-04T02:37:30.313 INFO:tasks.workunit.client.0.smithi001.stdout: 10 905 0.09 MB/sec execute 66 sec latency 1222.305 ms 2024-05-04T02:37:31.313 INFO:tasks.workunit.client.0.smithi001.stdout: 10 909 0.09 MB/sec execute 67 sec latency 2166.674 ms 2024-05-04T02:37:32.313 INFO:tasks.workunit.client.0.smithi001.stdout: 10 910 0.09 MB/sec execute 68 sec latency 3166.732 ms 2024-05-04T02:37:33.313 INFO:tasks.workunit.client.0.smithi001.stdout: 10 911 0.09 MB/sec execute 69 sec latency 4155.610 ms 2024-05-04T02:37:34.313 INFO:tasks.workunit.client.0.smithi001.stdout: 10 915 0.09 MB/sec execute 70 sec latency 4145.663 ms 2024-05-04T02:37:35.313 INFO:tasks.workunit.client.0.smithi001.stdout: 10 923 0.10 MB/sec execute 71 sec latency 4061.067 ms 2024-05-04T02:37:36.313 INFO:tasks.workunit.client.0.smithi001.stdout: 10 927 0.10 MB/sec execute 72 sec latency 1448.614 ms 2024-05-04T02:37:37.313 INFO:tasks.workunit.client.0.smithi001.stdout: 10 929 0.09 MB/sec execute 73 sec latency 2448.674 ms 2024-05-04T02:37:38.313 INFO:tasks.workunit.client.0.smithi001.stdout: 10 929 0.09 MB/sec execute 74 sec latency 3059.905 ms 2024-05-04T02:37:39.313 INFO:tasks.workunit.client.0.smithi001.stdout: 10 930 0.09 MB/sec execute 75 sec latency 3390.608 ms 2024-05-04T02:37:40.313 INFO:tasks.workunit.client.0.smithi001.stdout: 10 931 0.09 MB/sec execute 76 sec latency 3207.239 ms 2024-05-04T02:37:41.313 INFO:tasks.workunit.client.0.smithi001.stdout: 10 934 0.09 MB/sec execute 77 sec latency 2480.389 ms 2024-05-04T02:37:42.314 INFO:tasks.workunit.client.0.smithi001.stdout: 10 936 0.09 MB/sec execute 78 sec latency 2908.787 ms 2024-05-04T02:37:43.314 INFO:tasks.workunit.client.0.smithi001.stdout: 10 938 0.09 MB/sec execute 79 sec latency 3318.046 ms 2024-05-04T02:37:44.314 INFO:tasks.workunit.client.0.smithi001.stdout: 10 940 0.09 MB/sec execute 80 sec latency 1699.055 ms 2024-05-04T02:37:45.314 INFO:tasks.workunit.client.0.smithi001.stdout: 10 943 0.09 MB/sec execute 81 sec latency 2058.534 ms 2024-05-04T02:37:46.314 INFO:tasks.workunit.client.0.smithi001.stdout: 10 946 0.09 MB/sec execute 82 sec latency 2669.929 ms 2024-05-04T02:37:47.314 INFO:tasks.workunit.client.0.smithi001.stdout: 10 947 0.09 MB/sec execute 83 sec latency 2196.562 ms 2024-05-04T02:37:48.314 INFO:tasks.workunit.client.0.smithi001.stdout: 10 948 0.09 MB/sec execute 84 sec latency 2932.087 ms 2024-05-04T02:37:49.314 INFO:tasks.workunit.client.0.smithi001.stdout: 10 955 0.10 MB/sec execute 85 sec latency 3102.144 ms 2024-05-04T02:37:50.314 INFO:tasks.workunit.client.0.smithi001.stdout: 10 960 0.11 MB/sec execute 86 sec latency 1268.141 ms 2024-05-04T02:37:51.314 INFO:tasks.workunit.client.0.smithi001.stdout: 10 960 0.11 MB/sec execute 87 sec latency 2268.198 ms 2024-05-04T02:37:52.314 INFO:tasks.workunit.client.0.smithi001.stdout: 10 961 0.10 MB/sec execute 88 sec latency 2540.397 ms 2024-05-04T02:37:53.314 INFO:tasks.workunit.client.0.smithi001.stdout: 10 965 0.11 MB/sec execute 89 sec latency 2810.112 ms 2024-05-04T02:37:54.314 INFO:tasks.workunit.client.0.smithi001.stdout: 10 969 0.11 MB/sec execute 90 sec latency 2394.007 ms 2024-05-04T02:37:55.314 INFO:tasks.workunit.client.0.smithi001.stdout: 10 973 0.11 MB/sec execute 91 sec latency 2520.660 ms 2024-05-04T02:37:56.314 INFO:tasks.workunit.client.0.smithi001.stdout: 10 981 0.11 MB/sec execute 92 sec latency 3018.550 ms 2024-05-04T02:37:56.552 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:37:56.554 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:37:57.315 INFO:tasks.workunit.client.0.smithi001.stdout: 10 986 0.11 MB/sec execute 93 sec latency 2697.195 ms 2024-05-04T02:37:58.315 INFO:tasks.workunit.client.0.smithi001.stdout: 10 991 0.11 MB/sec execute 94 sec latency 1692.723 ms 2024-05-04T02:37:59.315 INFO:tasks.workunit.client.0.smithi001.stdout: 10 994 0.11 MB/sec execute 95 sec latency 2692.824 ms 2024-05-04T02:38:00.315 INFO:tasks.workunit.client.0.smithi001.stdout: 10 996 0.11 MB/sec execute 96 sec latency 3692.926 ms 2024-05-04T02:38:01.315 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1001 0.11 MB/sec execute 97 sec latency 4195.658 ms 2024-05-04T02:38:02.315 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1006 0.11 MB/sec execute 98 sec latency 3832.071 ms 2024-05-04T02:38:03.315 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1009 0.11 MB/sec execute 99 sec latency 3295.502 ms 2024-05-04T02:38:04.315 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1010 0.11 MB/sec execute 100 sec latency 4071.760 ms 2024-05-04T02:38:05.315 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1016 0.13 MB/sec execute 101 sec latency 3930.012 ms 2024-05-04T02:38:06.315 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1017 0.13 MB/sec execute 102 sec latency 3828.904 ms 2024-05-04T02:38:07.315 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1027 0.15 MB/sec execute 103 sec latency 3475.517 ms 2024-05-04T02:38:08.315 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1034 0.17 MB/sec execute 104 sec latency 2615.918 ms 2024-05-04T02:38:09.315 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1037 0.17 MB/sec execute 105 sec latency 2544.705 ms 2024-05-04T02:38:10.315 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1037 0.17 MB/sec execute 106 sec latency 2606.661 ms 2024-05-04T02:38:11.315 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1041 0.17 MB/sec execute 107 sec latency 2902.298 ms 2024-05-04T02:38:12.315 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1045 0.17 MB/sec execute 108 sec latency 3018.415 ms 2024-05-04T02:38:13.316 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1046 0.17 MB/sec execute 109 sec latency 2386.118 ms 2024-05-04T02:38:14.316 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1049 0.16 MB/sec execute 110 sec latency 3386.215 ms 2024-05-04T02:38:15.316 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1050 0.16 MB/sec execute 111 sec latency 3405.449 ms 2024-05-04T02:38:16.316 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1055 0.16 MB/sec execute 112 sec latency 3732.454 ms 2024-05-04T02:38:17.316 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1059 0.16 MB/sec execute 113 sec latency 3227.158 ms 2024-05-04T02:38:18.316 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1061 0.16 MB/sec execute 114 sec latency 3384.820 ms 2024-05-04T02:38:19.318 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1061 0.16 MB/sec execute 115 sec latency 2894.265 ms 2024-05-04T02:38:20.316 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1063 0.16 MB/sec execute 116 sec latency 3198.478 ms 2024-05-04T02:38:21.316 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1065 0.16 MB/sec execute 117 sec latency 2787.161 ms 2024-05-04T02:38:22.316 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1066 0.15 MB/sec execute 118 sec latency 2887.655 ms 2024-05-04T02:38:23.316 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1066 0.15 MB/sec execute 119 sec latency 3271.634 ms 2024-05-04T02:38:24.316 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1067 0.15 MB/sec execute 120 sec latency 3295.917 ms 2024-05-04T02:38:25.316 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1071 0.15 MB/sec execute 121 sec latency 3102.723 ms 2024-05-04T02:38:26.316 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1076 0.15 MB/sec execute 122 sec latency 2546.142 ms 2024-05-04T02:38:26.608 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:38:26.611 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:38:27.316 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1081 0.15 MB/sec execute 123 sec latency 1131.845 ms 2024-05-04T02:38:28.316 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1086 0.15 MB/sec execute 124 sec latency 2131.896 ms 2024-05-04T02:38:29.316 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1090 0.15 MB/sec execute 125 sec latency 2846.679 ms 2024-05-04T02:38:30.316 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1093 0.15 MB/sec execute 126 sec latency 1064.886 ms 2024-05-04T02:38:31.316 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1102 0.15 MB/sec execute 127 sec latency 1992.230 ms 2024-05-04T02:38:32.317 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1105 0.15 MB/sec execute 128 sec latency 2992.277 ms 2024-05-04T02:38:33.317 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1106 0.14 MB/sec execute 129 sec latency 3992.368 ms 2024-05-04T02:38:34.317 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1108 0.14 MB/sec execute 130 sec latency 4461.862 ms 2024-05-04T02:38:35.317 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1111 0.14 MB/sec execute 131 sec latency 4033.987 ms 2024-05-04T02:38:36.317 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1113 0.14 MB/sec execute 132 sec latency 4602.568 ms 2024-05-04T02:38:37.317 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1117 0.14 MB/sec execute 133 sec latency 3611.530 ms 2024-05-04T02:38:38.317 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1119 0.14 MB/sec execute 134 sec latency 3215.872 ms 2024-05-04T02:38:39.317 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1120 0.14 MB/sec execute 135 sec latency 3644.851 ms 2024-05-04T02:38:40.317 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1123 0.14 MB/sec execute 136 sec latency 3471.493 ms 2024-05-04T02:38:41.317 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1127 0.14 MB/sec execute 137 sec latency 2994.578 ms 2024-05-04T02:38:42.317 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1130 0.14 MB/sec execute 138 sec latency 3003.533 ms 2024-05-04T02:38:43.317 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1131 0.14 MB/sec execute 139 sec latency 3236.282 ms 2024-05-04T02:38:44.317 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1132 0.14 MB/sec execute 140 sec latency 3051.124 ms 2024-05-04T02:38:45.317 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1137 0.13 MB/sec execute 141 sec latency 2900.096 ms 2024-05-04T02:38:46.317 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1143 0.13 MB/sec execute 142 sec latency 2127.381 ms 2024-05-04T02:38:47.317 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1148 0.13 MB/sec execute 143 sec latency 2115.999 ms 2024-05-04T02:38:48.317 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1153 0.13 MB/sec execute 144 sec latency 3116.025 ms 2024-05-04T02:38:49.317 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1158 0.13 MB/sec execute 145 sec latency 3660.466 ms 2024-05-04T02:38:50.317 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1163 0.13 MB/sec execute 146 sec latency 1626.335 ms 2024-05-04T02:38:51.317 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1167 0.13 MB/sec execute 147 sec latency 2626.375 ms 2024-05-04T02:38:52.317 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1169 0.13 MB/sec execute 148 sec latency 2884.009 ms 2024-05-04T02:38:53.317 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1169 0.13 MB/sec execute 149 sec latency 2671.962 ms 2024-05-04T02:38:54.317 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1172 0.13 MB/sec execute 150 sec latency 3671.986 ms 2024-05-04T02:38:55.317 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1175 0.13 MB/sec execute 151 sec latency 3812.156 ms 2024-05-04T02:38:56.317 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1179 0.13 MB/sec execute 152 sec latency 3813.574 ms 2024-05-04T02:38:56.719 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:38:56.722 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:38:57.318 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1182 0.13 MB/sec execute 153 sec latency 3349.132 ms 2024-05-04T02:38:58.318 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1184 0.13 MB/sec execute 154 sec latency 3480.440 ms 2024-05-04T02:38:59.318 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1186 0.13 MB/sec execute 155 sec latency 3264.300 ms 2024-05-04T02:39:00.318 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1190 0.12 MB/sec execute 156 sec latency 3393.565 ms 2024-05-04T02:39:01.318 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1192 0.12 MB/sec execute 157 sec latency 2361.173 ms 2024-05-04T02:39:02.318 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1192 0.12 MB/sec execute 158 sec latency 2984.336 ms 2024-05-04T02:39:03.318 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1193 0.12 MB/sec execute 159 sec latency 3612.233 ms 2024-05-04T02:39:04.318 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1194 0.12 MB/sec execute 160 sec latency 3347.423 ms 2024-05-04T02:39:05.318 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1197 0.12 MB/sec execute 161 sec latency 3361.488 ms 2024-05-04T02:39:06.318 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1201 0.12 MB/sec execute 162 sec latency 3344.429 ms 2024-05-04T02:39:07.318 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1204 0.12 MB/sec execute 163 sec latency 1362.380 ms 2024-05-04T02:39:08.318 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1207 0.12 MB/sec execute 164 sec latency 2362.421 ms 2024-05-04T02:39:09.318 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1210 0.12 MB/sec execute 165 sec latency 3362.482 ms 2024-05-04T02:39:10.318 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1212 0.12 MB/sec execute 166 sec latency 4096.773 ms 2024-05-04T02:39:11.319 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1216 0.12 MB/sec execute 167 sec latency 4021.482 ms 2024-05-04T02:39:12.318 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1224 0.12 MB/sec execute 168 sec latency 2840.968 ms 2024-05-04T02:39:13.318 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1224 0.12 MB/sec execute 169 sec latency 3243.194 ms 2024-05-04T02:39:14.318 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1227 0.12 MB/sec execute 170 sec latency 3374.946 ms 2024-05-04T02:39:15.318 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1228 0.12 MB/sec execute 171 sec latency 3488.726 ms 2024-05-04T02:39:16.318 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1230 0.12 MB/sec execute 172 sec latency 2962.921 ms 2024-05-04T02:39:17.318 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1235 0.12 MB/sec execute 173 sec latency 2850.743 ms 2024-05-04T02:39:18.319 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1238 0.11 MB/sec execute 174 sec latency 2456.541 ms 2024-05-04T02:39:19.318 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1241 0.11 MB/sec execute 175 sec latency 3000.456 ms 2024-05-04T02:39:20.319 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1254 0.13 MB/sec execute 176 sec latency 3421.184 ms 2024-05-04T02:39:21.319 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1268 0.15 MB/sec execute 177 sec latency 3105.658 ms 2024-05-04T02:39:22.319 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1280 0.16 MB/sec execute 178 sec latency 2054.373 ms 2024-05-04T02:39:23.319 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1285 0.16 MB/sec execute 179 sec latency 2092.662 ms 2024-05-04T02:39:24.319 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1288 0.16 MB/sec execute 180 sec latency 3002.272 ms 2024-05-04T02:39:25.319 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1289 0.16 MB/sec execute 181 sec latency 3558.820 ms 2024-05-04T02:39:26.319 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1289 0.16 MB/sec execute 182 sec latency 3427.612 ms 2024-05-04T02:39:26.847 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:39:26.850 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:39:27.319 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1290 0.16 MB/sec execute 183 sec latency 2957.910 ms 2024-05-04T02:39:28.319 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1292 0.16 MB/sec execute 184 sec latency 3416.071 ms 2024-05-04T02:39:29.319 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1296 0.16 MB/sec execute 185 sec latency 2324.961 ms 2024-05-04T02:39:30.319 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1306 0.16 MB/sec execute 186 sec latency 3302.314 ms 2024-05-04T02:39:31.319 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1309 0.16 MB/sec execute 187 sec latency 3757.044 ms 2024-05-04T02:39:32.319 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1309 0.15 MB/sec execute 188 sec latency 3015.102 ms 2024-05-04T02:39:32.689 INFO:tasks.ceph.mon.a.smithi001.stderr:==00:00:20:06.046 35030== Warning: unimplemented fcntl command: 1036 2024-05-04T02:39:32.691 INFO:tasks.ceph.mon.a.smithi001.stderr:==00:00:20:06.049 35030== Warning: unimplemented fcntl command: 1036 2024-05-04T02:39:32.766 INFO:tasks.ceph.mon.a.smithi001.stderr:==00:00:20:06.123 35030== Warning: unimplemented fcntl command: 1036 2024-05-04T02:39:32.798 INFO:tasks.ceph.mon.c.smithi107.stderr:==00:00:20:06.126 34878== Warning: unimplemented fcntl command: 1036 2024-05-04T02:39:32.799 INFO:tasks.ceph.mon.b.smithi107.stderr:==00:00:20:06.127 34877== Warning: unimplemented fcntl command: 1036 2024-05-04T02:39:32.800 INFO:tasks.ceph.mon.b.smithi107.stderr:==00:00:20:06.129 34877== Warning: unimplemented fcntl command: 1036 2024-05-04T02:39:32.802 INFO:tasks.ceph.mon.c.smithi107.stderr:==00:00:20:06.130 34878== Warning: unimplemented fcntl command: 1036 2024-05-04T02:39:32.881 INFO:tasks.ceph.mon.c.smithi107.stderr:==00:00:20:06.209 34878== Warning: unimplemented fcntl command: 1036 2024-05-04T02:39:32.885 INFO:tasks.ceph.mon.b.smithi107.stderr:==00:00:20:06.214 34877== Warning: unimplemented fcntl command: 1036 2024-05-04T02:39:33.319 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1309 0.15 MB/sec execute 189 sec latency 3779.235 ms 2024-05-04T02:39:34.319 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1310 0.15 MB/sec execute 190 sec latency 4005.584 ms 2024-05-04T02:39:35.319 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1312 0.15 MB/sec execute 191 sec latency 3815.270 ms 2024-05-04T02:39:36.320 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1313 0.15 MB/sec execute 192 sec latency 2313.239 ms 2024-05-04T02:39:37.319 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1313 0.15 MB/sec execute 193 sec latency 3101.715 ms 2024-05-04T02:39:38.320 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1316 0.15 MB/sec execute 194 sec latency 3360.391 ms 2024-05-04T02:39:39.320 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1325 0.16 MB/sec execute 195 sec latency 2480.376 ms 2024-05-04T02:39:40.319 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1326 0.16 MB/sec execute 196 sec latency 2779.868 ms 2024-05-04T02:39:41.320 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1329 0.16 MB/sec execute 197 sec latency 2647.504 ms 2024-05-04T02:39:42.320 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1330 0.16 MB/sec execute 198 sec latency 2519.833 ms 2024-05-04T02:39:43.320 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1334 0.16 MB/sec execute 199 sec latency 2844.496 ms 2024-05-04T02:39:44.321 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1380 0.23 MB/sec execute 200 sec latency 3317.874 ms 2024-05-04T02:39:45.320 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1389 0.24 MB/sec execute 201 sec latency 3362.986 ms 2024-05-04T02:39:46.320 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1391 0.24 MB/sec execute 202 sec latency 3089.796 ms 2024-05-04T02:39:47.320 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1393 0.24 MB/sec execute 203 sec latency 2872.614 ms 2024-05-04T02:39:48.320 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1396 0.24 MB/sec execute 204 sec latency 2823.209 ms 2024-05-04T02:39:49.320 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1398 0.24 MB/sec execute 205 sec latency 2554.128 ms 2024-05-04T02:39:50.320 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1399 0.24 MB/sec execute 206 sec latency 3196.264 ms 2024-05-04T02:39:51.320 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1402 0.24 MB/sec execute 207 sec latency 2873.104 ms 2024-05-04T02:39:52.320 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1403 0.24 MB/sec execute 208 sec latency 2930.166 ms 2024-05-04T02:39:53.320 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1405 0.24 MB/sec execute 209 sec latency 2941.689 ms 2024-05-04T02:39:54.321 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1407 0.23 MB/sec execute 210 sec latency 3416.914 ms 2024-05-04T02:39:55.320 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1410 0.23 MB/sec execute 211 sec latency 3017.043 ms 2024-05-04T02:39:56.321 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1412 0.23 MB/sec execute 212 sec latency 1998.337 ms 2024-05-04T02:39:56.927 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:39:56.929 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:39:57.321 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1414 0.23 MB/sec execute 213 sec latency 2645.315 ms 2024-05-04T02:39:58.321 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1420 0.23 MB/sec execute 214 sec latency 2923.390 ms 2024-05-04T02:39:59.321 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1424 0.23 MB/sec execute 215 sec latency 2839.768 ms 2024-05-04T02:40:00.321 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1426 0.23 MB/sec execute 216 sec latency 1327.952 ms 2024-05-04T02:40:01.321 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1427 0.23 MB/sec execute 217 sec latency 2328.000 ms 2024-05-04T02:40:02.321 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1430 0.23 MB/sec execute 218 sec latency 2967.576 ms 2024-05-04T02:40:03.321 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1434 0.23 MB/sec execute 219 sec latency 3363.891 ms 2024-05-04T02:40:04.321 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1439 0.22 MB/sec execute 220 sec latency 3171.751 ms 2024-05-04T02:40:05.321 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1443 0.22 MB/sec execute 221 sec latency 2402.304 ms 2024-05-04T02:40:06.321 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1445 0.22 MB/sec execute 222 sec latency 2157.647 ms 2024-05-04T02:40:07.321 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1450 0.22 MB/sec execute 223 sec latency 2585.396 ms 2024-05-04T02:40:08.321 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1452 0.22 MB/sec execute 224 sec latency 3016.968 ms 2024-05-04T02:40:09.321 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1456 0.22 MB/sec execute 225 sec latency 1417.198 ms 2024-05-04T02:40:10.321 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1461 0.22 MB/sec execute 226 sec latency 1588.738 ms 2024-05-04T02:40:11.321 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1467 0.22 MB/sec execute 227 sec latency 2588.764 ms 2024-05-04T02:40:12.321 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1471 0.22 MB/sec execute 228 sec latency 3413.264 ms 2024-05-04T02:40:13.321 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1474 0.22 MB/sec execute 229 sec latency 4091.288 ms 2024-05-04T02:40:14.321 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1475 0.22 MB/sec execute 230 sec latency 4162.647 ms 2024-05-04T02:40:15.321 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1476 0.21 MB/sec execute 231 sec latency 4789.085 ms 2024-05-04T02:40:16.321 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1478 0.21 MB/sec execute 232 sec latency 3814.592 ms 2024-05-04T02:40:17.321 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1479 0.21 MB/sec execute 233 sec latency 3961.147 ms 2024-05-04T02:40:18.321 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1481 0.21 MB/sec execute 234 sec latency 3311.918 ms 2024-05-04T02:40:19.321 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1483 0.21 MB/sec execute 235 sec latency 3789.029 ms 2024-05-04T02:40:20.323 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1487 0.21 MB/sec execute 236 sec latency 4232.083 ms 2024-05-04T02:40:21.321 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1493 0.21 MB/sec execute 237 sec latency 3203.605 ms 2024-05-04T02:40:22.321 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1496 0.21 MB/sec execute 238 sec latency 1944.916 ms 2024-05-04T02:40:23.321 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1499 0.21 MB/sec execute 239 sec latency 2572.442 ms 2024-05-04T02:40:24.322 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1499 0.21 MB/sec execute 240 sec latency 2770.766 ms 2024-05-04T02:40:25.321 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1503 0.21 MB/sec execute 241 sec latency 3021.137 ms 2024-05-04T02:40:26.322 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1510 0.21 MB/sec execute 242 sec latency 2315.625 ms 2024-05-04T02:40:27.031 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:40:27.034 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:40:27.322 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1515 0.21 MB/sec execute 243 sec latency 1558.015 ms 2024-05-04T02:40:28.322 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1517 0.20 MB/sec execute 244 sec latency 2558.078 ms 2024-05-04T02:40:29.322 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1519 0.20 MB/sec execute 245 sec latency 3558.124 ms 2024-05-04T02:40:30.322 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1521 0.20 MB/sec execute 246 sec latency 3645.792 ms 2024-05-04T02:40:31.322 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1523 0.20 MB/sec execute 247 sec latency 3967.943 ms 2024-05-04T02:40:32.322 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1526 0.20 MB/sec execute 248 sec latency 2519.633 ms 2024-05-04T02:40:33.322 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1527 0.20 MB/sec execute 249 sec latency 2088.894 ms 2024-05-04T02:40:34.322 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1529 0.20 MB/sec execute 250 sec latency 3088.919 ms 2024-05-04T02:40:35.322 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1535 0.20 MB/sec execute 251 sec latency 3402.341 ms 2024-05-04T02:40:36.322 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1538 0.20 MB/sec execute 252 sec latency 3385.950 ms 2024-05-04T02:40:37.322 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1542 0.20 MB/sec execute 253 sec latency 2681.826 ms 2024-05-04T02:40:38.322 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1544 0.20 MB/sec execute 254 sec latency 2414.186 ms 2024-05-04T02:40:39.322 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1549 0.20 MB/sec execute 255 sec latency 2766.463 ms 2024-05-04T02:40:40.322 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1551 0.20 MB/sec execute 256 sec latency 2944.156 ms 2024-05-04T02:40:41.322 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1556 0.20 MB/sec execute 257 sec latency 3059.422 ms 2024-05-04T02:40:42.322 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1558 0.19 MB/sec execute 258 sec latency 3380.661 ms 2024-05-04T02:40:43.322 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1560 0.19 MB/sec execute 259 sec latency 3451.276 ms 2024-05-04T02:40:44.322 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1563 0.19 MB/sec execute 260 sec latency 3259.157 ms 2024-05-04T02:40:45.322 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1565 0.19 MB/sec execute 261 sec latency 3260.183 ms 2024-05-04T02:40:46.323 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1567 0.19 MB/sec execute 262 sec latency 3382.042 ms 2024-05-04T02:40:47.322 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1568 0.19 MB/sec execute 263 sec latency 3267.885 ms 2024-05-04T02:40:48.323 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1574 0.19 MB/sec execute 264 sec latency 3269.734 ms 2024-05-04T02:40:49.323 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1578 0.19 MB/sec execute 265 sec latency 3668.029 ms 2024-05-04T02:40:50.323 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1586 0.19 MB/sec execute 266 sec latency 2535.502 ms 2024-05-04T02:40:51.323 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1590 0.19 MB/sec execute 267 sec latency 2134.009 ms 2024-05-04T02:40:52.323 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1592 0.19 MB/sec execute 268 sec latency 2792.505 ms 2024-05-04T02:40:53.323 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1593 0.19 MB/sec execute 269 sec latency 3106.322 ms 2024-05-04T02:40:54.323 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1595 0.19 MB/sec execute 270 sec latency 3760.177 ms 2024-05-04T02:40:55.323 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1597 0.19 MB/sec execute 271 sec latency 3670.900 ms 2024-05-04T02:40:56.323 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1600 0.19 MB/sec execute 272 sec latency 3982.314 ms 2024-05-04T02:40:57.176 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:40:57.179 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:40:57.323 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1603 0.19 MB/sec execute 273 sec latency 4039.856 ms 2024-05-04T02:40:58.323 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1609 0.19 MB/sec execute 274 sec latency 4061.229 ms 2024-05-04T02:40:59.323 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1614 0.18 MB/sec execute 275 sec latency 3898.160 ms 2024-05-04T02:41:00.323 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1619 0.18 MB/sec execute 276 sec latency 3938.789 ms 2024-05-04T02:41:01.323 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1622 0.18 MB/sec execute 277 sec latency 3024.498 ms 2024-05-04T02:41:02.323 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1627 0.18 MB/sec execute 278 sec latency 3185.266 ms 2024-05-04T02:41:03.323 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1629 0.18 MB/sec execute 279 sec latency 1416.887 ms 2024-05-04T02:41:04.323 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1630 0.18 MB/sec execute 280 sec latency 2416.934 ms 2024-05-04T02:41:05.323 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1631 0.18 MB/sec execute 281 sec latency 3416.980 ms 2024-05-04T02:41:06.323 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1633 0.18 MB/sec execute 282 sec latency 4115.897 ms 2024-05-04T02:41:07.323 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1638 0.18 MB/sec execute 283 sec latency 4123.031 ms 2024-05-04T02:41:08.324 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1642 0.18 MB/sec execute 284 sec latency 2437.352 ms 2024-05-04T02:41:09.323 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1644 0.18 MB/sec execute 285 sec latency 2317.935 ms 2024-05-04T02:41:10.323 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1646 0.18 MB/sec execute 286 sec latency 3046.622 ms 2024-05-04T02:41:11.323 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1648 0.18 MB/sec execute 287 sec latency 3143.331 ms 2024-05-04T02:41:12.324 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1654 0.18 MB/sec execute 288 sec latency 3012.751 ms 2024-05-04T02:41:13.323 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1658 0.18 MB/sec execute 289 sec latency 2883.921 ms 2024-05-04T02:41:14.324 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1662 0.18 MB/sec execute 290 sec latency 3049.168 ms 2024-05-04T02:41:15.324 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1665 0.18 MB/sec execute 291 sec latency 3556.592 ms 2024-05-04T02:41:16.324 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1669 0.18 MB/sec execute 292 sec latency 3518.478 ms 2024-05-04T02:41:17.324 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1676 0.17 MB/sec execute 293 sec latency 1667.771 ms 2024-05-04T02:41:18.324 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1680 0.17 MB/sec execute 294 sec latency 2006.933 ms 2024-05-04T02:41:19.324 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1684 0.17 MB/sec execute 295 sec latency 2342.599 ms 2024-05-04T02:41:20.324 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1688 0.17 MB/sec execute 296 sec latency 3342.626 ms 2024-05-04T02:41:21.324 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1691 0.17 MB/sec execute 297 sec latency 3975.963 ms 2024-05-04T02:41:22.324 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1694 0.17 MB/sec execute 298 sec latency 3019.781 ms 2024-05-04T02:41:23.324 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1699 0.17 MB/sec execute 299 sec latency 3408.925 ms 2024-05-04T02:41:24.324 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1703 0.17 MB/sec execute 300 sec latency 2567.060 ms 2024-05-04T02:41:25.324 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1705 0.17 MB/sec execute 301 sec latency 3567.088 ms 2024-05-04T02:41:26.324 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1706 0.17 MB/sec execute 302 sec latency 4567.154 ms 2024-05-04T02:41:27.279 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:41:27.282 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:41:27.324 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1712 0.17 MB/sec execute 303 sec latency 4781.982 ms 2024-05-04T02:41:28.324 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1714 0.17 MB/sec execute 304 sec latency 3708.180 ms 2024-05-04T02:41:29.324 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1718 0.17 MB/sec execute 305 sec latency 2922.367 ms 2024-05-04T02:41:30.324 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1718 0.17 MB/sec execute 306 sec latency 3125.845 ms 2024-05-04T02:41:31.324 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1719 0.17 MB/sec execute 307 sec latency 3456.566 ms 2024-05-04T02:41:32.324 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1721 0.17 MB/sec execute 308 sec latency 3750.899 ms 2024-05-04T02:41:33.324 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1727 0.17 MB/sec execute 309 sec latency 3850.966 ms 2024-05-04T02:41:34.325 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1732 0.17 MB/sec execute 310 sec latency 2759.887 ms 2024-05-04T02:41:35.325 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1736 0.17 MB/sec execute 311 sec latency 3064.612 ms 2024-05-04T02:41:36.325 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1744 0.17 MB/sec execute 312 sec latency 3786.573 ms 2024-05-04T02:41:37.325 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1748 0.17 MB/sec execute 313 sec latency 3696.054 ms 2024-05-04T02:41:38.325 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1753 0.17 MB/sec execute 314 sec latency 2940.106 ms 2024-05-04T02:41:39.325 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1755 0.16 MB/sec execute 315 sec latency 2926.347 ms 2024-05-04T02:41:40.325 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1758 0.16 MB/sec execute 316 sec latency 3360.878 ms 2024-05-04T02:41:41.325 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1763 0.16 MB/sec execute 317 sec latency 3692.954 ms 2024-05-04T02:41:42.325 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1764 0.16 MB/sec execute 318 sec latency 4480.785 ms 2024-05-04T02:41:43.325 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1765 0.16 MB/sec execute 319 sec latency 5480.857 ms 2024-05-04T02:41:44.325 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1767 0.16 MB/sec execute 320 sec latency 6176.321 ms 2024-05-04T02:41:45.325 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1770 0.16 MB/sec execute 321 sec latency 5409.088 ms 2024-05-04T02:41:46.325 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1773 0.16 MB/sec execute 322 sec latency 5460.129 ms 2024-05-04T02:41:47.325 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1780 0.16 MB/sec execute 323 sec latency 5421.379 ms 2024-05-04T02:41:48.325 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1782 0.16 MB/sec execute 324 sec latency 2904.902 ms 2024-05-04T02:41:49.325 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1784 0.16 MB/sec execute 325 sec latency 3047.637 ms 2024-05-04T02:41:50.325 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1786 0.16 MB/sec execute 326 sec latency 3209.053 ms 2024-05-04T02:41:51.325 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1790 0.16 MB/sec execute 327 sec latency 3545.058 ms 2024-05-04T02:41:52.325 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1794 0.16 MB/sec execute 328 sec latency 3083.773 ms 2024-05-04T02:41:53.325 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1797 0.16 MB/sec execute 329 sec latency 2119.914 ms 2024-05-04T02:41:54.326 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1799 0.16 MB/sec execute 330 sec latency 3119.998 ms 2024-05-04T02:41:55.326 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1807 0.16 MB/sec execute 331 sec latency 3691.808 ms 2024-05-04T02:41:56.326 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1815 0.16 MB/sec execute 332 sec latency 3328.888 ms 2024-05-04T02:41:57.326 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1818 0.16 MB/sec execute 333 sec latency 2062.395 ms 2024-05-04T02:41:57.433 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:41:57.436 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:41:58.326 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1820 0.16 MB/sec execute 334 sec latency 2611.037 ms 2024-05-04T02:41:59.326 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1822 0.16 MB/sec execute 335 sec latency 2893.299 ms 2024-05-04T02:42:00.326 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1824 0.16 MB/sec execute 336 sec latency 3009.274 ms 2024-05-04T02:42:01.326 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1826 0.16 MB/sec execute 337 sec latency 3140.564 ms 2024-05-04T02:42:02.326 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1829 0.16 MB/sec execute 338 sec latency 3485.402 ms 2024-05-04T02:42:03.326 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1833 0.16 MB/sec execute 339 sec latency 4248.953 ms 2024-05-04T02:42:04.326 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1837 0.15 MB/sec execute 340 sec latency 4416.765 ms 2024-05-04T02:42:05.326 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1840 0.15 MB/sec execute 341 sec latency 4668.159 ms 2024-05-04T02:42:06.326 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1844 0.15 MB/sec execute 342 sec latency 4271.399 ms 2024-05-04T02:42:07.329 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1848 0.15 MB/sec execute 343 sec latency 3439.605 ms 2024-05-04T02:42:08.326 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1849 0.15 MB/sec execute 344 sec latency 2182.432 ms 2024-05-04T02:42:09.326 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1851 0.15 MB/sec execute 345 sec latency 2266.469 ms 2024-05-04T02:42:10.326 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1852 0.15 MB/sec execute 346 sec latency 2875.248 ms 2024-05-04T02:42:11.326 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1858 0.15 MB/sec execute 347 sec latency 2998.505 ms 2024-05-04T02:42:12.326 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1862 0.15 MB/sec execute 348 sec latency 2817.216 ms 2024-05-04T02:42:13.326 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1863 0.15 MB/sec execute 349 sec latency 1927.452 ms 2024-05-04T02:42:14.327 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1863 0.15 MB/sec execute 350 sec latency 2904.843 ms 2024-05-04T02:42:15.327 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1869 0.15 MB/sec execute 351 sec latency 3024.336 ms 2024-05-04T02:42:16.327 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1873 0.15 MB/sec execute 352 sec latency 2943.695 ms 2024-05-04T02:42:17.327 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1875 0.15 MB/sec execute 353 sec latency 2301.895 ms 2024-05-04T02:42:18.327 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1880 0.15 MB/sec execute 354 sec latency 2822.337 ms 2024-05-04T02:42:19.327 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1883 0.15 MB/sec execute 355 sec latency 2800.653 ms 2024-05-04T02:42:20.327 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1889 0.15 MB/sec execute 356 sec latency 2909.030 ms 2024-05-04T02:42:21.327 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1892 0.15 MB/sec execute 357 sec latency 2781.862 ms 2024-05-04T02:42:22.327 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1897 0.15 MB/sec execute 358 sec latency 3162.068 ms 2024-05-04T02:42:23.327 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1898 0.15 MB/sec execute 359 sec latency 3201.788 ms 2024-05-04T02:42:24.327 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1900 0.15 MB/sec execute 360 sec latency 3705.088 ms 2024-05-04T02:42:25.327 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1903 0.15 MB/sec execute 361 sec latency 4397.555 ms 2024-05-04T02:42:26.327 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1909 0.15 MB/sec execute 362 sec latency 4011.804 ms 2024-05-04T02:42:27.327 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1911 0.15 MB/sec execute 363 sec latency 4067.007 ms 2024-05-04T02:42:27.486 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:42:27.489 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:42:28.327 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1913 0.15 MB/sec execute 364 sec latency 4018.973 ms 2024-05-04T02:42:29.327 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1916 0.15 MB/sec execute 365 sec latency 3168.589 ms 2024-05-04T02:42:30.327 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1919 0.15 MB/sec execute 366 sec latency 3296.711 ms 2024-05-04T02:42:31.327 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1923 0.15 MB/sec execute 367 sec latency 3241.349 ms 2024-05-04T02:42:32.327 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1926 0.15 MB/sec execute 368 sec latency 3042.114 ms 2024-05-04T02:42:33.327 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1928 0.15 MB/sec execute 369 sec latency 3195.918 ms 2024-05-04T02:42:34.328 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1931 0.14 MB/sec execute 370 sec latency 3059.064 ms 2024-05-04T02:42:35.328 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1935 0.14 MB/sec execute 371 sec latency 3246.673 ms 2024-05-04T02:42:36.328 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1938 0.14 MB/sec execute 372 sec latency 2457.427 ms 2024-05-04T02:42:37.328 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1939 0.14 MB/sec execute 373 sec latency 3095.627 ms 2024-05-04T02:42:38.328 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1946 0.14 MB/sec execute 374 sec latency 2973.323 ms 2024-05-04T02:42:39.328 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1952 0.14 MB/sec execute 375 sec latency 2667.134 ms 2024-05-04T02:42:40.328 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1956 0.14 MB/sec execute 376 sec latency 2811.442 ms 2024-05-04T02:42:41.328 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1964 0.14 MB/sec execute 377 sec latency 2962.534 ms 2024-05-04T02:42:42.328 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1968 0.14 MB/sec execute 378 sec latency 2542.207 ms 2024-05-04T02:42:43.328 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1970 0.14 MB/sec execute 379 sec latency 2902.564 ms 2024-05-04T02:42:44.328 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1972 0.14 MB/sec execute 380 sec latency 3484.461 ms 2024-05-04T02:42:45.328 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1973 0.14 MB/sec execute 381 sec latency 3654.294 ms 2024-05-04T02:42:46.328 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1974 0.14 MB/sec execute 382 sec latency 4212.141 ms 2024-05-04T02:42:47.328 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1974 0.14 MB/sec execute 383 sec latency 4412.636 ms 2024-05-04T02:42:48.328 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1978 0.14 MB/sec execute 384 sec latency 4774.124 ms 2024-05-04T02:42:49.328 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1982 0.14 MB/sec execute 385 sec latency 2567.096 ms 2024-05-04T02:42:50.329 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1986 0.14 MB/sec execute 386 sec latency 2037.431 ms 2024-05-04T02:42:51.330 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1990 0.14 MB/sec execute 387 sec latency 3037.504 ms 2024-05-04T02:42:52.329 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1991 0.14 MB/sec execute 388 sec latency 3593.080 ms 2024-05-04T02:42:53.329 INFO:tasks.workunit.client.0.smithi001.stdout: 10 1998 0.14 MB/sec execute 389 sec latency 3599.983 ms 2024-05-04T02:42:54.329 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2001 0.14 MB/sec execute 390 sec latency 2874.133 ms 2024-05-04T02:42:55.329 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2003 0.14 MB/sec execute 391 sec latency 3527.538 ms 2024-05-04T02:42:56.329 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2007 0.14 MB/sec execute 392 sec latency 3632.531 ms 2024-05-04T02:42:57.329 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2009 0.14 MB/sec execute 393 sec latency 3916.026 ms 2024-05-04T02:42:57.541 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:42:57.543 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:42:58.329 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2019 0.14 MB/sec execute 394 sec latency 4041.604 ms 2024-05-04T02:42:59.329 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2021 0.14 MB/sec execute 395 sec latency 3892.768 ms 2024-05-04T02:43:00.329 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2025 0.14 MB/sec execute 396 sec latency 4644.859 ms 2024-05-04T02:43:01.329 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2029 0.14 MB/sec execute 397 sec latency 3678.429 ms 2024-05-04T02:43:02.329 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2032 0.14 MB/sec execute 398 sec latency 3893.622 ms 2024-05-04T02:43:03.329 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2033 0.14 MB/sec execute 399 sec latency 2790.460 ms 2024-05-04T02:43:04.329 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2035 0.14 MB/sec execute 400 sec latency 3610.299 ms 2024-05-04T02:43:05.329 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2037 0.14 MB/sec execute 401 sec latency 4427.291 ms 2024-05-04T02:43:06.329 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2041 0.14 MB/sec execute 402 sec latency 4191.046 ms 2024-05-04T02:43:07.329 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2043 0.14 MB/sec execute 403 sec latency 4017.908 ms 2024-05-04T02:43:08.329 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2045 0.14 MB/sec execute 404 sec latency 2929.952 ms 2024-05-04T02:43:09.330 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2048 0.14 MB/sec execute 405 sec latency 3307.698 ms 2024-05-04T02:43:10.330 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2051 0.14 MB/sec execute 406 sec latency 3137.453 ms 2024-05-04T02:43:11.330 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2057 0.14 MB/sec execute 407 sec latency 2470.733 ms 2024-05-04T02:43:12.330 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2059 0.14 MB/sec execute 408 sec latency 2982.305 ms 2024-05-04T02:43:13.330 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2062 0.14 MB/sec execute 409 sec latency 3099.555 ms 2024-05-04T02:43:14.330 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2068 0.13 MB/sec execute 410 sec latency 3703.121 ms 2024-05-04T02:43:15.330 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2069 0.13 MB/sec execute 411 sec latency 3743.823 ms 2024-05-04T02:43:16.330 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2074 0.13 MB/sec execute 412 sec latency 3686.850 ms 2024-05-04T02:43:17.330 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2078 0.13 MB/sec execute 413 sec latency 3138.786 ms 2024-05-04T02:43:18.330 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2079 0.13 MB/sec execute 414 sec latency 3040.895 ms 2024-05-04T02:43:19.330 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2082 0.13 MB/sec execute 415 sec latency 3170.864 ms 2024-05-04T02:43:20.330 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2083 0.13 MB/sec execute 416 sec latency 3491.266 ms 2024-05-04T02:43:21.330 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2084 0.13 MB/sec execute 417 sec latency 3654.373 ms 2024-05-04T02:43:22.330 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2089 0.13 MB/sec execute 418 sec latency 3740.963 ms 2024-05-04T02:43:23.330 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2093 0.13 MB/sec execute 419 sec latency 3574.583 ms 2024-05-04T02:43:24.330 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2094 0.13 MB/sec execute 420 sec latency 2670.518 ms 2024-05-04T02:43:25.330 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2095 0.13 MB/sec execute 421 sec latency 3670.598 ms 2024-05-04T02:43:26.330 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2096 0.13 MB/sec execute 422 sec latency 4026.879 ms 2024-05-04T02:43:27.330 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2099 0.13 MB/sec execute 423 sec latency 3725.482 ms 2024-05-04T02:43:27.677 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:43:27.682 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:43:28.330 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2101 0.13 MB/sec execute 424 sec latency 2660.639 ms 2024-05-04T02:43:29.330 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2103 0.13 MB/sec execute 425 sec latency 3049.349 ms 2024-05-04T02:43:30.330 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2104 0.13 MB/sec execute 426 sec latency 3297.814 ms 2024-05-04T02:43:31.330 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2107 0.13 MB/sec execute 427 sec latency 3170.204 ms 2024-05-04T02:43:32.331 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2112 0.13 MB/sec execute 428 sec latency 2605.647 ms 2024-05-04T02:43:33.331 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2115 0.13 MB/sec execute 429 sec latency 1986.853 ms 2024-05-04T02:43:34.331 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2116 0.13 MB/sec execute 430 sec latency 2518.233 ms 2024-05-04T02:43:35.331 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2121 0.13 MB/sec execute 431 sec latency 3029.460 ms 2024-05-04T02:43:36.331 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2127 0.13 MB/sec execute 432 sec latency 3172.258 ms 2024-05-04T02:43:37.331 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2132 0.13 MB/sec execute 433 sec latency 2751.683 ms 2024-05-04T02:43:38.331 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2133 0.13 MB/sec execute 434 sec latency 2745.838 ms 2024-05-04T02:43:39.331 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2137 0.13 MB/sec execute 435 sec latency 2886.096 ms 2024-05-04T02:43:40.331 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2141 0.13 MB/sec execute 436 sec latency 3525.779 ms 2024-05-04T02:43:41.331 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2146 0.13 MB/sec execute 437 sec latency 3581.820 ms 2024-05-04T02:43:42.331 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2152 0.13 MB/sec execute 438 sec latency 3583.471 ms 2024-05-04T02:43:43.331 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2154 0.13 MB/sec execute 439 sec latency 3971.835 ms 2024-05-04T02:43:44.331 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2162 0.13 MB/sec execute 440 sec latency 3754.127 ms 2024-05-04T02:43:45.331 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2165 0.13 MB/sec execute 441 sec latency 2001.164 ms 2024-05-04T02:43:46.332 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2168 0.13 MB/sec execute 442 sec latency 3001.281 ms 2024-05-04T02:43:47.332 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2172 0.13 MB/sec execute 443 sec latency 3551.069 ms 2024-05-04T02:43:48.332 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2172 0.13 MB/sec execute 444 sec latency 4506.295 ms 2024-05-04T02:43:49.332 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2174 0.13 MB/sec execute 445 sec latency 4990.405 ms 2024-05-04T02:43:50.332 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2180 0.13 MB/sec execute 446 sec latency 3780.637 ms 2024-05-04T02:43:51.332 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2183 0.13 MB/sec execute 447 sec latency 4018.474 ms 2024-05-04T02:43:52.332 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2188 0.13 MB/sec execute 448 sec latency 4406.805 ms 2024-05-04T02:43:53.332 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2192 0.13 MB/sec execute 449 sec latency 3730.353 ms 2024-05-04T02:43:54.332 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2201 0.13 MB/sec execute 450 sec latency 2978.229 ms 2024-05-04T02:43:55.332 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2202 0.13 MB/sec execute 451 sec latency 2566.856 ms 2024-05-04T02:43:56.332 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2202 0.13 MB/sec execute 452 sec latency 3566.967 ms 2024-05-04T02:43:57.332 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2204 0.13 MB/sec execute 453 sec latency 3858.395 ms 2024-05-04T02:43:57.806 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:43:57.809 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:43:58.332 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2205 0.13 MB/sec execute 454 sec latency 3682.733 ms 2024-05-04T02:43:59.332 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2207 0.13 MB/sec execute 455 sec latency 3926.200 ms 2024-05-04T02:44:00.332 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2208 0.13 MB/sec execute 456 sec latency 3443.284 ms 2024-05-04T02:44:01.332 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2209 0.13 MB/sec execute 457 sec latency 4104.949 ms 2024-05-04T02:44:02.332 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2213 0.13 MB/sec execute 458 sec latency 3797.959 ms 2024-05-04T02:44:03.332 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2217 0.13 MB/sec execute 459 sec latency 3945.157 ms 2024-05-04T02:44:04.333 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2220 0.13 MB/sec execute 460 sec latency 2327.966 ms 2024-05-04T02:44:05.333 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2226 0.13 MB/sec execute 461 sec latency 2708.743 ms 2024-05-04T02:44:06.333 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2227 0.13 MB/sec execute 462 sec latency 3123.721 ms 2024-05-04T02:44:07.333 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2229 0.13 MB/sec execute 463 sec latency 3278.413 ms 2024-05-04T02:44:08.333 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2233 0.13 MB/sec execute 464 sec latency 3474.176 ms 2024-05-04T02:44:09.333 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2244 0.13 MB/sec execute 465 sec latency 3453.714 ms 2024-05-04T02:44:10.333 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2248 0.13 MB/sec execute 466 sec latency 2023.602 ms 2024-05-04T02:44:11.333 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2252 0.13 MB/sec execute 467 sec latency 2954.286 ms 2024-05-04T02:44:12.333 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2255 0.13 MB/sec execute 468 sec latency 2792.645 ms 2024-05-04T02:44:12.504 INFO:tasks.ceph.mon.a.smithi001.stderr:==00:00:24:45.862 35030== Warning: unimplemented fcntl command: 1036 2024-05-04T02:44:12.507 INFO:tasks.ceph.mon.a.smithi001.stderr:==00:00:24:45.865 35030== Warning: unimplemented fcntl command: 1036 2024-05-04T02:44:12.582 INFO:tasks.ceph.mon.c.smithi107.stderr:==00:00:24:45.911 34878== Warning: unimplemented fcntl command: 1036 2024-05-04T02:44:12.585 INFO:tasks.ceph.mon.c.smithi107.stderr:==00:00:24:45.914 34878== Warning: unimplemented fcntl command: 1036 2024-05-04T02:44:12.592 INFO:tasks.ceph.mon.b.smithi107.stderr:==00:00:24:45.921 34877== Warning: unimplemented fcntl command: 1036 2024-05-04T02:44:12.600 INFO:tasks.ceph.mon.b.smithi107.stderr:==00:00:24:45.929 34877== Warning: unimplemented fcntl command: 1036 2024-05-04T02:44:12.641 INFO:tasks.ceph.mon.a.smithi001.stderr:==00:00:24:45.998 35030== Warning: unimplemented fcntl command: 1036 2024-05-04T02:44:12.708 INFO:tasks.ceph.mon.c.smithi107.stderr:==00:00:24:46.037 34878== Warning: unimplemented fcntl command: 1036 2024-05-04T02:44:12.723 INFO:tasks.ceph.mon.b.smithi107.stderr:==00:00:24:46.052 34877== Warning: unimplemented fcntl command: 1036 2024-05-04T02:44:13.333 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2256 0.13 MB/sec execute 469 sec latency 2942.853 ms 2024-05-04T02:44:14.339 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2261 0.13 MB/sec execute 470 sec latency 3201.977 ms 2024-05-04T02:44:15.333 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2263 0.13 MB/sec execute 471 sec latency 3358.598 ms 2024-05-04T02:44:16.333 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2268 0.13 MB/sec execute 472 sec latency 3813.799 ms 2024-05-04T02:44:17.333 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2273 0.13 MB/sec execute 473 sec latency 3943.766 ms 2024-05-04T02:44:18.333 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2279 0.13 MB/sec execute 474 sec latency 2187.542 ms 2024-05-04T02:44:19.333 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2279 0.13 MB/sec execute 475 sec latency 3187.616 ms 2024-05-04T02:44:20.333 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2282 0.13 MB/sec execute 476 sec latency 3468.444 ms 2024-05-04T02:44:21.333 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2286 0.13 MB/sec execute 477 sec latency 3076.800 ms 2024-05-04T02:44:22.333 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2291 0.13 MB/sec execute 478 sec latency 2487.020 ms 2024-05-04T02:44:23.333 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2294 0.13 MB/sec execute 479 sec latency 2808.894 ms 2024-05-04T02:44:24.333 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2298 0.13 MB/sec execute 480 sec latency 2910.314 ms 2024-05-04T02:44:25.334 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2303 0.14 MB/sec execute 481 sec latency 2995.664 ms 2024-05-04T02:44:26.334 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2305 0.14 MB/sec execute 482 sec latency 3259.466 ms 2024-05-04T02:44:27.334 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2307 0.14 MB/sec execute 483 sec latency 3101.701 ms 2024-05-04T02:44:27.863 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:44:27.866 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:44:28.334 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2314 0.13 MB/sec execute 484 sec latency 3384.626 ms 2024-05-04T02:44:29.334 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2316 0.14 MB/sec execute 485 sec latency 3393.573 ms 2024-05-04T02:44:30.334 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2323 0.14 MB/sec execute 486 sec latency 3423.378 ms 2024-05-04T02:44:31.334 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2323 0.14 MB/sec execute 487 sec latency 3722.769 ms 2024-05-04T02:44:32.334 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2324 0.14 MB/sec execute 488 sec latency 3549.348 ms 2024-05-04T02:44:33.334 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2327 0.14 MB/sec execute 489 sec latency 3053.452 ms 2024-05-04T02:44:34.334 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2328 0.14 MB/sec execute 490 sec latency 3224.038 ms 2024-05-04T02:44:35.334 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2331 0.14 MB/sec execute 491 sec latency 3051.682 ms 2024-05-04T02:44:36.334 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2332 0.14 MB/sec execute 492 sec latency 3711.952 ms 2024-05-04T02:44:37.334 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2333 0.14 MB/sec execute 493 sec latency 3973.133 ms 2024-05-04T02:44:38.334 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2334 0.14 MB/sec execute 494 sec latency 3404.077 ms 2024-05-04T02:44:39.334 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2336 0.14 MB/sec execute 495 sec latency 2926.667 ms 2024-05-04T02:44:40.334 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2338 0.14 MB/sec execute 496 sec latency 2625.911 ms 2024-05-04T02:44:41.335 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2341 0.14 MB/sec execute 497 sec latency 3174.550 ms 2024-05-04T02:44:42.335 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2343 0.14 MB/sec execute 498 sec latency 3398.729 ms 2024-05-04T02:44:43.335 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2345 0.14 MB/sec execute 499 sec latency 3091.352 ms 2024-05-04T02:44:44.335 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2349 0.14 MB/sec execute 500 sec latency 3299.439 ms 2024-05-04T02:44:45.338 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2353 0.14 MB/sec execute 501 sec latency 3157.930 ms 2024-05-04T02:44:46.335 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2354 0.14 MB/sec execute 502 sec latency 3270.533 ms 2024-05-04T02:44:47.335 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2355 0.14 MB/sec execute 503 sec latency 3471.498 ms 2024-05-04T02:44:48.335 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2358 0.14 MB/sec execute 504 sec latency 3170.190 ms 2024-05-04T02:44:49.335 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2361 0.13 MB/sec execute 505 sec latency 3574.629 ms 2024-05-04T02:44:50.335 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2363 0.13 MB/sec execute 506 sec latency 3046.631 ms 2024-05-04T02:44:51.335 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2364 0.13 MB/sec execute 507 sec latency 3003.220 ms 2024-05-04T02:44:52.335 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2368 0.13 MB/sec execute 508 sec latency 3024.298 ms 2024-05-04T02:44:53.335 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2371 0.13 MB/sec execute 509 sec latency 3222.054 ms 2024-05-04T02:44:54.335 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2373 0.13 MB/sec execute 510 sec latency 2702.838 ms 2024-05-04T02:44:55.335 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2373 0.13 MB/sec execute 511 sec latency 3358.044 ms 2024-05-04T02:44:56.335 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2374 0.13 MB/sec execute 512 sec latency 3433.274 ms 2024-05-04T02:44:57.335 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2377 0.13 MB/sec execute 513 sec latency 3395.069 ms 2024-05-04T02:44:58.031 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:44:58.038 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:44:58.336 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2379 0.13 MB/sec execute 514 sec latency 2981.749 ms 2024-05-04T02:44:59.336 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2380 0.13 MB/sec execute 515 sec latency 3456.518 ms 2024-05-04T02:45:00.336 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2381 0.13 MB/sec execute 516 sec latency 2861.382 ms 2024-05-04T02:45:01.336 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2385 0.13 MB/sec execute 517 sec latency 2789.438 ms 2024-05-04T02:45:02.338 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2388 0.13 MB/sec execute 518 sec latency 2874.938 ms 2024-05-04T02:45:03.336 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2391 0.13 MB/sec execute 519 sec latency 1950.992 ms 2024-05-04T02:45:04.336 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2392 0.13 MB/sec execute 520 sec latency 2951.063 ms 2024-05-04T02:45:05.336 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2395 0.13 MB/sec execute 521 sec latency 2969.532 ms 2024-05-04T02:45:06.336 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2397 0.13 MB/sec execute 522 sec latency 3004.246 ms 2024-05-04T02:45:07.336 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2399 0.13 MB/sec execute 523 sec latency 3325.193 ms 2024-05-04T02:45:08.336 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2401 0.13 MB/sec execute 524 sec latency 3295.812 ms 2024-05-04T02:45:09.336 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2404 0.13 MB/sec execute 525 sec latency 3505.536 ms 2024-05-04T02:45:10.336 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2407 0.13 MB/sec execute 526 sec latency 3125.631 ms 2024-05-04T02:45:11.336 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2408 0.13 MB/sec execute 527 sec latency 3238.470 ms 2024-05-04T02:45:12.336 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2412 0.13 MB/sec execute 528 sec latency 3208.845 ms 2024-05-04T02:45:12.746 INFO:tasks.ceph.mon.a.smithi001.stderr:==00:00:25:46.104 35030== Warning: unimplemented fcntl command: 1036 2024-05-04T02:45:12.755 INFO:tasks.ceph.mon.a.smithi001.stderr:==00:00:25:46.113 35030== Warning: unimplemented fcntl command: 1036 2024-05-04T02:45:12.787 INFO:tasks.ceph.mon.a.smithi001.stderr:==00:00:25:46.145 35030== Warning: unimplemented fcntl command: 1036 2024-05-04T02:45:12.804 INFO:tasks.ceph.mon.b.smithi107.stderr:==00:00:25:46.133 34877== Warning: unimplemented fcntl command: 1036 2024-05-04T02:45:12.808 INFO:tasks.ceph.mon.b.smithi107.stderr:==00:00:25:46.137 34877== Warning: unimplemented fcntl command: 1036 2024-05-04T02:45:12.837 INFO:tasks.ceph.mon.c.smithi107.stderr:==00:00:25:46.165 34878== Warning: unimplemented fcntl command: 1036 2024-05-04T02:45:12.840 INFO:tasks.ceph.mon.c.smithi107.stderr:==00:00:25:46.169 34878== Warning: unimplemented fcntl command: 1036 2024-05-04T02:45:12.853 INFO:tasks.ceph.mon.b.smithi107.stderr:==00:00:25:46.181 34877== Warning: unimplemented fcntl command: 1036 2024-05-04T02:45:12.882 INFO:tasks.ceph.mon.c.smithi107.stderr:==00:00:25:46.210 34878== Warning: unimplemented fcntl command: 1036 2024-05-04T02:45:13.336 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2414 0.13 MB/sec execute 529 sec latency 3560.496 ms 2024-05-04T02:45:14.336 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2418 0.13 MB/sec execute 530 sec latency 3580.004 ms 2024-05-04T02:45:15.336 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2420 0.13 MB/sec execute 531 sec latency 3312.785 ms 2024-05-04T02:45:16.336 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2422 0.13 MB/sec execute 532 sec latency 3527.301 ms 2024-05-04T02:45:17.336 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2426 0.13 MB/sec execute 533 sec latency 3730.995 ms 2024-05-04T02:45:18.336 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2427 0.13 MB/sec execute 534 sec latency 3806.932 ms 2024-05-04T02:45:19.336 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2430 0.13 MB/sec execute 535 sec latency 3436.294 ms 2024-05-04T02:45:20.336 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2431 0.13 MB/sec execute 536 sec latency 2962.468 ms 2024-05-04T02:45:21.337 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2433 0.13 MB/sec execute 537 sec latency 2886.434 ms 2024-05-04T02:45:22.337 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2437 0.13 MB/sec execute 538 sec latency 3089.900 ms 2024-05-04T02:45:23.337 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2440 0.13 MB/sec execute 539 sec latency 3083.207 ms 2024-05-04T02:45:24.337 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2442 0.13 MB/sec execute 540 sec latency 3159.827 ms 2024-05-04T02:45:25.337 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2445 0.13 MB/sec execute 541 sec latency 3146.118 ms 2024-05-04T02:45:26.337 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2446 0.13 MB/sec execute 542 sec latency 3348.047 ms 2024-05-04T02:45:27.337 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2452 0.13 MB/sec execute 543 sec latency 3456.334 ms 2024-05-04T02:45:28.084 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:45:28.087 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:45:28.337 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2459 0.13 MB/sec execute 544 sec latency 3081.850 ms 2024-05-04T02:45:29.337 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2462 0.13 MB/sec execute 545 sec latency 2715.918 ms 2024-05-04T02:45:30.337 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2465 0.13 MB/sec execute 546 sec latency 3196.026 ms 2024-05-04T02:45:31.337 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2467 0.13 MB/sec execute 547 sec latency 3369.744 ms 2024-05-04T02:45:32.337 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2472 0.13 MB/sec execute 548 sec latency 3518.813 ms 2024-05-04T02:45:33.337 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2475 0.13 MB/sec execute 549 sec latency 2773.542 ms 2024-05-04T02:45:34.337 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2479 0.13 MB/sec execute 550 sec latency 2800.265 ms 2024-05-04T02:45:35.337 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2482 0.13 MB/sec execute 551 sec latency 3498.255 ms 2024-05-04T02:45:36.337 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2486 0.13 MB/sec execute 552 sec latency 3454.957 ms 2024-05-04T02:45:37.337 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2486 0.13 MB/sec execute 553 sec latency 4301.417 ms 2024-05-04T02:45:38.338 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2489 0.14 MB/sec execute 554 sec latency 3604.808 ms 2024-05-04T02:45:39.337 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2491 0.14 MB/sec execute 555 sec latency 3630.572 ms 2024-05-04T02:45:40.337 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2495 0.13 MB/sec execute 556 sec latency 3004.652 ms 2024-05-04T02:45:41.338 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2495 0.13 MB/sec execute 557 sec latency 3828.856 ms 2024-05-04T02:45:42.338 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2498 0.13 MB/sec execute 558 sec latency 3523.501 ms 2024-05-04T02:45:43.338 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2501 0.14 MB/sec execute 559 sec latency 3534.262 ms 2024-05-04T02:45:44.338 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2504 0.14 MB/sec execute 560 sec latency 2876.487 ms 2024-05-04T02:45:45.338 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2507 0.13 MB/sec execute 561 sec latency 2167.610 ms 2024-05-04T02:45:46.338 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2508 0.13 MB/sec execute 562 sec latency 2975.667 ms 2024-05-04T02:45:47.338 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2509 0.13 MB/sec execute 563 sec latency 3226.238 ms 2024-05-04T02:45:48.338 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2517 0.13 MB/sec execute 564 sec latency 3327.740 ms 2024-05-04T02:45:49.338 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2521 0.14 MB/sec execute 565 sec latency 2993.330 ms 2024-05-04T02:45:50.338 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2523 0.14 MB/sec execute 566 sec latency 3023.186 ms 2024-05-04T02:45:51.338 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2530 0.14 MB/sec execute 567 sec latency 3280.189 ms 2024-05-04T02:45:52.338 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2531 0.14 MB/sec execute 568 sec latency 3588.131 ms 2024-05-04T02:45:53.338 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2533 0.14 MB/sec execute 569 sec latency 3030.806 ms 2024-05-04T02:45:54.338 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2540 0.14 MB/sec execute 570 sec latency 2874.581 ms 2024-05-04T02:45:55.338 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2543 0.14 MB/sec execute 571 sec latency 2606.241 ms 2024-05-04T02:45:56.339 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2545 0.14 MB/sec execute 572 sec latency 2947.925 ms 2024-05-04T02:45:57.338 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2547 0.14 MB/sec execute 573 sec latency 3611.595 ms 2024-05-04T02:45:58.230 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:45:58.233 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:45:58.338 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2553 0.14 MB/sec execute 574 sec latency 3617.202 ms 2024-05-04T02:45:59.339 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2554 0.14 MB/sec execute 575 sec latency 3973.299 ms 2024-05-04T02:46:00.339 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2555 0.14 MB/sec execute 576 sec latency 4116.060 ms 2024-05-04T02:46:01.339 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2557 0.14 MB/sec execute 577 sec latency 2935.934 ms 2024-05-04T02:46:02.339 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2563 0.14 MB/sec execute 578 sec latency 2979.192 ms 2024-05-04T02:46:03.339 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2566 0.14 MB/sec execute 579 sec latency 3040.958 ms 2024-05-04T02:46:04.339 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2568 0.14 MB/sec execute 580 sec latency 2996.887 ms 2024-05-04T02:46:05.339 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2570 0.14 MB/sec execute 581 sec latency 2897.711 ms 2024-05-04T02:46:06.339 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2571 0.13 MB/sec execute 582 sec latency 2742.657 ms 2024-05-04T02:46:07.339 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2572 0.13 MB/sec execute 583 sec latency 3196.363 ms 2024-05-04T02:46:08.339 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2577 0.13 MB/sec execute 584 sec latency 3235.638 ms 2024-05-04T02:46:09.339 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2592 0.14 MB/sec execute 585 sec latency 3327.524 ms 2024-05-04T02:46:10.339 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2595 0.14 MB/sec execute 586 sec latency 3031.285 ms 2024-05-04T02:46:11.339 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2599 0.14 MB/sec execute 587 sec latency 3095.241 ms 2024-05-04T02:46:12.339 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2607 0.14 MB/sec execute 588 sec latency 3117.901 ms 2024-05-04T02:46:13.339 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2611 0.14 MB/sec execute 589 sec latency 3200.332 ms 2024-05-04T02:46:14.340 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2613 0.14 MB/sec execute 590 sec latency 2904.283 ms 2024-05-04T02:46:15.340 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2618 0.15 MB/sec execute 591 sec latency 2972.397 ms 2024-05-04T02:46:16.340 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2628 0.15 MB/sec execute 592 sec latency 3092.426 ms 2024-05-04T02:46:17.340 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2631 0.15 MB/sec execute 593 sec latency 3431.142 ms 2024-05-04T02:46:18.340 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2633 0.15 MB/sec execute 594 sec latency 2980.161 ms 2024-05-04T02:46:19.340 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2635 0.15 MB/sec execute 595 sec latency 3591.467 ms 2024-05-04T02:46:20.340 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2639 0.15 MB/sec execute 596 sec latency 3650.738 ms 2024-05-04T02:46:21.340 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2642 0.15 MB/sec execute 597 sec latency 3427.735 ms 2024-05-04T02:46:22.340 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2644 0.15 MB/sec execute 598 sec latency 3451.630 ms 2024-05-04T02:46:23.340 INFO:tasks.workunit.client.0.smithi001.stdout: 10 2646 0.15 MB/sec execute 599 sec latency 3120.559 ms 2024-05-04T02:46:24.340 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 600 sec 2024-05-04T02:46:25.340 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 601 sec 2024-05-04T02:46:26.340 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 602 sec 2024-05-04T02:46:27.340 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 603 sec 2024-05-04T02:46:28.284 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:46:28.286 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:46:28.340 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 604 sec 2024-05-04T02:46:29.340 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 605 sec 2024-05-04T02:46:30.341 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 606 sec 2024-05-04T02:46:31.340 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 607 sec 2024-05-04T02:46:32.341 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 608 sec 2024-05-04T02:46:33.341 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 609 sec 2024-05-04T02:46:34.341 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 610 sec 2024-05-04T02:46:35.341 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 611 sec 2024-05-04T02:46:36.341 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 612 sec 2024-05-04T02:46:37.341 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 613 sec 2024-05-04T02:46:38.341 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 614 sec 2024-05-04T02:46:39.341 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 615 sec 2024-05-04T02:46:40.341 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 616 sec 2024-05-04T02:46:41.341 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 617 sec 2024-05-04T02:46:42.342 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 618 sec 2024-05-04T02:46:43.342 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 619 sec 2024-05-04T02:46:44.342 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 620 sec 2024-05-04T02:46:45.342 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 621 sec 2024-05-04T02:46:46.342 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 622 sec 2024-05-04T02:46:47.342 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 623 sec 2024-05-04T02:46:48.342 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 624 sec 2024-05-04T02:46:49.342 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 625 sec 2024-05-04T02:46:50.342 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 626 sec 2024-05-04T02:46:51.342 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 627 sec 2024-05-04T02:46:52.342 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 628 sec 2024-05-04T02:46:53.342 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 629 sec 2024-05-04T02:46:54.342 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 630 sec 2024-05-04T02:46:55.343 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 631 sec 2024-05-04T02:46:56.343 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 632 sec 2024-05-04T02:46:57.343 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 633 sec 2024-05-04T02:46:58.343 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 634 sec 2024-05-04T02:46:58.784 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:46:58.787 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:46:59.343 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 635 sec 2024-05-04T02:47:00.343 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 636 sec 2024-05-04T02:47:01.343 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 637 sec 2024-05-04T02:47:02.343 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 638 sec 2024-05-04T02:47:03.343 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 639 sec 2024-05-04T02:47:04.343 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 640 sec 2024-05-04T02:47:05.343 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 641 sec 2024-05-04T02:47:06.343 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 642 sec 2024-05-04T02:47:07.343 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 643 sec 2024-05-04T02:47:08.343 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 644 sec 2024-05-04T02:47:09.343 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 645 sec 2024-05-04T02:47:10.343 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 646 sec 2024-05-04T02:47:11.344 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 647 sec 2024-05-04T02:47:12.343 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 648 sec 2024-05-04T02:47:13.344 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 649 sec 2024-05-04T02:47:14.344 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 650 sec 2024-05-04T02:47:15.344 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 651 sec 2024-05-04T02:47:16.344 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 652 sec 2024-05-04T02:47:17.344 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 653 sec 2024-05-04T02:47:18.344 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 654 sec 2024-05-04T02:47:19.344 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 655 sec 2024-05-04T02:47:20.344 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 656 sec 2024-05-04T02:47:21.344 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 657 sec 2024-05-04T02:47:22.344 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 658 sec 2024-05-04T02:47:23.345 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 659 sec 2024-05-04T02:47:24.344 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 660 sec 2024-05-04T02:47:25.344 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 661 sec 2024-05-04T02:47:26.344 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 662 sec 2024-05-04T02:47:27.344 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 663 sec 2024-05-04T02:47:28.344 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 664 sec 2024-05-04T02:47:28.867 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:47:28.870 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:47:29.344 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 665 sec 2024-05-04T02:47:30.344 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 666 sec 2024-05-04T02:47:31.344 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 667 sec 2024-05-04T02:47:32.345 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 668 sec 2024-05-04T02:47:33.345 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 669 sec 2024-05-04T02:47:34.345 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 670 sec 2024-05-04T02:47:35.345 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 671 sec 2024-05-04T02:47:36.345 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 672 sec 2024-05-04T02:47:37.345 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 673 sec 2024-05-04T02:47:38.345 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 674 sec 2024-05-04T02:47:39.345 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 675 sec 2024-05-04T02:47:40.345 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 676 sec 2024-05-04T02:47:41.345 INFO:tasks.workunit.client.0.smithi001.stdout: 10 cleanup 677 sec 2024-05-04T02:47:42.346 INFO:tasks.workunit.client.0.smithi001.stdout: 8 cleanup 678 sec 2024-05-04T02:47:43.345 INFO:tasks.workunit.client.0.smithi001.stdout: 7 cleanup 679 sec 2024-05-04T02:47:44.346 INFO:tasks.workunit.client.0.smithi001.stdout: 7 cleanup 680 sec 2024-05-04T02:47:45.345 INFO:tasks.workunit.client.0.smithi001.stdout: 4 cleanup 681 sec 2024-05-04T02:47:46.346 INFO:tasks.workunit.client.0.smithi001.stdout: 2 cleanup 682 sec 2024-05-04T02:47:46.769 INFO:tasks.workunit.client.0.smithi001.stdout: 0 cleanup 682 sec 2024-05-04T02:47:46.769 INFO:tasks.workunit.client.0.smithi001.stdout: 2024-05-04T02:47:46.769 INFO:tasks.workunit.client.0.smithi001.stdout: Operation Count AvgLat MaxLat 2024-05-04T02:47:46.769 INFO:tasks.workunit.client.0.smithi001.stdout: ---------------------------------------- 2024-05-04T02:47:46.769 INFO:tasks.workunit.client.0.smithi001.stdout: NTCreateX 3494 332.484 1742.890 2024-05-04T02:47:46.769 INFO:tasks.workunit.client.0.smithi001.stdout: Close 2982 3.817 57.091 2024-05-04T02:47:46.769 INFO:tasks.workunit.client.0.smithi001.stdout: Rename 168 1023.839 1759.560 2024-05-04T02:47:46.769 INFO:tasks.workunit.client.0.smithi001.stdout: Unlink 386 332.706 923.411 2024-05-04T02:47:46.769 INFO:tasks.workunit.client.0.smithi001.stdout: Qpathinfo 3455 209.755 1882.672 2024-05-04T02:47:46.769 INFO:tasks.workunit.client.0.smithi001.stdout: Qfileinfo 660 7.061 46.029 2024-05-04T02:47:46.770 INFO:tasks.workunit.client.0.smithi001.stdout: Qfsinfo 403 27.453 179.983 2024-05-04T02:47:46.770 INFO:tasks.workunit.client.0.smithi001.stdout: Sfileinfo 476 59.548 180.854 2024-05-04T02:47:46.770 INFO:tasks.workunit.client.0.smithi001.stdout: Find 1156 3150.849 6176.314 2024-05-04T02:47:46.770 INFO:tasks.workunit.client.0.smithi001.stdout: WriteX 1998 16.151 600.652 2024-05-04T02:47:46.770 INFO:tasks.workunit.client.0.smithi001.stdout: ReadX 4407 0.143 18.708 2024-05-04T02:47:46.770 INFO:tasks.workunit.client.0.smithi001.stdout: Flush 329 316.747 1246.117 2024-05-04T02:47:46.770 INFO:tasks.workunit.client.0.smithi001.stdout: 2024-05-04T02:47:46.770 INFO:tasks.workunit.client.0.smithi001.stdout:Throughput 0.147048 MB/sec 10 clients 10 procs max_latency=6176.321 ms 2024-05-04T02:47:46.770 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-05-04T02:47:46.771 DEBUG:teuthology.orchestra.run.smithi001:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-05-04T02:47:47.955 INFO:tasks.ceph.mon.a.smithi001.stderr:==00:00:28:21.313 35030== Warning: unimplemented fcntl command: 1036 2024-05-04T02:47:47.959 INFO:tasks.ceph.mon.a.smithi001.stderr:==00:00:28:21.317 35030== Warning: unimplemented fcntl command: 1036 2024-05-04T02:47:47.972 INFO:tasks.ceph.mon.b.smithi107.stderr:==00:00:28:21.301 34877== Warning: unimplemented fcntl command: 1036 2024-05-04T02:47:47.973 INFO:tasks.ceph.mon.c.smithi107.stderr:==00:00:28:21.302 34878== Warning: unimplemented fcntl command: 1036 2024-05-04T02:47:47.974 INFO:tasks.ceph.mon.b.smithi107.stderr:==00:00:28:21.303 34877== Warning: unimplemented fcntl command: 1036 2024-05-04T02:47:47.976 INFO:tasks.ceph.mon.c.smithi107.stderr:==00:00:28:21.305 34878== Warning: unimplemented fcntl command: 1036 2024-05-04T02:47:48.038 INFO:tasks.ceph.mon.a.smithi001.stderr:==00:00:28:21.395 35030== Warning: unimplemented fcntl command: 1036 2024-05-04T02:47:48.050 INFO:tasks.ceph.mon.b.smithi107.stderr:==00:00:28:21.379 34877== Warning: unimplemented fcntl command: 1036 2024-05-04T02:47:48.052 INFO:tasks.ceph.mon.c.smithi107.stderr:==00:00:28:21.381 34878== Warning: unimplemented fcntl command: 1036 2024-05-04T02:47:58.995 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:47:58.998 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:48:11.156 INFO:tasks.workunit:Stopping ['suites/dbench.sh'] on client.0... 2024-05-04T02:48:11.157 DEBUG:teuthology.orchestra.run.smithi001:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-05-04T02:48:11.453 DEBUG:teuthology.parallel:result is None 2024-05-04T02:48:11.454 DEBUG:teuthology.orchestra.run.smithi001:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-05-04T02:48:11.659 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-05-04T02:48:11.659 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-05-04T02:48:11.668 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-05-04T02:48:11.668 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-05-04T02:48:11.668 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-04T02:48:11.684 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-05-04T02:48:11.684 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-04T02:48:11.740 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-04T02:48:11.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:11.894+0000 7fa8fa668640 1 Processor -- start 2024-05-04T02:48:11.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:11.894+0000 7fa8fa668640 1 -- start start 2024-05-04T02:48:11.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:11.896+0000 7fa8fa668640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fa8f406dc70 0x7fa8f4159c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:11.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:11.896+0000 7fa8fa668640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa8f41533a0 0x7fa8f40c8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:11.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:11.896+0000 7fa8fa668640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8f40c9810 con 0x7fa8f40c9020 2024-05-04T02:48:11.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:11.896+0000 7fa8fa668640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7fa8f40c8650 con 0x7fa8f406dc70 2024-05-04T02:48:11.897 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:11.896+0000 7fa8fa668640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fa8f40c9af0 con 0x7fa8f41533a0 2024-05-04T02:48:11.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:11.896+0000 7fa8f3fff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fa8f406dc70 0x7fa8f4159c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:11.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:11.897+0000 7fa8f3fff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fa8f406dc70 0x7fa8f4159c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34104/0 (socket says 172.21.15.1:34104) 2024-05-04T02:48:11.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:11.897+0000 7fa8f3fff640 1 -- 172.21.15.1:0/2996801473 learned_addr learned my addr 172.21.15.1:0/2996801473 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:48:11.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:11.900+0000 7fa8f3fff640 1 -- 172.21.15.1:0/2996801473 >> v2:172.21.15.107:3300/0 conn(0x7fa8f41533a0 msgr2=0x7fa8f40c8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:48:11.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:11.900+0000 7fa8f3fff640 1 --2- 172.21.15.1:0/2996801473 >> v2:172.21.15.107:3300/0 conn(0x7fa8f41533a0 0x7fa8f40c8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:11.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:11.900+0000 7fa8f3fff640 1 -- 172.21.15.1:0/2996801473 >> v1:172.21.15.107:6789/0 conn(0x7fa8f40c9020 legacy=0x7fa8f40cd530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:48:11.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:11.900+0000 7fa8f3fff640 1 -- 172.21.15.1:0/2996801473 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8f40c9dd0 con 0x7fa8f406dc70 2024-05-04T02:48:11.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:11.902+0000 7fa8f3fff640 1 --2- 172.21.15.1:0/2996801473 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa8f406dc70 0x7fa8f4159c90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa8f40cafc0 tx=0x7fa8dc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d97eb229b3ce6dba server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:11.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:11.906+0000 7fa8f2ffd640 1 -- 172.21.15.1:0/2996801473 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8dc037070 con 0x7fa8f406dc70 2024-05-04T02:48:11.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:11.906+0000 7fa8f2ffd640 1 -- 172.21.15.1:0/2996801473 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8dc032440 con 0x7fa8f406dc70 2024-05-04T02:48:11.907 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:11.906+0000 7fa8f2ffd640 1 -- 172.21.15.1:0/2996801473 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8dc032810 con 0x7fa8f406dc70 2024-05-04T02:48:11.908 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:11.907+0000 7fa8fa668640 1 -- 172.21.15.1:0/2996801473 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa8f406dc70 msgr2=0x7fa8f4159c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:11.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:11.907+0000 7fa8fa668640 1 --2- 172.21.15.1:0/2996801473 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa8f406dc70 0x7fa8f4159c90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa8f40cafc0 tx=0x7fa8dc02a270 comp rx=0 tx=0).stop 2024-05-04T02:48:11.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:11.907+0000 7fa8fa668640 1 -- 172.21.15.1:0/2996801473 shutdown_connections 2024-05-04T02:48:11.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:11.907+0000 7fa8fa668640 1 --2- 172.21.15.1:0/2996801473 >> v2:172.21.15.107:3300/0 conn(0x7fa8f41533a0 0x7fa8f40c8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:11.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:11.907+0000 7fa8fa668640 1 --2- 172.21.15.1:0/2996801473 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa8f406dc70 0x7fa8f4159c90 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:11.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:11.907+0000 7fa8fa668640 1 -- 172.21.15.1:0/2996801473 >> 172.21.15.1:0/2996801473 conn(0x7fa8f40ca060 msgr2=0x7fa8f40ca470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:48:11.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:11.907+0000 7fa8fa668640 1 -- 172.21.15.1:0/2996801473 shutdown_connections 2024-05-04T02:48:11.909 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:11.907+0000 7fa8fa668640 1 -- 172.21.15.1:0/2996801473 wait complete. 2024-05-04T02:48:11.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:11.909+0000 7fa8fa668640 1 Processor -- start 2024-05-04T02:48:11.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:11.909+0000 7fa8fa668640 1 -- start start 2024-05-04T02:48:11.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:11.910+0000 7fa8fa668640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa8f406dc70 0x7fa8f4153ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:11.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:11.910+0000 7fa8fa668640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa8f40c9020 0x7fa8f41e0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:11.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:11.910+0000 7fa8fa668640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa8f41533a0 0x7fa8f40ccc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:11.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:11.910+0000 7fa8fa668640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f40c7850 con 0x7fa8f406dc70 2024-05-04T02:48:11.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:11.910+0000 7fa8fa668640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f40c82e0 con 0x7fa8f40c9020 2024-05-04T02:48:11.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:11.910+0000 7fa8fa668640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa8f40c4a60 con 0x7fa8f41533a0 2024-05-04T02:48:11.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:11.911+0000 7fa8f3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa8f406dc70 0x7fa8f4153ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:11.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:11.911+0000 7fa8f3fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa8f406dc70 0x7fa8f4153ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:34110/0 (socket says 172.21.15.1:34110) 2024-05-04T02:48:11.912 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:11.911+0000 7fa8f3fff640 1 -- 172.21.15.1:0/3159012913 learned_addr learned my addr 172.21.15.1:0/3159012913 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:48:11.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:11.915+0000 7fa8f3fff640 1 -- 172.21.15.1:0/3159012913 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa8f41533a0 msgr2=0x7fa8f40ccc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:11.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:11.915+0000 7fa8f3fff640 1 --2- 172.21.15.1:0/3159012913 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa8f41533a0 0x7fa8f40ccc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:11.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:11.915+0000 7fa8f3fff640 1 -- 172.21.15.1:0/3159012913 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa8f40c9020 msgr2=0x7fa8f41e0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:11.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:11.915+0000 7fa8f3fff640 1 --2- 172.21.15.1:0/3159012913 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa8f40c9020 0x7fa8f41e0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:11.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:11.915+0000 7fa8f3fff640 1 -- 172.21.15.1:0/3159012913 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8f41ef0a0 con 0x7fa8f406dc70 2024-05-04T02:48:11.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:11.918+0000 7fa8f3fff640 1 --2- 172.21.15.1:0/3159012913 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa8f406dc70 0x7fa8f4153ee0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc02a2b0 tx=0x7fa8dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:11.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:11.922+0000 7fa8f0ff9640 1 -- 172.21.15.1:0/3159012913 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8dc041070 con 0x7fa8f406dc70 2024-05-04T02:48:11.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:11.922+0000 7fa8f0ff9640 1 -- 172.21.15.1:0/3159012913 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8dc03c870 con 0x7fa8f406dc70 2024-05-04T02:48:11.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:11.922+0000 7fa8f0ff9640 1 -- 172.21.15.1:0/3159012913 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8dc037040 con 0x7fa8f406dc70 2024-05-04T02:48:11.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:11.922+0000 7fa8fa668640 1 -- 172.21.15.1:0/3159012913 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8f4154420 con 0x7fa8f406dc70 2024-05-04T02:48:11.923 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:11.922+0000 7fa8fa668640 1 -- 172.21.15.1:0/3159012913 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8f41e0f70 con 0x7fa8f406dc70 2024-05-04T02:48:11.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:11.923+0000 7fa8fa668640 1 -- 172.21.15.1:0/3159012913 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8f4069bc0 con 0x7fa8f406dc70 2024-05-04T02:48:12.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.224+0000 7fa8f0ff9640 1 -- 172.21.15.1:0/3159012913 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa8dc044070 con 0x7fa8f406dc70 2024-05-04T02:48:12.225 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.224+0000 7fa8f0ff9640 1 --2- 172.21.15.1:0/3159012913 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fa8d4076350 0x7fa8d4078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:12.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.225+0000 7fa8f37fe640 1 --2- 172.21.15.1:0/3159012913 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fa8d4076350 0x7fa8d4078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:12.226 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.225+0000 7fa8f37fe640 1 --2- 172.21.15.1:0/3159012913 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fa8d4076350 0x7fa8d4078860 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa8f40ce2a0 tx=0x7fa8e4006be0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:12.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.240+0000 7fa8f0ff9640 1 -- 172.21.15.1:0/3159012913 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5854+0+0 (secure 0 0 0) 0x7fa8dc07d2f0 con 0x7fa8f406dc70 2024-05-04T02:48:12.241 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.240+0000 7fa8f0ff9640 1 -- 172.21.15.1:0/3159012913 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa8dc04b020 con 0x7fa8f406dc70 2024-05-04T02:48:12.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.445+0000 7fa8fa668640 1 -- 172.21.15.1:0/3159012913 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa8f40c9550 con 0x7fa8f406dc70 2024-05-04T02:48:12.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.450+0000 7fa8f0ff9640 1 -- 172.21.15.1:0/3159012913 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7fa8dc081760 con 0x7fa8f406dc70 2024-05-04T02:48:12.451 INFO:teuthology.orchestra.run.smithi001.stderr:listed 0 entries 2024-05-04T02:48:12.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.452+0000 7fa8fa668640 1 -- 172.21.15.1:0/3159012913 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fa8d4076350 msgr2=0x7fa8d4078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:12.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.452+0000 7fa8fa668640 1 --2- 172.21.15.1:0/3159012913 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fa8d4076350 0x7fa8d4078860 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa8f40ce2a0 tx=0x7fa8e4006be0 comp rx=0 tx=0).stop 2024-05-04T02:48:12.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.452+0000 7fa8fa668640 1 -- 172.21.15.1:0/3159012913 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa8f406dc70 msgr2=0x7fa8f4153ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:12.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.453+0000 7fa8fa668640 1 --2- 172.21.15.1:0/3159012913 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa8f406dc70 0x7fa8f4153ee0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc02a2b0 tx=0x7fa8dc0046c0 comp rx=0 tx=0).stop 2024-05-04T02:48:12.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.453+0000 7fa8fa668640 1 -- 172.21.15.1:0/3159012913 shutdown_connections 2024-05-04T02:48:12.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.453+0000 7fa8fa668640 1 --2- 172.21.15.1:0/3159012913 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fa8d4076350 0x7fa8d4078860 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:12.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.453+0000 7fa8fa668640 1 --2- 172.21.15.1:0/3159012913 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa8f41533a0 0x7fa8f40ccc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:12.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.453+0000 7fa8fa668640 1 --2- 172.21.15.1:0/3159012913 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa8f40c9020 0x7fa8f41e0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:12.454 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.453+0000 7fa8fa668640 1 --2- 172.21.15.1:0/3159012913 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa8f406dc70 0x7fa8f4153ee0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:12.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.453+0000 7fa8fa668640 1 -- 172.21.15.1:0/3159012913 >> 172.21.15.1:0/3159012913 conn(0x7fa8f40ca060 msgr2=0x7fa8f4152750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:48:12.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.453+0000 7fa8fa668640 1 -- 172.21.15.1:0/3159012913 shutdown_connections 2024-05-04T02:48:12.455 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.453+0000 7fa8fa668640 1 -- 172.21.15.1:0/3159012913 wait complete. 2024-05-04T02:48:12.465 DEBUG:teuthology.orchestra.run.smithi001:> set -ex 2024-05-04T02:48:12.465 DEBUG:teuthology.orchestra.run.smithi001:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-04T02:48:12.481 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-04T02:48:12.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.634+0000 7f8cd50a8640 1 Processor -- start 2024-05-04T02:48:12.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.634+0000 7f8cd50a8640 1 -- start start 2024-05-04T02:48:12.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.636+0000 7f8cd50a8640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8cd00c6f70 0x7f8cd00ccea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:12.636 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.636+0000 7f8cd50a8640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f8cd00cd3e0 0x7f8cd0166e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:12.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.636+0000 7f8cd50a8640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cd00c69e0 con 0x7f8cd00cdc20 2024-05-04T02:48:12.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.636+0000 7f8cd50a8640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f8cd0160a20 con 0x7f8cd00cd3e0 2024-05-04T02:48:12.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.636+0000 7f8cd50a8640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f8cd0160740 con 0x7f8cd00c6f70 2024-05-04T02:48:12.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.636+0000 7f8cced9d640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f8cd00cdc20 0x7f8cd006c6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:55374/0 (socket says 172.21.15.1:55374) 2024-05-04T02:48:12.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.636+0000 7f8cced9d640 1 -- 172.21.15.1:0/450502065 learned_addr learned my addr 172.21.15.1:0/450502065 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-05-04T02:48:12.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.636+0000 7f8cce59c640 1 --2- 172.21.15.1:0/450502065 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8cd00c6f70 0x7f8cd00ccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:12.638 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.636+0000 7f8ccf59e640 1 --2- 172.21.15.1:0/450502065 >> v2:172.21.15.107:3300/0 conn(0x7f8cd00cd3e0 0x7f8cd0166e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:12.640 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.639+0000 7f8ccdd9b640 1 -- 172.21.15.1:0/450502065 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3933744701 0 0) 0x7f8cd00c69e0 con 0x7f8cd00cdc20 2024-05-04T02:48:12.640 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.639+0000 7f8ccdd9b640 1 -- 172.21.15.1:0/450502065 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8cbc003520 con 0x7f8cd00cdc20 2024-05-04T02:48:12.640 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.639+0000 7f8cce59c640 1 -- 172.21.15.1:0/450502065 >> v2:172.21.15.107:3300/0 conn(0x7f8cd00cd3e0 msgr2=0x7f8cd0166e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:48:12.640 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.639+0000 7f8cce59c640 1 --2- 172.21.15.1:0/450502065 >> v2:172.21.15.107:3300/0 conn(0x7f8cd00cd3e0 0x7f8cd0166e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:12.640 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.639+0000 7f8cce59c640 1 -- 172.21.15.1:0/450502065 >> v1:172.21.15.1:6789/0 conn(0x7f8cd00cdc20 legacy=0x7f8cd006c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:12.640 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.639+0000 7f8cce59c640 1 -- 172.21.15.1:0/450502065 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cd00c77f0 con 0x7f8cd00c6f70 2024-05-04T02:48:12.642 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.641+0000 7f8cce59c640 1 --2- 172.21.15.1:0/450502065 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8cd00c6f70 0x7f8cd00ccea0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8cb80097a0 tx=0x7f8cb802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f324fd84b67022fd server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:12.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.645+0000 7f8ccdd9b640 1 -- 172.21.15.1:0/450502065 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cb8037070 con 0x7f8cd00c6f70 2024-05-04T02:48:12.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.645+0000 7f8ccdd9b640 1 -- 172.21.15.1:0/450502065 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cb8032440 con 0x7f8cd00c6f70 2024-05-04T02:48:12.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.645+0000 7f8ccdd9b640 1 -- 172.21.15.1:0/450502065 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cb8032810 con 0x7f8cd00c6f70 2024-05-04T02:48:12.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.646+0000 7f8cd50a8640 1 -- 172.21.15.1:0/450502065 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8cd00c6f70 msgr2=0x7f8cd00ccea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:12.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.646+0000 7f8cd50a8640 1 --2- 172.21.15.1:0/450502065 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8cd00c6f70 0x7f8cd00ccea0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8cb80097a0 tx=0x7f8cb802a210 comp rx=0 tx=0).stop 2024-05-04T02:48:12.647 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.646+0000 7f8cd50a8640 1 -- 172.21.15.1:0/450502065 shutdown_connections 2024-05-04T02:48:12.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.646+0000 7f8cd50a8640 1 --2- 172.21.15.1:0/450502065 >> v2:172.21.15.107:3300/0 conn(0x7f8cd00cd3e0 0x7f8cd0166e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:12.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.646+0000 7f8cd50a8640 1 --2- 172.21.15.1:0/450502065 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8cd00c6f70 0x7f8cd00ccea0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:12.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.646+0000 7f8cd50a8640 1 -- 172.21.15.1:0/450502065 >> 172.21.15.1:0/450502065 conn(0x7f8cd008e210 msgr2=0x7f8cd00d1960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:48:12.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.646+0000 7f8cd50a8640 1 -- 172.21.15.1:0/450502065 shutdown_connections 2024-05-04T02:48:12.648 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.646+0000 7f8cd50a8640 1 -- 172.21.15.1:0/450502065 wait complete. 2024-05-04T02:48:12.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.648+0000 7f8cd50a8640 1 Processor -- start 2024-05-04T02:48:12.649 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.648+0000 7f8cd50a8640 1 -- start start 2024-05-04T02:48:12.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.649+0000 7f8cd50a8640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8cd00c6f70 0x7f8cd01e8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:12.650 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.649+0000 7f8cd50a8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cd00cd3e0 0x7f8cd01e9050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:12.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.649+0000 7f8cd50a8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8cd00cdc20 0x7f8cd014fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:12.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.649+0000 7f8cd50a8640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8cd00c8090 con 0x7f8cd00cd3e0 2024-05-04T02:48:12.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.649+0000 7f8cd50a8640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f8cd00c7db0 con 0x7f8cd00cdc20 2024-05-04T02:48:12.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.649+0000 7f8cd50a8640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f8cd0160450 con 0x7f8cd00c6f70 2024-05-04T02:48:12.651 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.650+0000 7f8ccf59e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8cd00cdc20 0x7f8cd014fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:12.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.650+0000 7f8cce59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cd00cd3e0 0x7f8cd01e9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:12.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.650+0000 7f8cced9d640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8cd00c6f70 0x7f8cd01e8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:12.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.650+0000 7f8cce59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cd00cd3e0 0x7f8cd01e9050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37742/0 (socket says 172.21.15.1:37742) 2024-05-04T02:48:12.652 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.650+0000 7f8cce59c640 1 -- 172.21.15.1:0/420533551 learned_addr learned my addr 172.21.15.1:0/420533551 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:48:12.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.654+0000 7f8ccf59e640 1 -- 172.21.15.1:0/420533551 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8cd00c6f70 msgr2=0x7f8cd01e8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:12.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.654+0000 7f8ccf59e640 1 --2- 172.21.15.1:0/420533551 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8cd00c6f70 0x7f8cd01e8b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:12.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.654+0000 7f8ccf59e640 1 -- 172.21.15.1:0/420533551 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cd00cd3e0 msgr2=0x7f8cd01e9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:12.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.654+0000 7f8ccf59e640 1 --2- 172.21.15.1:0/420533551 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cd00cd3e0 0x7f8cd01e9050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:12.655 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.654+0000 7f8ccf59e640 1 -- 172.21.15.1:0/420533551 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cd014d910 con 0x7f8cd00cdc20 2024-05-04T02:48:12.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.657+0000 7f8ccf59e640 1 --2- 172.21.15.1:0/420533551 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8cd00cdc20 0x7f8cd014fa70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8cd00b7b70 tx=0x7f8cc000c0c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:12.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.661+0000 7f8cc77fe640 1 -- 172.21.15.1:0/420533551 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cc0018020 con 0x7f8cd00cdc20 2024-05-04T02:48:12.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.661+0000 7f8cc77fe640 1 -- 172.21.15.1:0/420533551 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cc000cc80 con 0x7f8cd00cdc20 2024-05-04T02:48:12.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.661+0000 7f8cd50a8640 1 -- 172.21.15.1:0/420533551 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cd00cbc70 con 0x7f8cd00cdc20 2024-05-04T02:48:12.662 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.661+0000 7f8cc77fe640 1 -- 172.21.15.1:0/420533551 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cc00146c0 con 0x7f8cd00cdc20 2024-05-04T02:48:12.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.661+0000 7f8cd50a8640 1 -- 172.21.15.1:0/420533551 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cd01f25c0 con 0x7f8cd00cdc20 2024-05-04T02:48:12.663 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.662+0000 7f8cd50a8640 1 -- 172.21.15.1:0/420533551 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cd00cc770 con 0x7f8cd00cdc20 2024-05-04T02:48:12.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.943+0000 7f8cc77fe640 1 -- 172.21.15.1:0/420533551 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8cc0005d10 con 0x7f8cd00cdc20 2024-05-04T02:48:12.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.943+0000 7f8cc77fe640 1 --2- 172.21.15.1:0/420533551 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f8cb0076350 0x7f8cb0078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:12.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.943+0000 7f8cced9d640 1 --2- 172.21.15.1:0/420533551 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f8cb0076350 0x7f8cb0078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:12.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.944+0000 7f8cced9d640 1 --2- 172.21.15.1:0/420533551 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f8cb0076350 0x7f8cb0078860 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8cc8005880 tx=0x7f8cc8006aa0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:12.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.947+0000 7f8cc77fe640 1 -- 172.21.15.1:0/420533551 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5854+0+0 (secure 0 0 0) 0x7f8cc005deb0 con 0x7f8cd00cdc20 2024-05-04T02:48:12.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:12.958+0000 7f8cc77fe640 1 -- 172.21.15.1:0/420533551 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8cc0022020 con 0x7f8cd00cdc20 2024-05-04T02:48:13.165 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:13.164+0000 7f8cd50a8640 1 -- 172.21.15.1:0/420533551 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f8cd01f23b0 con 0x7f8cd00cdc20 2024-05-04T02:48:13.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:13.170+0000 7f8cc77fe640 1 -- 172.21.15.1:0/420533551 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7f8cc0010040 con 0x7f8cd00cdc20 2024-05-04T02:48:13.171 INFO:teuthology.orchestra.run.smithi001.stderr:listed 0 entries 2024-05-04T02:48:13.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:13.172+0000 7f8cd50a8640 1 -- 172.21.15.1:0/420533551 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f8cb0076350 msgr2=0x7f8cb0078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:13.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:13.172+0000 7f8cd50a8640 1 --2- 172.21.15.1:0/420533551 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f8cb0076350 0x7f8cb0078860 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8cc8005880 tx=0x7f8cc8006aa0 comp rx=0 tx=0).stop 2024-05-04T02:48:13.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:13.173+0000 7f8cd50a8640 1 -- 172.21.15.1:0/420533551 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8cd00cdc20 msgr2=0x7f8cd014fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:13.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:13.173+0000 7f8cd50a8640 1 --2- 172.21.15.1:0/420533551 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8cd00cdc20 0x7f8cd014fa70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8cd00b7b70 tx=0x7f8cc000c0c0 comp rx=0 tx=0).stop 2024-05-04T02:48:13.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:13.173+0000 7f8cd50a8640 1 -- 172.21.15.1:0/420533551 shutdown_connections 2024-05-04T02:48:13.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:13.173+0000 7f8cd50a8640 1 --2- 172.21.15.1:0/420533551 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f8cb0076350 0x7f8cb0078860 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:13.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:13.173+0000 7f8cd50a8640 1 --2- 172.21.15.1:0/420533551 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8cd00cdc20 0x7f8cd014fa70 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:13.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:13.173+0000 7f8cd50a8640 1 --2- 172.21.15.1:0/420533551 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8cd00cd3e0 0x7f8cd01e9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:13.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:13.173+0000 7f8cd50a8640 1 --2- 172.21.15.1:0/420533551 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8cd00c6f70 0x7f8cd01e8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:13.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:13.173+0000 7f8cd50a8640 1 -- 172.21.15.1:0/420533551 >> 172.21.15.1:0/420533551 conn(0x7f8cd008e210 msgr2=0x7f8cd006c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:48:13.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:13.173+0000 7f8cd50a8640 1 -- 172.21.15.1:0/420533551 shutdown_connections 2024-05-04T02:48:13.175 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:13.173+0000 7f8cd50a8640 1 -- 172.21.15.1:0/420533551 wait complete. 2024-05-04T02:48:13.185 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi001.front.sepia.ceph.com... 2024-05-04T02:48:13.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T02:48:13.186 DEBUG:teuthology.orchestra.run.smithi001:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-05-04T02:48:13.210 INFO:teuthology.orchestra.run:waiting for 300 2024-05-04T02:48:13.235 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi001.stderr:ceph-fuse[41971]: fuse finished with error 0 and tester_r 0 2024-05-04T02:48:13.841 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi001.stderr:==00:00:27:32.680 41971== 2024-05-04T02:48:13.841 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi001.stderr:==00:00:27:32.680 41971== Exit program on first error (--exit-on-first-error=yes) 2024-05-04T02:48:14.007 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi001.stderr:daemon-helper: command failed with exit status 42 2024-05-04T02:48:19.312 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-05-04T02:48:19.312 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi001.front.sepia.ceph.com 2024-05-04T02:48:19.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T02:48:19.312 DEBUG:teuthology.orchestra.run.smithi001:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-04T02:48:19.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T02:48:19.343 DEBUG:teuthology.orchestra.run.smithi001:> ip netns list 2024-05-04T02:48:19.403 INFO:teuthology.orchestra.run.smithi001.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-04T02:48:19.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T02:48:19.403 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-04T02:48:19.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-04T02:48:19.473 DEBUG:teuthology.orchestra.run.smithi001:> sudo ip link delete ceph-brx 2024-05-04T02:48:19.571 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-05-04T02:48:19.580 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-04T02:48:19.580 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-04T02:48:19.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:19.736+0000 7fa891cd9640 1 Processor -- start 2024-05-04T02:48:19.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:19.736+0000 7fa891cd9640 1 -- start start 2024-05-04T02:48:19.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:19.737+0000 7fa891cd9640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fa88c0cde50 0x7fa88c15cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:19.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:19.737+0000 7fa891cd9640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa88c0c7da0 0x7fa88c06c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:19.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:19.737+0000 7fa891cd9640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fa88c0cc590 0x7fa88c0cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:19.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:19.737+0000 7fa891cd9640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7fa88c0c7070 con 0x7fa88c0cde50 2024-05-04T02:48:19.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:19.737+0000 7fa891cd9640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fa88c0cd6c0 con 0x7fa88c0cc590 2024-05-04T02:48:19.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:19.737+0000 7fa891cd9640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa88c06cc30 con 0x7fa88c0c7da0 2024-05-04T02:48:19.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:19.738+0000 7fa88affd640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa88c0c7da0 0x7fa88c06c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:19.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:19.738+0000 7fa88affd640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa88c0c7da0 0x7fa88c06c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.1:39456/0 (socket says 172.21.15.1:39456) 2024-05-04T02:48:19.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:19.738+0000 7fa88affd640 1 -- 172.21.15.1:0/3050811344 learned_addr learned my addr 172.21.15.1:0/3050811344 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:48:19.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:19.740+0000 7fa88b7fe640 1 --2- 172.21.15.1:0/3050811344 >> v2:172.21.15.1:3300/0 conn(0x7fa88c0cde50 0x7fa88c15cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:19.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:19.742+0000 7fa88affd640 1 -- 172.21.15.1:0/3050811344 >> v2:172.21.15.107:3300/0 conn(0x7fa88c0cc590 msgr2=0x7fa88c0cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:48:19.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:19.742+0000 7fa88affd640 1 --2- 172.21.15.1:0/3050811344 >> v2:172.21.15.107:3300/0 conn(0x7fa88c0cc590 0x7fa88c0cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:19.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:19.742+0000 7fa88affd640 1 -- 172.21.15.1:0/3050811344 >> v2:172.21.15.1:3300/0 conn(0x7fa88c0cde50 msgr2=0x7fa88c15cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:48:19.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:19.742+0000 7fa88affd640 1 --2- 172.21.15.1:0/3050811344 >> v2:172.21.15.1:3300/0 conn(0x7fa88c0cde50 0x7fa88c15cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:19.743 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:19.742+0000 7fa88affd640 1 -- 172.21.15.1:0/3050811344 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa88c0cd980 con 0x7fa88c0c7da0 2024-05-04T02:48:19.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:19.745+0000 7fa88affd640 1 --2- 172.21.15.1:0/3050811344 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa88c0c7da0 0x7fa88c06c6f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa88c15a070 tx=0x7fa87402a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1588d264bd36d7f0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:19.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:19.826+0000 7fa88a7fc640 1 -- 172.21.15.1:0/3050811344 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa874037070 con 0x7fa88c0c7da0 2024-05-04T02:48:19.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:19.826+0000 7fa88a7fc640 1 -- 172.21.15.1:0/3050811344 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa874032440 con 0x7fa88c0c7da0 2024-05-04T02:48:19.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:19.826+0000 7fa88a7fc640 1 -- 172.21.15.1:0/3050811344 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa874032810 con 0x7fa88c0c7da0 2024-05-04T02:48:19.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:19.826+0000 7fa891cd9640 1 -- 172.21.15.1:0/3050811344 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa88c0c7da0 msgr2=0x7fa88c06c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:19.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:19.826+0000 7fa891cd9640 1 --2- 172.21.15.1:0/3050811344 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa88c0c7da0 0x7fa88c06c6f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa88c15a070 tx=0x7fa87402a270 comp rx=0 tx=0).stop 2024-05-04T02:48:19.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:19.827+0000 7fa891cd9640 1 -- 172.21.15.1:0/3050811344 shutdown_connections 2024-05-04T02:48:19.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:19.827+0000 7fa891cd9640 1 --2- 172.21.15.1:0/3050811344 >> v2:172.21.15.107:3300/0 conn(0x7fa88c0cc590 0x7fa88c0cc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:19.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:19.827+0000 7fa891cd9640 1 --2- 172.21.15.1:0/3050811344 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa88c0c7da0 0x7fa88c06c6f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:19.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:19.827+0000 7fa891cd9640 1 --2- 172.21.15.1:0/3050811344 >> v2:172.21.15.1:3300/0 conn(0x7fa88c0cde50 0x7fa88c15cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:19.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:19.827+0000 7fa891cd9640 1 -- 172.21.15.1:0/3050811344 >> 172.21.15.1:0/3050811344 conn(0x7fa88c0d2590 msgr2=0x7fa88c0ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:48:19.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:19.827+0000 7fa891cd9640 1 -- 172.21.15.1:0/3050811344 shutdown_connections 2024-05-04T02:48:19.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:19.827+0000 7fa891cd9640 1 -- 172.21.15.1:0/3050811344 wait complete. 2024-05-04T02:48:19.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:19.829+0000 7fa891cd9640 1 Processor -- start 2024-05-04T02:48:19.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:19.829+0000 7fa891cd9640 1 -- start start 2024-05-04T02:48:19.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:19.830+0000 7fa891cd9640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa88c0c7da0 0x7fa88c155240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:19.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:19.830+0000 7fa891cd9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa88c0cc590 0x7fa88c0cb620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:19.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:19.830+0000 7fa891cd9640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa88c15fcb0 0x7fa88c1520d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:19.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:19.830+0000 7fa891cd9640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa88c0c7880 con 0x7fa88c0c7da0 2024-05-04T02:48:19.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:19.830+0000 7fa891cd9640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa88c0c75a0 con 0x7fa88c0cc590 2024-05-04T02:48:19.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:19.830+0000 7fa891cd9640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa88c156b40 con 0x7fa88c15fcb0 2024-05-04T02:48:19.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:19.831+0000 7fa88b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa88c0c7da0 0x7fa88c155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:19.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:19.831+0000 7fa88bfff640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa88c15fcb0 0x7fa88c1520d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:19.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:19.831+0000 7fa88affd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa88c0cc590 0x7fa88c0cb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:19.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:19.831+0000 7fa88b7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa88c0c7da0 0x7fa88c155240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37760/0 (socket says 172.21.15.1:37760) 2024-05-04T02:48:19.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:19.831+0000 7fa88b7fe640 1 -- 172.21.15.1:0/3257649078 learned_addr learned my addr 172.21.15.1:0/3257649078 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:48:19.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:19.835+0000 7fa88b7fe640 1 -- 172.21.15.1:0/3257649078 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa88c15fcb0 msgr2=0x7fa88c1520d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:19.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:19.835+0000 7fa88b7fe640 1 --2- 172.21.15.1:0/3257649078 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa88c15fcb0 0x7fa88c1520d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:19.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:19.835+0000 7fa88b7fe640 1 -- 172.21.15.1:0/3257649078 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa88c0cc590 msgr2=0x7fa88c0cb620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:19.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:19.835+0000 7fa88b7fe640 1 --2- 172.21.15.1:0/3257649078 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa88c0cc590 0x7fa88c0cb620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:19.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:19.835+0000 7fa88b7fe640 1 -- 172.21.15.1:0/3257649078 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa88c157630 con 0x7fa88c0c7da0 2024-05-04T02:48:19.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:19.838+0000 7fa88b7fe640 1 --2- 172.21.15.1:0/3257649078 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa88c0c7da0 0x7fa88c155240 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa87c00e870 tx=0x7fa87c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:19.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:19.842+0000 7fa883fff640 1 -- 172.21.15.1:0/3257649078 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa87c017070 con 0x7fa88c0c7da0 2024-05-04T02:48:19.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:19.842+0000 7fa883fff640 1 -- 172.21.15.1:0/3257649078 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa87c00c940 con 0x7fa88c0c7da0 2024-05-04T02:48:19.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:19.842+0000 7fa891cd9640 1 -- 172.21.15.1:0/3257649078 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa88c155780 con 0x7fa88c0c7da0 2024-05-04T02:48:19.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:19.842+0000 7fa883fff640 1 -- 172.21.15.1:0/3257649078 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa87c00cd10 con 0x7fa88c0c7da0 2024-05-04T02:48:19.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:19.842+0000 7fa891cd9640 1 -- 172.21.15.1:0/3257649078 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa88c157070 con 0x7fa88c0c7da0 2024-05-04T02:48:19.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:19.843+0000 7fa891cd9640 1 -- 172.21.15.1:0/3257649078 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa88c069bc0 con 0x7fa88c0c7da0 2024-05-04T02:48:19.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:19.867+0000 7fa883fff640 1 -- 172.21.15.1:0/3257649078 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa87c01a070 con 0x7fa88c0c7da0 2024-05-04T02:48:19.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:19.867+0000 7fa883fff640 1 --2- 172.21.15.1:0/3257649078 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fa86c076320 0x7fa86c078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:19.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:19.868+0000 7fa88affd640 1 --2- 172.21.15.1:0/3257649078 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fa86c076320 0x7fa86c078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:19.870 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:19.868+0000 7fa88affd640 1 --2- 172.21.15.1:0/3257649078 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fa86c076320 0x7fa86c078830 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa874034000 tx=0x7fa87402e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:19.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:19.871+0000 7fa883fff640 1 -- 172.21.15.1:0/3257649078 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5854+0+0 (secure 0 0 0) 0x7fa87c05d1b0 con 0x7fa88c0c7da0 2024-05-04T02:48:20.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:20.155+0000 7fa883fff640 1 -- 172.21.15.1:0/3257649078 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa88c157630 con 0x7fa88c0c7da0 2024-05-04T02:48:20.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:20.344+0000 7fa891cd9640 1 -- 172.21.15.1:0/3257649078 --> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa88c0c6c40 con 0x7fa86c076320 2024-05-04T02:48:20.352 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:20.352+0000 7fa883fff640 1 -- 172.21.15.1:0/3257649078 <== mgr.4108 v2:172.21.15.107:6800/3809222574 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+253080 (secure 0 0 0) 0x7fa88c0c6c40 con 0x7fa86c076320 2024-05-04T02:48:20.355 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:48:20.361 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-05-04T02:48:20.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:20.354+0000 7fa891cd9640 1 -- 172.21.15.1:0/3257649078 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fa86c076320 msgr2=0x7fa86c078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:20.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:20.354+0000 7fa891cd9640 1 --2- 172.21.15.1:0/3257649078 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fa86c076320 0x7fa86c078830 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa874034000 tx=0x7fa87402e000 comp rx=0 tx=0).stop 2024-05-04T02:48:20.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:20.354+0000 7fa891cd9640 1 -- 172.21.15.1:0/3257649078 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa88c0c7da0 msgr2=0x7fa88c155240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:20.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:20.354+0000 7fa891cd9640 1 --2- 172.21.15.1:0/3257649078 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa88c0c7da0 0x7fa88c155240 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa87c00e870 tx=0x7fa87c00ed30 comp rx=0 tx=0).stop 2024-05-04T02:48:20.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:20.354+0000 7fa891cd9640 1 -- 172.21.15.1:0/3257649078 shutdown_connections 2024-05-04T02:48:20.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:20.354+0000 7fa891cd9640 1 --2- 172.21.15.1:0/3257649078 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fa86c076320 0x7fa86c078830 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:20.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:20.354+0000 7fa891cd9640 1 --2- 172.21.15.1:0/3257649078 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa88c15fcb0 0x7fa88c1520d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:20.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:20.354+0000 7fa891cd9640 1 --2- 172.21.15.1:0/3257649078 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa88c0cc590 0x7fa88c0cb620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:20.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:20.354+0000 7fa891cd9640 1 --2- 172.21.15.1:0/3257649078 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa88c0c7da0 0x7fa88c155240 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:20.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:20.354+0000 7fa891cd9640 1 -- 172.21.15.1:0/3257649078 >> 172.21.15.1:0/3257649078 conn(0x7fa88c0d2590 msgr2=0x7fa88c0cc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:48:20.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:20.355+0000 7fa891cd9640 1 -- 172.21.15.1:0/3257649078 shutdown_connections 2024-05-04T02:48:20.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:20.355+0000 7fa891cd9640 1 -- 172.21.15.1:0/3257649078 wait complete. 2024-05-04T02:48:20.368 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":869,"stamp":"2024-05-04T02:48:19.514064+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":38130963,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":907,"num_read_kb":952,"num_write":14340,"num_write_kb":337389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13312,"ondisk_log_size":13312,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":361760,"kb_used_data":49888,"kb_used_omap":12,"kb_used_meta":311795,"kb_avail":754612960,"statfs":{"total":773094113280,"available":772723671040,"internally_reserved":0,"allocated":51085312,"data_stored":77036366,"data_compressed":7561304,"data_compressed_allocated":11436032,"data_compressed_original":38748160,"omap_allocated":12752,"internal_metadata":319278640},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":137460,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":47,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004187"},"pg_stats":[{"pgid":"3.3f","version":"25'66","reported_seq":89,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.484191+0000","last_change":"2024-05-04T02:20:53.380646+0000","last_active":"2024-05-04T02:48:13.484191+0000","last_peered":"2024-05-04T02:48:13.484191+0000","last_clean":"2024-05-04T02:48:13.484191+0000","last_became_active":"2024-05-04T02:20:53.380291+0000","last_became_peered":"2024-05-04T02:20:53.380291+0000","last_unstale":"2024-05-04T02:48:13.484191+0000","last_undegraded":"2024-05-04T02:48:13.484191+0000","last_fullsized":"2024-05-04T02:48:13.484191+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:40:37.553293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":3382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3e","version":"25'82","reported_seq":116,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.481403+0000","last_change":"2024-05-04T02:20:15.299265+0000","last_active":"2024-05-04T02:48:13.481403+0000","last_peered":"2024-05-04T02:48:13.481403+0000","last_clean":"2024-05-04T02:48:13.481403+0000","last_became_active":"2024-05-04T02:20:15.298956+0000","last_became_peered":"2024-05-04T02:20:15.298956+0000","last_unstale":"2024-05-04T02:48:13.481403+0000","last_undegraded":"2024-05-04T02:48:13.481403+0000","last_fullsized":"2024-05-04T02:48:13.481403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:23:25.157473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":2093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"25'86","reported_seq":120,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.710579+0000","last_change":"2024-05-04T02:20:15.297447+0000","last_active":"2024-05-04T02:48:13.710579+0000","last_peered":"2024-05-04T02:48:13.710579+0000","last_clean":"2024-05-04T02:48:13.710579+0000","last_became_active":"2024-05-04T02:20:15.297150+0000","last_became_peered":"2024-05-04T02:20:15.297150+0000","last_unstale":"2024-05-04T02:48:13.710579+0000","last_undegraded":"2024-05-04T02:48:13.710579+0000","last_fullsized":"2024-05-04T02:48:13.710579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:10:27.059401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":4094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"25'50","reported_seq":84,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.527559+0000","last_change":"2024-05-04T02:20:15.301427+0000","last_active":"2024-05-04T02:48:13.527559+0000","last_peered":"2024-05-04T02:48:13.527559+0000","last_clean":"2024-05-04T02:48:13.527559+0000","last_became_active":"2024-05-04T02:20:15.301113+0000","last_became_peered":"2024-05-04T02:20:15.301113+0000","last_unstale":"2024-05-04T02:48:13.527559+0000","last_undegraded":"2024-05-04T02:48:13.527559+0000","last_fullsized":"2024-05-04T02:48:13.527559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:06:48.185771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":1582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"25'54","reported_seq":86,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.604371+0000","last_change":"2024-05-04T02:20:15.297817+0000","last_active":"2024-05-04T02:48:13.604371+0000","last_peered":"2024-05-04T02:48:13.604371+0000","last_clean":"2024-05-04T02:48:13.604371+0000","last_became_active":"2024-05-04T02:20:15.297511+0000","last_became_peered":"2024-05-04T02:20:15.297511+0000","last_unstale":"2024-05-04T02:48:13.604371+0000","last_undegraded":"2024-05-04T02:48:13.604371+0000","last_fullsized":"2024-05-04T02:48:13.604371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:33:31.416768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":3466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"25'86","reported_seq":118,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.524090+0000","last_change":"2024-05-04T02:20:15.306853+0000","last_active":"2024-05-04T02:48:13.524090+0000","last_peered":"2024-05-04T02:48:13.524090+0000","last_clean":"2024-05-04T02:48:13.524090+0000","last_became_active":"2024-05-04T02:20:15.306537+0000","last_became_peered":"2024-05-04T02:20:15.306537+0000","last_unstale":"2024-05-04T02:48:13.524090+0000","last_undegraded":"2024-05-04T02:48:13.524090+0000","last_fullsized":"2024-05-04T02:48:13.524090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:35:15.732585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":4281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"25'87","reported_seq":119,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.615849+0000","last_change":"2024-05-04T02:20:15.299499+0000","last_active":"2024-05-04T02:48:13.615849+0000","last_peered":"2024-05-04T02:48:13.615849+0000","last_clean":"2024-05-04T02:48:13.615849+0000","last_became_active":"2024-05-04T02:20:15.299177+0000","last_became_peered":"2024-05-04T02:20:15.299177+0000","last_unstale":"2024-05-04T02:48:13.615849+0000","last_undegraded":"2024-05-04T02:48:13.615849+0000","last_fullsized":"2024-05-04T02:48:13.615849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:13:25.600467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75,"num_write_kb":3160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"25'62","reported_seq":94,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.571271+0000","last_change":"2024-05-04T02:20:15.306964+0000","last_active":"2024-05-04T02:48:13.571271+0000","last_peered":"2024-05-04T02:48:13.571271+0000","last_clean":"2024-05-04T02:48:13.571271+0000","last_became_active":"2024-05-04T02:20:15.306663+0000","last_became_peered":"2024-05-04T02:20:15.306663+0000","last_unstale":"2024-05-04T02:48:13.571271+0000","last_undegraded":"2024-05-04T02:48:13.571271+0000","last_fullsized":"2024-05-04T02:48:13.571271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:52:22.299082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":4413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"25'72","reported_seq":104,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.608102+0000","last_change":"2024-05-04T02:20:15.303354+0000","last_active":"2024-05-04T02:48:13.608102+0000","last_peered":"2024-05-04T02:48:13.608102+0000","last_clean":"2024-05-04T02:48:13.608102+0000","last_became_active":"2024-05-04T02:20:15.303055+0000","last_became_peered":"2024-05-04T02:20:15.303055+0000","last_unstale":"2024-05-04T02:48:13.608102+0000","last_undegraded":"2024-05-04T02:48:13.608102+0000","last_fullsized":"2024-05-04T02:48:13.608102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:22:30.839899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":5860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"25'70","reported_seq":102,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.625591+0000","last_change":"2024-05-04T02:20:15.307433+0000","last_active":"2024-05-04T02:48:13.625591+0000","last_peered":"2024-05-04T02:48:13.625591+0000","last_clean":"2024-05-04T02:48:13.625591+0000","last_became_active":"2024-05-04T02:20:15.307124+0000","last_became_peered":"2024-05-04T02:20:15.307124+0000","last_unstale":"2024-05-04T02:48:13.625591+0000","last_undegraded":"2024-05-04T02:48:13.625591+0000","last_fullsized":"2024-05-04T02:48:13.625591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:22:04.903746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":2059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"25'65","reported_seq":97,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.618354+0000","last_change":"2024-05-04T02:20:15.306714+0000","last_active":"2024-05-04T02:48:13.618354+0000","last_peered":"2024-05-04T02:48:13.618354+0000","last_clean":"2024-05-04T02:48:13.618354+0000","last_became_active":"2024-05-04T02:20:15.306409+0000","last_became_peered":"2024-05-04T02:20:15.306409+0000","last_unstale":"2024-05-04T02:48:13.618354+0000","last_undegraded":"2024-05-04T02:48:13.618354+0000","last_fullsized":"2024-05-04T02:48:13.618354+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:51:58.828664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"25'50","reported_seq":82,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.521353+0000","last_change":"2024-05-04T02:20:15.296940+0000","last_active":"2024-05-04T02:48:13.521353+0000","last_peered":"2024-05-04T02:48:13.521353+0000","last_clean":"2024-05-04T02:48:13.521353+0000","last_became_active":"2024-05-04T02:20:15.296640+0000","last_became_peered":"2024-05-04T02:20:15.296640+0000","last_unstale":"2024-05-04T02:48:13.521353+0000","last_undegraded":"2024-05-04T02:48:13.521353+0000","last_fullsized":"2024-05-04T02:48:13.521353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:25:44.598454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":2327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"25'84","reported_seq":116,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.572426+0000","last_change":"2024-05-04T02:20:15.294287+0000","last_active":"2024-05-04T02:48:13.572426+0000","last_peered":"2024-05-04T02:48:13.572426+0000","last_clean":"2024-05-04T02:48:13.572426+0000","last_became_active":"2024-05-04T02:20:15.293909+0000","last_became_peered":"2024-05-04T02:20:15.293909+0000","last_unstale":"2024-05-04T02:48:13.572426+0000","last_undegraded":"2024-05-04T02:48:13.572426+0000","last_fullsized":"2024-05-04T02:48:13.572426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:31:26.635672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":6748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"25'70","reported_seq":103,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.711912+0000","last_change":"2024-05-04T02:20:15.293837+0000","last_active":"2024-05-04T02:48:13.711912+0000","last_peered":"2024-05-04T02:48:13.711912+0000","last_clean":"2024-05-04T02:48:13.711912+0000","last_became_active":"2024-05-04T02:20:15.293550+0000","last_became_peered":"2024-05-04T02:20:15.293550+0000","last_unstale":"2024-05-04T02:48:13.711912+0000","last_undegraded":"2024-05-04T02:48:13.711912+0000","last_fullsized":"2024-05-04T02:48:13.711912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:55:35.975972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":6468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"25'94","reported_seq":127,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.488175+0000","last_change":"2024-05-04T02:20:15.306005+0000","last_active":"2024-05-04T02:48:13.488175+0000","last_peered":"2024-05-04T02:48:13.488175+0000","last_clean":"2024-05-04T02:48:13.488175+0000","last_became_active":"2024-05-04T02:20:15.305549+0000","last_became_peered":"2024-05-04T02:20:15.305549+0000","last_unstale":"2024-05-04T02:48:13.488175+0000","last_undegraded":"2024-05-04T02:48:13.488175+0000","last_fullsized":"2024-05-04T02:48:13.488175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:58:55.400048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":3628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"25'80","reported_seq":113,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.527476+0000","last_change":"2024-05-04T02:20:15.305322+0000","last_active":"2024-05-04T02:48:13.527476+0000","last_peered":"2024-05-04T02:48:13.527476+0000","last_clean":"2024-05-04T02:48:13.527476+0000","last_became_active":"2024-05-04T02:20:15.301515+0000","last_became_peered":"2024-05-04T02:20:15.301515+0000","last_unstale":"2024-05-04T02:48:13.527476+0000","last_undegraded":"2024-05-04T02:48:13.527476+0000","last_fullsized":"2024-05-04T02:48:13.527476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:10:21.048301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":4426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"25'78","reported_seq":111,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.529144+0000","last_change":"2024-05-04T02:20:15.301042+0000","last_active":"2024-05-04T02:48:13.529144+0000","last_peered":"2024-05-04T02:48:13.529144+0000","last_clean":"2024-05-04T02:48:13.529144+0000","last_became_active":"2024-05-04T02:20:15.300707+0000","last_became_peered":"2024-05-04T02:20:15.300707+0000","last_unstale":"2024-05-04T02:48:13.529144+0000","last_undegraded":"2024-05-04T02:48:13.529144+0000","last_fullsized":"2024-05-04T02:48:13.529144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:36:19.111702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":4257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"25'87","reported_seq":120,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.492002+0000","last_change":"2024-05-04T02:20:15.292059+0000","last_active":"2024-05-04T02:48:13.492002+0000","last_peered":"2024-05-04T02:48:13.492002+0000","last_clean":"2024-05-04T02:48:13.492002+0000","last_became_active":"2024-05-04T02:20:15.291766+0000","last_became_peered":"2024-05-04T02:20:15.291766+0000","last_unstale":"2024-05-04T02:48:13.492002+0000","last_undegraded":"2024-05-04T02:48:13.492002+0000","last_fullsized":"2024-05-04T02:48:13.492002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:49:41.728826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":5570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"25'65","reported_seq":98,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.604751+0000","last_change":"2024-05-04T02:20:15.297861+0000","last_active":"2024-05-04T02:48:13.604751+0000","last_peered":"2024-05-04T02:48:13.604751+0000","last_clean":"2024-05-04T02:48:13.604751+0000","last_became_active":"2024-05-04T02:20:15.297568+0000","last_became_peered":"2024-05-04T02:20:15.297568+0000","last_unstale":"2024-05-04T02:48:13.604751+0000","last_undegraded":"2024-05-04T02:48:13.604751+0000","last_fullsized":"2024-05-04T02:48:13.604751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:52:52.278453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":4387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"25'89","reported_seq":122,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.619958+0000","last_change":"2024-05-04T02:20:15.303036+0000","last_active":"2024-05-04T02:48:13.619958+0000","last_peered":"2024-05-04T02:48:13.619958+0000","last_clean":"2024-05-04T02:48:13.619958+0000","last_became_active":"2024-05-04T02:20:15.302743+0000","last_became_peered":"2024-05-04T02:20:15.302743+0000","last_unstale":"2024-05-04T02:48:13.619958+0000","last_undegraded":"2024-05-04T02:48:13.619958+0000","last_fullsized":"2024-05-04T02:48:13.619958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:58:55.400048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75,"num_write_kb":8052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"25'110","reported_seq":143,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.677669+0000","last_change":"2024-05-04T02:20:15.300987+0000","last_active":"2024-05-04T02:48:13.677669+0000","last_peered":"2024-05-04T02:48:13.677669+0000","last_clean":"2024-05-04T02:48:13.677669+0000","last_became_active":"2024-05-04T02:20:15.300709+0000","last_became_peered":"2024-05-04T02:20:15.300709+0000","last_unstale":"2024-05-04T02:48:13.677669+0000","last_undegraded":"2024-05-04T02:48:13.677669+0000","last_fullsized":"2024-05-04T02:48:13.677669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:15:46.319755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":9218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"25'64","reported_seq":97,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.528965+0000","last_change":"2024-05-04T02:20:15.301545+0000","last_active":"2024-05-04T02:48:13.528965+0000","last_peered":"2024-05-04T02:48:13.528965+0000","last_clean":"2024-05-04T02:48:13.528965+0000","last_became_active":"2024-05-04T02:20:15.300848+0000","last_became_peered":"2024-05-04T02:20:15.300848+0000","last_unstale":"2024-05-04T02:48:13.528965+0000","last_undegraded":"2024-05-04T02:48:13.528965+0000","last_fullsized":"2024-05-04T02:48:13.528965+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:26:17.650165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":2229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"25'75","reported_seq":108,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.567290+0000","last_change":"2024-05-04T02:20:15.302188+0000","last_active":"2024-05-04T02:48:13.567290+0000","last_peered":"2024-05-04T02:48:13.567290+0000","last_clean":"2024-05-04T02:48:13.567290+0000","last_became_active":"2024-05-04T02:20:15.301879+0000","last_became_peered":"2024-05-04T02:20:15.301879+0000","last_unstale":"2024-05-04T02:48:13.567290+0000","last_undegraded":"2024-05-04T02:48:13.567290+0000","last_fullsized":"2024-05-04T02:48:13.567290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:51:58.828664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":4046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"25'55","reported_seq":77,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.486920+0000","last_change":"2024-05-04T02:20:53.115860+0000","last_active":"2024-05-04T02:48:13.486920+0000","last_peered":"2024-05-04T02:48:13.486920+0000","last_clean":"2024-05-04T02:48:13.486920+0000","last_became_active":"2024-05-04T02:20:53.115499+0000","last_became_peered":"2024-05-04T02:20:53.115499+0000","last_unstale":"2024-05-04T02:48:13.486920+0000","last_undegraded":"2024-05-04T02:48:13.486920+0000","last_fullsized":"2024-05-04T02:48:13.486920+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:48:25.169824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":4120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"25'84","reported_seq":117,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.543660+0000","last_change":"2024-05-04T02:20:15.301659+0000","last_active":"2024-05-04T02:48:13.543660+0000","last_peered":"2024-05-04T02:48:13.543660+0000","last_clean":"2024-05-04T02:48:13.543660+0000","last_became_active":"2024-05-04T02:20:15.301363+0000","last_became_peered":"2024-05-04T02:20:15.301363+0000","last_unstale":"2024-05-04T02:48:13.543660+0000","last_undegraded":"2024-05-04T02:48:13.543660+0000","last_fullsized":"2024-05-04T02:48:13.543660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:23:25.157473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":4697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"25'75","reported_seq":108,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.623404+0000","last_change":"2024-05-04T02:20:15.295843+0000","last_active":"2024-05-04T02:48:13.623404+0000","last_peered":"2024-05-04T02:48:13.623404+0000","last_clean":"2024-05-04T02:48:13.623404+0000","last_became_active":"2024-05-04T02:20:15.295577+0000","last_became_peered":"2024-05-04T02:20:15.295577+0000","last_unstale":"2024-05-04T02:48:13.623404+0000","last_undegraded":"2024-05-04T02:48:13.623404+0000","last_fullsized":"2024-05-04T02:48:13.623404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:23:25.157473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":3524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"25'87","reported_seq":120,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.488294+0000","last_change":"2024-05-04T02:20:15.299661+0000","last_active":"2024-05-04T02:48:13.488294+0000","last_peered":"2024-05-04T02:48:13.488294+0000","last_clean":"2024-05-04T02:48:13.488294+0000","last_became_active":"2024-05-04T02:20:15.299230+0000","last_became_peered":"2024-05-04T02:20:15.299230+0000","last_unstale":"2024-05-04T02:48:13.488294+0000","last_undegraded":"2024-05-04T02:48:13.488294+0000","last_fullsized":"2024-05-04T02:48:13.488294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:51:58.828664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":4545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"25'51","reported_seq":84,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.572483+0000","last_change":"2024-05-04T02:20:15.302719+0000","last_active":"2024-05-04T02:48:13.572483+0000","last_peered":"2024-05-04T02:48:13.572483+0000","last_clean":"2024-05-04T02:48:13.572483+0000","last_became_active":"2024-05-04T02:20:15.302456+0000","last_became_peered":"2024-05-04T02:20:15.302456+0000","last_unstale":"2024-05-04T02:48:13.572483+0000","last_undegraded":"2024-05-04T02:48:13.572483+0000","last_fullsized":"2024-05-04T02:48:13.572483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:06:48.185771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":7049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"25'65","reported_seq":99,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.676535+0000","last_change":"2024-05-04T02:20:15.296567+0000","last_active":"2024-05-04T02:48:13.676535+0000","last_peered":"2024-05-04T02:48:13.676535+0000","last_clean":"2024-05-04T02:48:13.676535+0000","last_became_active":"2024-05-04T02:20:15.296235+0000","last_became_peered":"2024-05-04T02:20:15.296235+0000","last_unstale":"2024-05-04T02:48:13.676535+0000","last_undegraded":"2024-05-04T02:48:13.676535+0000","last_fullsized":"2024-05-04T02:48:13.676535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:32:20.652776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":6740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"25'135","reported_seq":158,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.482735+0000","last_change":"2024-05-04T02:20:53.116445+0000","last_active":"2024-05-04T02:48:13.482735+0000","last_peered":"2024-05-04T02:48:13.482735+0000","last_clean":"2024-05-04T02:48:13.482735+0000","last_became_active":"2024-05-04T02:20:53.116069+0000","last_became_peered":"2024-05-04T02:20:53.116069+0000","last_unstale":"2024-05-04T02:48:13.482735+0000","last_undegraded":"2024-05-04T02:48:13.482735+0000","last_fullsized":"2024-05-04T02:48:13.482735+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:57:11.656812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":7251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"25'77","reported_seq":111,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.488795+0000","last_change":"2024-05-04T02:20:15.301739+0000","last_active":"2024-05-04T02:48:13.488795+0000","last_peered":"2024-05-04T02:48:13.488795+0000","last_clean":"2024-05-04T02:48:13.488795+0000","last_became_active":"2024-05-04T02:20:15.301424+0000","last_became_peered":"2024-05-04T02:20:15.301424+0000","last_unstale":"2024-05-04T02:48:13.488795+0000","last_undegraded":"2024-05-04T02:48:13.488795+0000","last_fullsized":"2024-05-04T02:48:13.488795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:40:19.927293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":8003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"25'86","reported_seq":120,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.616633+0000","last_change":"2024-05-04T02:20:15.293189+0000","last_active":"2024-05-04T02:48:13.616633+0000","last_peered":"2024-05-04T02:48:13.616633+0000","last_clean":"2024-05-04T02:48:13.616633+0000","last_became_active":"2024-05-04T02:20:15.292840+0000","last_became_peered":"2024-05-04T02:20:15.292840+0000","last_unstale":"2024-05-04T02:48:13.616633+0000","last_undegraded":"2024-05-04T02:48:13.616633+0000","last_fullsized":"2024-05-04T02:48:13.616633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:01:57.617230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":6858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"25'66","reported_seq":98,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.520113+0000","last_change":"2024-05-04T02:20:15.297718+0000","last_active":"2024-05-04T02:48:13.520113+0000","last_peered":"2024-05-04T02:48:13.520113+0000","last_clean":"2024-05-04T02:48:13.520113+0000","last_became_active":"2024-05-04T02:20:15.297415+0000","last_became_peered":"2024-05-04T02:20:15.297415+0000","last_unstale":"2024-05-04T02:48:13.520113+0000","last_undegraded":"2024-05-04T02:48:13.520113+0000","last_fullsized":"2024-05-04T02:48:13.520113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:03:46.054307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":6149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"25'712","reported_seq":746,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:47:47.196612+0000","last_change":"2024-05-04T02:20:14.290469+0000","last_active":"2024-05-04T02:47:47.196612+0000","last_peered":"2024-05-04T02:47:47.196612+0000","last_clean":"2024-05-04T02:47:47.196612+0000","last_became_active":"2024-05-04T02:20:14.289651+0000","last_became_peered":"2024-05-04T02:20:14.289651+0000","last_unstale":"2024-05-04T02:47:47.196612+0000","last_undegraded":"2024-05-04T02:47:47.196612+0000","last_fullsized":"2024-05-04T02:47:47.196612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":712,"log_dups_size":0,"ondisk_log_size":712,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:57:10.542857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":710,"num_write_kb":4451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"25'81","reported_seq":113,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.678763+0000","last_change":"2024-05-04T02:20:15.305933+0000","last_active":"2024-05-04T02:48:13.678763+0000","last_peered":"2024-05-04T02:48:13.678763+0000","last_clean":"2024-05-04T02:48:13.678763+0000","last_became_active":"2024-05-04T02:20:15.305597+0000","last_became_peered":"2024-05-04T02:20:15.305597+0000","last_unstale":"2024-05-04T02:48:13.678763+0000","last_undegraded":"2024-05-04T02:48:13.678763+0000","last_fullsized":"2024-05-04T02:48:13.678763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:50:29.983685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":5085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"25'609","reported_seq":643,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:03.909161+0000","last_change":"2024-05-04T02:20:14.359094+0000","last_active":"2024-05-04T02:48:03.909161+0000","last_peered":"2024-05-04T02:48:03.909161+0000","last_clean":"2024-05-04T02:48:03.909161+0000","last_became_active":"2024-05-04T02:20:14.358394+0000","last_became_peered":"2024-05-04T02:20:14.358394+0000","last_unstale":"2024-05-04T02:48:03.909161+0000","last_undegraded":"2024-05-04T02:48:03.909161+0000","last_fullsized":"2024-05-04T02:48:03.909161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":609,"log_dups_size":0,"ondisk_log_size":609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:57:26.889464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":604,"num_write_kb":4430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"25'3","reported_seq":37,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:01.667263+0000","last_change":"2024-05-04T02:20:14.356259+0000","last_active":"2024-05-04T02:48:01.667263+0000","last_peered":"2024-05-04T02:48:01.667263+0000","last_clean":"2024-05-04T02:48:01.667263+0000","last_became_active":"2024-05-04T02:20:14.355988+0000","last_became_peered":"2024-05-04T02:20:14.355988+0000","last_unstale":"2024-05-04T02:48:01.667263+0000","last_undegraded":"2024-05-04T02:48:01.667263+0000","last_fullsized":"2024-05-04T02:48:01.667263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:40:36.439339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"25'73","reported_seq":105,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.568401+0000","last_change":"2024-05-04T02:20:15.295517+0000","last_active":"2024-05-04T02:48:13.568401+0000","last_peered":"2024-05-04T02:48:13.568401+0000","last_clean":"2024-05-04T02:48:13.568401+0000","last_became_active":"2024-05-04T02:20:15.295222+0000","last_became_peered":"2024-05-04T02:20:15.295222+0000","last_unstale":"2024-05-04T02:48:13.568401+0000","last_undegraded":"2024-05-04T02:48:13.568401+0000","last_fullsized":"2024-05-04T02:48:13.568401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:58:55.400048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":4655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"25'4","reported_seq":38,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:47:56.631136+0000","last_change":"2024-05-04T02:20:14.291543+0000","last_active":"2024-05-04T02:47:56.631136+0000","last_peered":"2024-05-04T02:47:56.631136+0000","last_clean":"2024-05-04T02:47:56.631136+0000","last_became_active":"2024-05-04T02:20:14.290893+0000","last_became_peered":"2024-05-04T02:20:14.290893+0000","last_unstale":"2024-05-04T02:47:56.631136+0000","last_undegraded":"2024-05-04T02:47:56.631136+0000","last_fullsized":"2024-05-04T02:47:56.631136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:57:10.542857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"25'86","reported_seq":118,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.493562+0000","last_change":"2024-05-04T02:20:15.291991+0000","last_active":"2024-05-04T02:48:13.493562+0000","last_peered":"2024-05-04T02:48:13.493562+0000","last_clean":"2024-05-04T02:48:13.493562+0000","last_became_active":"2024-05-04T02:20:15.291704+0000","last_became_peered":"2024-05-04T02:20:15.291704+0000","last_unstale":"2024-05-04T02:48:13.493562+0000","last_undegraded":"2024-05-04T02:48:13.493562+0000","last_fullsized":"2024-05-04T02:48:13.493562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:52:22.299082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":4969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"25'5","reported_seq":39,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:12.312177+0000","last_change":"2024-05-04T02:20:14.359336+0000","last_active":"2024-05-04T02:48:12.312177+0000","last_peered":"2024-05-04T02:48:12.312177+0000","last_clean":"2024-05-04T02:48:12.312177+0000","last_became_active":"2024-05-04T02:20:14.357940+0000","last_became_peered":"2024-05-04T02:20:14.357940+0000","last_unstale":"2024-05-04T02:48:12.312177+0000","last_undegraded":"2024-05-04T02:48:12.312177+0000","last_fullsized":"2024-05-04T02:48:12.312177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:48:24.055870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"25'92","reported_seq":124,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.529166+0000","last_change":"2024-05-04T02:20:15.301852+0000","last_active":"2024-05-04T02:48:13.529166+0000","last_peered":"2024-05-04T02:48:13.529166+0000","last_clean":"2024-05-04T02:48:13.529166+0000","last_became_active":"2024-05-04T02:20:15.300374+0000","last_became_peered":"2024-05-04T02:20:15.300374+0000","last_unstale":"2024-05-04T02:48:13.529166+0000","last_undegraded":"2024-05-04T02:48:13.529166+0000","last_fullsized":"2024-05-04T02:48:13.529166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:16:20.585860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":5924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"25'5","reported_seq":39,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:10.615618+0000","last_change":"2024-05-04T02:20:14.358952+0000","last_active":"2024-05-04T02:48:10.615618+0000","last_peered":"2024-05-04T02:48:10.615618+0000","last_clean":"2024-05-04T02:48:10.615618+0000","last_became_active":"2024-05-04T02:20:14.358625+0000","last_became_peered":"2024-05-04T02:20:14.358625+0000","last_unstale":"2024-05-04T02:48:10.615618+0000","last_undegraded":"2024-05-04T02:48:10.615618+0000","last_fullsized":"2024-05-04T02:48:10.615618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:52:21.185127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"25'59","reported_seq":91,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.610978+0000","last_change":"2024-05-04T02:20:15.307242+0000","last_active":"2024-05-04T02:48:13.610978+0000","last_peered":"2024-05-04T02:48:13.610978+0000","last_clean":"2024-05-04T02:48:13.610978+0000","last_became_active":"2024-05-04T02:20:15.306572+0000","last_became_peered":"2024-05-04T02:20:15.306572+0000","last_unstale":"2024-05-04T02:48:13.610978+0000","last_undegraded":"2024-05-04T02:48:13.610978+0000","last_fullsized":"2024-05-04T02:48:13.610978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:31:36.578679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":3639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"25'609","reported_seq":643,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:12.326866+0000","last_change":"2024-05-04T02:20:14.292979+0000","last_active":"2024-05-04T02:48:12.326866+0000","last_peered":"2024-05-04T02:48:12.326866+0000","last_clean":"2024-05-04T02:48:12.326866+0000","last_became_active":"2024-05-04T02:20:14.292564+0000","last_became_peered":"2024-05-04T02:20:14.292564+0000","last_unstale":"2024-05-04T02:48:12.326866+0000","last_undegraded":"2024-05-04T02:48:12.326866+0000","last_fullsized":"2024-05-04T02:48:12.326866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":609,"log_dups_size":0,"ondisk_log_size":609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:34:37.703735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":607,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"25'71","reported_seq":104,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.528110+0000","last_change":"2024-05-04T02:20:15.298392+0000","last_active":"2024-05-04T02:48:13.528110+0000","last_peered":"2024-05-04T02:48:13.528110+0000","last_clean":"2024-05-04T02:48:13.528110+0000","last_became_active":"2024-05-04T02:20:15.298018+0000","last_became_peered":"2024-05-04T02:20:15.298018+0000","last_unstale":"2024-05-04T02:48:13.528110+0000","last_undegraded":"2024-05-04T02:48:13.528110+0000","last_fullsized":"2024-05-04T02:48:13.528110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:42:57.398678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":3497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"25'829","reported_seq":863,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:47:54.393924+0000","last_change":"2024-05-04T02:20:14.360237+0000","last_active":"2024-05-04T02:47:54.393924+0000","last_peered":"2024-05-04T02:47:54.393924+0000","last_clean":"2024-05-04T02:47:54.393924+0000","last_became_active":"2024-05-04T02:20:14.359886+0000","last_became_peered":"2024-05-04T02:20:14.359886+0000","last_unstale":"2024-05-04T02:47:54.393924+0000","last_undegraded":"2024-05-04T02:47:54.393924+0000","last_fullsized":"2024-05-04T02:47:54.393924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":829,"log_dups_size":0,"ondisk_log_size":829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:34:37.703735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":826,"num_write_kb":4535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"25'64","reported_seq":101,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.606294+0000","last_change":"2024-05-04T02:20:53.117045+0000","last_active":"2024-05-04T02:48:13.606294+0000","last_peered":"2024-05-04T02:48:13.606294+0000","last_clean":"2024-05-04T02:48:13.606294+0000","last_became_active":"2024-05-04T02:20:53.116761+0000","last_became_peered":"2024-05-04T02:20:53.116761+0000","last_unstale":"2024-05-04T02:48:13.606294+0000","last_undegraded":"2024-05-04T02:48:13.606294+0000","last_fullsized":"2024-05-04T02:48:13.606294+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:30:15.675774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":3872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"25'9","reported_seq":44,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:03.919461+0000","last_change":"2024-05-04T02:20:14.274932+0000","last_active":"2024-05-04T02:48:03.919461+0000","last_peered":"2024-05-04T02:48:03.919461+0000","last_clean":"2024-05-04T02:48:03.919461+0000","last_became_active":"2024-05-04T02:20:14.274604+0000","last_became_peered":"2024-05-04T02:20:14.274604+0000","last_unstale":"2024-05-04T02:48:03.919461+0000","last_undegraded":"2024-05-04T02:48:03.919461+0000","last_fullsized":"2024-05-04T02:48:03.919461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:35:43.182599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"25'79","reported_seq":112,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.713302+0000","last_change":"2024-05-04T02:20:15.300355+0000","last_active":"2024-05-04T02:48:13.713302+0000","last_peered":"2024-05-04T02:48:13.713302+0000","last_clean":"2024-05-04T02:48:13.713302+0000","last_became_active":"2024-05-04T02:20:15.300052+0000","last_became_peered":"2024-05-04T02:20:15.300052+0000","last_unstale":"2024-05-04T02:48:13.713302+0000","last_undegraded":"2024-05-04T02:48:13.713302+0000","last_fullsized":"2024-05-04T02:48:13.713302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:06:27.072275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":4963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"25'6","reported_seq":41,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.822797+0000","last_change":"2024-05-04T02:20:14.290125+0000","last_active":"2024-05-04T02:48:13.822797+0000","last_peered":"2024-05-04T02:48:13.822797+0000","last_clean":"2024-05-04T02:48:13.822797+0000","last_became_active":"2024-05-04T02:20:14.289826+0000","last_became_peered":"2024-05-04T02:20:14.289826+0000","last_unstale":"2024-05-04T02:48:13.822797+0000","last_undegraded":"2024-05-04T02:48:13.822797+0000","last_fullsized":"2024-05-04T02:48:13.822797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:39:23.112031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"25'96","reported_seq":129,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.608379+0000","last_change":"2024-05-04T02:20:15.303257+0000","last_active":"2024-05-04T02:48:13.608379+0000","last_peered":"2024-05-04T02:48:13.608379+0000","last_clean":"2024-05-04T02:48:13.608379+0000","last_became_active":"2024-05-04T02:20:15.302963+0000","last_became_peered":"2024-05-04T02:20:15.302963+0000","last_unstale":"2024-05-04T02:48:13.608379+0000","last_undegraded":"2024-05-04T02:48:13.608379+0000","last_fullsized":"2024-05-04T02:48:13.608379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:05:46.729556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":14780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"25'5","reported_seq":40,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:01.665098+0000","last_change":"2024-05-04T02:20:14.359226+0000","last_active":"2024-05-04T02:48:01.665098+0000","last_peered":"2024-05-04T02:48:01.665098+0000","last_clean":"2024-05-04T02:48:01.665098+0000","last_became_active":"2024-05-04T02:20:14.358494+0000","last_became_peered":"2024-05-04T02:20:14.358494+0000","last_unstale":"2024-05-04T02:48:01.665098+0000","last_undegraded":"2024-05-04T02:48:01.665098+0000","last_fullsized":"2024-05-04T02:48:01.665098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:43:19.283728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"25'51","reported_seq":84,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.610357+0000","last_change":"2024-05-04T02:20:15.294689+0000","last_active":"2024-05-04T02:48:13.610357+0000","last_peered":"2024-05-04T02:48:13.610357+0000","last_clean":"2024-05-04T02:48:13.610357+0000","last_became_active":"2024-05-04T02:20:15.294400+0000","last_became_peered":"2024-05-04T02:20:15.294400+0000","last_unstale":"2024-05-04T02:48:13.610357+0000","last_undegraded":"2024-05-04T02:48:13.610357+0000","last_fullsized":"2024-05-04T02:48:13.610357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:22:33.019301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":2930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"25'12","reported_seq":47,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:12.313149+0000","last_change":"2024-05-04T02:20:14.269539+0000","last_active":"2024-05-04T02:48:12.313149+0000","last_peered":"2024-05-04T02:48:12.313149+0000","last_clean":"2024-05-04T02:48:12.313149+0000","last_became_active":"2024-05-04T02:20:14.269238+0000","last_became_peered":"2024-05-04T02:20:14.269238+0000","last_unstale":"2024-05-04T02:48:12.313149+0000","last_undegraded":"2024-05-04T02:48:12.313149+0000","last_fullsized":"2024-05-04T02:48:12.313149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:19:48.082162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"25'64","reported_seq":97,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.606107+0000","last_change":"2024-05-04T02:20:15.304355+0000","last_active":"2024-05-04T02:48:13.606107+0000","last_peered":"2024-05-04T02:48:13.606107+0000","last_clean":"2024-05-04T02:48:13.606107+0000","last_became_active":"2024-05-04T02:20:15.302736+0000","last_became_peered":"2024-05-04T02:20:15.302736+0000","last_unstale":"2024-05-04T02:48:13.606107+0000","last_undegraded":"2024-05-04T02:48:13.606107+0000","last_fullsized":"2024-05-04T02:48:13.606107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:35:15.732585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":3572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'5","reported_seq":40,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:10.617362+0000","last_change":"2024-05-04T02:20:14.272218+0000","last_active":"2024-05-04T02:48:10.617362+0000","last_peered":"2024-05-04T02:48:10.617362+0000","last_clean":"2024-05-04T02:48:10.617362+0000","last_became_active":"2024-05-04T02:20:14.271883+0000","last_became_peered":"2024-05-04T02:20:14.271883+0000","last_unstale":"2024-05-04T02:48:10.617362+0000","last_undegraded":"2024-05-04T02:48:10.617362+0000","last_fullsized":"2024-05-04T02:48:10.617362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:32:55.463882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"25'35","reported_seq":68,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.605988+0000","last_change":"2024-05-04T02:20:15.302202+0000","last_active":"2024-05-04T02:48:13.605988+0000","last_peered":"2024-05-04T02:48:13.605988+0000","last_clean":"2024-05-04T02:48:13.605988+0000","last_became_active":"2024-05-04T02:20:15.301880+0000","last_became_peered":"2024-05-04T02:20:15.301880+0000","last_unstale":"2024-05-04T02:48:13.605988+0000","last_undegraded":"2024-05-04T02:48:13.605988+0000","last_fullsized":"2024-05-04T02:48:13.605988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:32:43.559282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":1775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'4","reported_seq":39,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:04.961049+0000","last_change":"2024-05-04T02:20:14.292107+0000","last_active":"2024-05-04T02:48:04.961049+0000","last_peered":"2024-05-04T02:48:04.961049+0000","last_clean":"2024-05-04T02:48:04.961049+0000","last_became_active":"2024-05-04T02:20:14.290132+0000","last_became_peered":"2024-05-04T02:20:14.290132+0000","last_unstale":"2024-05-04T02:48:04.961049+0000","last_undegraded":"2024-05-04T02:48:04.961049+0000","last_fullsized":"2024-05-04T02:48:04.961049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:40:35.516308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"25'56","reported_seq":89,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.607231+0000","last_change":"2024-05-04T02:20:15.302140+0000","last_active":"2024-05-04T02:48:13.607231+0000","last_peered":"2024-05-04T02:48:13.607231+0000","last_clean":"2024-05-04T02:48:13.607231+0000","last_became_active":"2024-05-04T02:20:15.301798+0000","last_became_peered":"2024-05-04T02:20:15.301798+0000","last_unstale":"2024-05-04T02:48:13.607231+0000","last_undegraded":"2024-05-04T02:48:13.607231+0000","last_fullsized":"2024-05-04T02:48:13.607231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:20:28.069809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":3906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":36,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:45:01.187324+0000","last_change":"2024-05-04T02:20:14.274965+0000","last_active":"2024-05-04T02:45:01.187324+0000","last_peered":"2024-05-04T02:45:01.187324+0000","last_clean":"2024-05-04T02:45:01.187324+0000","last_became_active":"2024-05-04T02:20:14.274609+0000","last_became_peered":"2024-05-04T02:20:14.274609+0000","last_unstale":"2024-05-04T02:45:01.187324+0000","last_undegraded":"2024-05-04T02:45:01.187324+0000","last_fullsized":"2024-05-04T02:45:01.187324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:43:19.283728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"25'84","reported_seq":117,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.520405+0000","last_change":"2024-05-04T02:20:15.305486+0000","last_active":"2024-05-04T02:48:13.520405+0000","last_peered":"2024-05-04T02:48:13.520405+0000","last_clean":"2024-05-04T02:48:13.520405+0000","last_became_active":"2024-05-04T02:20:15.301880+0000","last_became_peered":"2024-05-04T02:20:15.301880+0000","last_unstale":"2024-05-04T02:48:13.520405+0000","last_undegraded":"2024-05-04T02:48:13.520405+0000","last_fullsized":"2024-05-04T02:48:13.520405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:13:25.600467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70,"num_write_kb":6433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"25'2","reported_seq":37,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:47:56.668241+0000","last_change":"2024-05-04T02:20:14.288834+0000","last_active":"2024-05-04T02:47:56.668241+0000","last_peered":"2024-05-04T02:47:56.668241+0000","last_clean":"2024-05-04T02:47:56.668241+0000","last_became_active":"2024-05-04T02:20:14.287992+0000","last_became_peered":"2024-05-04T02:20:14.287992+0000","last_unstale":"2024-05-04T02:47:56.668241+0000","last_undegraded":"2024-05-04T02:47:56.668241+0000","last_fullsized":"2024-05-04T02:47:56.668241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:39:08.143762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"25'61","reported_seq":94,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.608504+0000","last_change":"2024-05-04T02:20:15.303880+0000","last_active":"2024-05-04T02:48:13.608504+0000","last_peered":"2024-05-04T02:48:13.608504+0000","last_clean":"2024-05-04T02:48:13.608504+0000","last_became_active":"2024-05-04T02:20:15.303601+0000","last_became_peered":"2024-05-04T02:20:15.303601+0000","last_unstale":"2024-05-04T02:48:13.608504+0000","last_undegraded":"2024-05-04T02:48:13.608504+0000","last_fullsized":"2024-05-04T02:48:13.608504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:26:17.650165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":2391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":132,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:46:07.109143+0000","last_change":"2024-05-04T02:20:02.920020+0000","last_active":"2024-05-04T02:46:07.109143+0000","last_peered":"2024-05-04T02:46:07.109143+0000","last_clean":"2024-05-04T02:46:07.109143+0000","last_became_active":"2024-05-04T02:20:02.918859+0000","last_became_peered":"2024-05-04T02:20:02.918859+0000","last_unstale":"2024-05-04T02:46:07.109143+0000","last_undegraded":"2024-05-04T02:46:07.109143+0000","last_fullsized":"2024-05-04T02:46:07.109143+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:00.162760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:00.162760+0000","last_clean_scrub_stamp":"2024-05-04T02:20:00.162760+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:25:04.934922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"25'1","reported_seq":37,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:47:22.179461+0000","last_change":"2024-05-04T02:20:14.290136+0000","last_active":"2024-05-04T02:47:22.179461+0000","last_peered":"2024-05-04T02:47:22.179461+0000","last_clean":"2024-05-04T02:47:22.179461+0000","last_became_active":"2024-05-04T02:20:14.289597+0000","last_became_peered":"2024-05-04T02:20:14.289597+0000","last_unstale":"2024-05-04T02:47:22.179461+0000","last_undegraded":"2024-05-04T02:47:22.179461+0000","last_fullsized":"2024-05-04T02:47:22.179461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:43:19.283728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"25'46","reported_seq":80,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.561859+0000","last_change":"2024-05-04T02:20:15.306971+0000","last_active":"2024-05-04T02:48:13.561859+0000","last_peered":"2024-05-04T02:48:13.561859+0000","last_clean":"2024-05-04T02:48:13.561859+0000","last_became_active":"2024-05-04T02:20:15.306640+0000","last_became_peered":"2024-05-04T02:20:15.306640+0000","last_unstale":"2024-05-04T02:48:13.561859+0000","last_undegraded":"2024-05-04T02:48:13.561859+0000","last_fullsized":"2024-05-04T02:48:13.561859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:22:04.903746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":2916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"25'362","reported_seq":398,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.277721+0000","last_change":"2024-05-04T02:20:14.291379+0000","last_active":"2024-05-04T02:48:13.277721+0000","last_peered":"2024-05-04T02:48:13.277721+0000","last_clean":"2024-05-04T02:48:13.277721+0000","last_became_active":"2024-05-04T02:20:14.291044+0000","last_became_peered":"2024-05-04T02:20:14.291044+0000","last_unstale":"2024-05-04T02:48:13.277721+0000","last_undegraded":"2024-05-04T02:48:13.277721+0000","last_fullsized":"2024-05-04T02:48:13.277721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:58:54.286093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3803499,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":356,"num_write_kb":3902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"25'52","reported_seq":86,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.710319+0000","last_change":"2024-05-04T02:20:15.305870+0000","last_active":"2024-05-04T02:48:13.710319+0000","last_peered":"2024-05-04T02:48:13.710319+0000","last_clean":"2024-05-04T02:48:13.710319+0000","last_became_active":"2024-05-04T02:20:15.305512+0000","last_became_peered":"2024-05-04T02:20:15.305512+0000","last_unstale":"2024-05-04T02:48:13.710319+0000","last_undegraded":"2024-05-04T02:48:13.710319+0000","last_fullsized":"2024-05-04T02:48:13.710319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:11:17.529449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":2895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"25'849","reported_seq":1726,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.493399+0000","last_change":"2024-05-04T02:20:14.287676+0000","last_active":"2024-05-04T02:48:13.493399+0000","last_peered":"2024-05-04T02:48:13.493399+0000","last_clean":"2024-05-04T02:48:13.493399+0000","last_became_active":"2024-05-04T02:20:14.287335+0000","last_became_peered":"2024-05-04T02:20:14.287335+0000","last_unstale":"2024-05-04T02:48:13.493399+0000","last_undegraded":"2024-05-04T02:48:13.493399+0000","last_fullsized":"2024-05-04T02:48:13.493399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":849,"log_dups_size":0,"ondisk_log_size":849,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:54:20.482900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":181194,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":841,"num_read_kb":897,"num_write":844,"num_write_kb":899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"25'71","reported_seq":106,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.491490+0000","last_change":"2024-05-04T02:20:15.297316+0000","last_active":"2024-05-04T02:48:13.491490+0000","last_peered":"2024-05-04T02:48:13.491490+0000","last_clean":"2024-05-04T02:48:13.491490+0000","last_became_active":"2024-05-04T02:20:15.297010+0000","last_became_peered":"2024-05-04T02:20:15.297010+0000","last_unstale":"2024-05-04T02:48:13.491490+0000","last_undegraded":"2024-05-04T02:48:13.491490+0000","last_fullsized":"2024-05-04T02:48:13.491490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:22:33.019301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":1942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"25'5","reported_seq":41,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:01.666970+0000","last_change":"2024-05-04T02:20:14.292802+0000","last_active":"2024-05-04T02:48:01.666970+0000","last_peered":"2024-05-04T02:48:01.666970+0000","last_clean":"2024-05-04T02:48:01.666970+0000","last_became_active":"2024-05-04T02:20:14.292595+0000","last_became_peered":"2024-05-04T02:20:14.292595+0000","last_unstale":"2024-05-04T02:48:01.666970+0000","last_undegraded":"2024-05-04T02:48:01.666970+0000","last_fullsized":"2024-05-04T02:48:01.666970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:31:25.521717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"25'85","reported_seq":119,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.517744+0000","last_change":"2024-05-04T02:20:15.296358+0000","last_active":"2024-05-04T02:48:13.517744+0000","last_peered":"2024-05-04T02:48:13.517744+0000","last_clean":"2024-05-04T02:48:13.517744+0000","last_became_active":"2024-05-04T02:20:15.296075+0000","last_became_peered":"2024-05-04T02:20:15.296075+0000","last_unstale":"2024-05-04T02:48:13.517744+0000","last_undegraded":"2024-05-04T02:48:13.517744+0000","last_fullsized":"2024-05-04T02:48:13.517744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:30:50.014584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":6268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"25'3","reported_seq":39,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:03.908572+0000","last_change":"2024-05-04T02:20:14.253846+0000","last_active":"2024-05-04T02:48:03.908572+0000","last_peered":"2024-05-04T02:48:03.908572+0000","last_clean":"2024-05-04T02:48:03.908572+0000","last_became_active":"2024-05-04T02:20:14.253513+0000","last_became_peered":"2024-05-04T02:20:14.253513+0000","last_unstale":"2024-05-04T02:48:03.908572+0000","last_undegraded":"2024-05-04T02:48:03.908572+0000","last_fullsized":"2024-05-04T02:48:03.908572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:40:36.439339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"25'68","reported_seq":102,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.524589+0000","last_change":"2024-05-04T02:20:15.300702+0000","last_active":"2024-05-04T02:48:13.524589+0000","last_peered":"2024-05-04T02:48:13.524589+0000","last_clean":"2024-05-04T02:48:13.524589+0000","last_became_active":"2024-05-04T02:20:15.300251+0000","last_became_peered":"2024-05-04T02:20:15.300251+0000","last_unstale":"2024-05-04T02:48:13.524589+0000","last_undegraded":"2024-05-04T02:48:13.524589+0000","last_fullsized":"2024-05-04T02:48:13.524589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:05:46.729556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":2367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"25'2","reported_seq":38,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:08.375514+0000","last_change":"2024-05-04T02:20:14.291304+0000","last_active":"2024-05-04T02:48:08.375514+0000","last_peered":"2024-05-04T02:48:08.375514+0000","last_clean":"2024-05-04T02:48:08.375514+0000","last_became_active":"2024-05-04T02:20:14.290952+0000","last_became_peered":"2024-05-04T02:20:14.290952+0000","last_unstale":"2024-05-04T02:48:08.375514+0000","last_undegraded":"2024-05-04T02:48:08.375514+0000","last_fullsized":"2024-05-04T02:48:08.375514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:15:55.478496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"25'68","reported_seq":102,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.487241+0000","last_change":"2024-05-04T02:20:15.296895+0000","last_active":"2024-05-04T02:48:13.487241+0000","last_peered":"2024-05-04T02:48:13.487241+0000","last_clean":"2024-05-04T02:48:13.487241+0000","last_became_active":"2024-05-04T02:20:15.296562+0000","last_became_peered":"2024-05-04T02:20:15.296562+0000","last_unstale":"2024-05-04T02:48:13.487241+0000","last_undegraded":"2024-05-04T02:48:13.487241+0000","last_fullsized":"2024-05-04T02:48:13.487241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:22:04.903746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":2660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"25'1353","reported_seq":1388,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:12.524952+0000","last_change":"2024-05-04T02:20:14.358920+0000","last_active":"2024-05-04T02:48:12.524952+0000","last_peered":"2024-05-04T02:48:12.524952+0000","last_clean":"2024-05-04T02:48:12.524952+0000","last_became_active":"2024-05-04T02:20:14.358621+0000","last_became_peered":"2024-05-04T02:20:14.358621+0000","last_unstale":"2024-05-04T02:48:12.524952+0000","last_undegraded":"2024-05-04T02:48:12.524952+0000","last_fullsized":"2024-05-04T02:48:12.524952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":1353,"log_dups_size":0,"ondisk_log_size":1353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:57:10.542857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3394,"num_write_kb":1205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"25'74","reported_seq":107,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.570662+0000","last_change":"2024-05-04T02:20:15.299992+0000","last_active":"2024-05-04T02:48:13.570662+0000","last_peered":"2024-05-04T02:48:13.570662+0000","last_clean":"2024-05-04T02:48:13.570662+0000","last_became_active":"2024-05-04T02:20:15.299678+0000","last_became_peered":"2024-05-04T02:20:15.299678+0000","last_unstale":"2024-05-04T02:48:13.570662+0000","last_undegraded":"2024-05-04T02:48:13.570662+0000","last_fullsized":"2024-05-04T02:48:13.570662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:39:43.029499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":5134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"25'6","reported_seq":41,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:08.260550+0000","last_change":"2024-05-04T02:20:14.359479+0000","last_active":"2024-05-04T02:48:08.260550+0000","last_peered":"2024-05-04T02:48:08.260550+0000","last_clean":"2024-05-04T02:48:08.260550+0000","last_became_active":"2024-05-04T02:20:14.358524+0000","last_became_peered":"2024-05-04T02:20:14.358524+0000","last_unstale":"2024-05-04T02:48:08.260550+0000","last_undegraded":"2024-05-04T02:48:08.260550+0000","last_fullsized":"2024-05-04T02:48:08.260550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:40:36.439339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"25'73","reported_seq":106,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.677570+0000","last_change":"2024-05-04T02:20:15.293908+0000","last_active":"2024-05-04T02:48:13.677570+0000","last_peered":"2024-05-04T02:48:13.677570+0000","last_clean":"2024-05-04T02:48:13.677570+0000","last_became_active":"2024-05-04T02:20:15.293602+0000","last_became_peered":"2024-05-04T02:20:15.293602+0000","last_unstale":"2024-05-04T02:48:13.677570+0000","last_undegraded":"2024-05-04T02:48:13.677570+0000","last_fullsized":"2024-05-04T02:48:13.677570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:18:03.065030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":2324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"25'6","reported_seq":41,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:08.375521+0000","last_change":"2024-05-04T02:20:14.291515+0000","last_active":"2024-05-04T02:48:08.375521+0000","last_peered":"2024-05-04T02:48:08.375521+0000","last_clean":"2024-05-04T02:48:08.375521+0000","last_became_active":"2024-05-04T02:20:14.291068+0000","last_became_peered":"2024-05-04T02:20:14.291068+0000","last_unstale":"2024-05-04T02:48:08.375521+0000","last_undegraded":"2024-05-04T02:48:08.375521+0000","last_fullsized":"2024-05-04T02:48:08.375521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:57:10.542857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"25'72","reported_seq":105,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:47:44.471584+0000","last_change":"2024-05-04T02:20:15.247885+0000","last_active":"2024-05-04T02:47:44.471584+0000","last_peered":"2024-05-04T02:47:44.471584+0000","last_clean":"2024-05-04T02:47:44.471584+0000","last_became_active":"2024-05-04T02:20:15.247583+0000","last_became_peered":"2024-05-04T02:20:15.247583+0000","last_unstale":"2024-05-04T02:47:44.471584+0000","last_undegraded":"2024-05-04T02:47:44.471584+0000","last_fullsized":"2024-05-04T02:47:44.471584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:39:16.967443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":6637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"25'3","reported_seq":38,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:47:56.665578+0000","last_change":"2024-05-04T02:20:14.289690+0000","last_active":"2024-05-04T02:47:56.665578+0000","last_peered":"2024-05-04T02:47:56.665578+0000","last_clean":"2024-05-04T02:47:56.665578+0000","last_became_active":"2024-05-04T02:20:14.289360+0000","last_became_peered":"2024-05-04T02:20:14.289360+0000","last_unstale":"2024-05-04T02:47:56.665578+0000","last_undegraded":"2024-05-04T02:47:56.665578+0000","last_fullsized":"2024-05-04T02:47:56.665578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:57:26.889464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"25'64","reported_seq":97,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.566262+0000","last_change":"2024-05-04T02:20:15.296623+0000","last_active":"2024-05-04T02:48:13.566262+0000","last_peered":"2024-05-04T02:48:13.566262+0000","last_clean":"2024-05-04T02:48:13.566262+0000","last_became_active":"2024-05-04T02:20:15.296330+0000","last_became_peered":"2024-05-04T02:20:15.296330+0000","last_unstale":"2024-05-04T02:48:13.566262+0000","last_undegraded":"2024-05-04T02:48:13.566262+0000","last_fullsized":"2024-05-04T02:48:13.566262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:39:18.114604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":4339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":35,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:44:06.182275+0000","last_change":"2024-05-04T02:20:14.289113+0000","last_active":"2024-05-04T02:44:06.182275+0000","last_peered":"2024-05-04T02:44:06.182275+0000","last_clean":"2024-05-04T02:44:06.182275+0000","last_became_active":"2024-05-04T02:20:14.288769+0000","last_became_peered":"2024-05-04T02:20:14.288769+0000","last_unstale":"2024-05-04T02:44:06.182275+0000","last_undegraded":"2024-05-04T02:44:06.182275+0000","last_fullsized":"2024-05-04T02:44:06.182275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:48:24.055870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"25'89","reported_seq":122,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.562700+0000","last_change":"2024-05-04T02:20:15.295428+0000","last_active":"2024-05-04T02:48:13.562700+0000","last_peered":"2024-05-04T02:48:13.562700+0000","last_clean":"2024-05-04T02:48:13.562700+0000","last_became_active":"2024-05-04T02:20:15.295128+0000","last_became_peered":"2024-05-04T02:20:15.295128+0000","last_unstale":"2024-05-04T02:48:13.562700+0000","last_undegraded":"2024-05-04T02:48:13.562700+0000","last_fullsized":"2024-05-04T02:48:13.562700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:10:21.048301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":2421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"25'555","reported_seq":590,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:04.961493+0000","last_change":"2024-05-04T02:20:14.294321+0000","last_active":"2024-05-04T02:48:04.961493+0000","last_peered":"2024-05-04T02:48:04.961493+0000","last_clean":"2024-05-04T02:48:04.961493+0000","last_became_active":"2024-05-04T02:20:14.293862+0000","last_became_peered":"2024-05-04T02:20:14.293862+0000","last_unstale":"2024-05-04T02:48:04.961493+0000","last_undegraded":"2024-05-04T02:48:04.961493+0000","last_fullsized":"2024-05-04T02:48:04.961493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":555,"log_dups_size":0,"ondisk_log_size":555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:39:17.000649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":4370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"25'73","reported_seq":106,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.623295+0000","last_change":"2024-05-04T02:20:15.296883+0000","last_active":"2024-05-04T02:48:13.623295+0000","last_peered":"2024-05-04T02:48:13.623295+0000","last_clean":"2024-05-04T02:48:13.623295+0000","last_became_active":"2024-05-04T02:20:15.296544+0000","last_became_peered":"2024-05-04T02:20:15.296544+0000","last_unstale":"2024-05-04T02:48:13.623295+0000","last_undegraded":"2024-05-04T02:48:13.623295+0000","last_fullsized":"2024-05-04T02:48:13.623295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:52:22.299082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":1715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"25'89","reported_seq":121,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.527857+0000","last_change":"2024-05-04T02:20:15.306263+0000","last_active":"2024-05-04T02:48:13.527857+0000","last_peered":"2024-05-04T02:48:13.527857+0000","last_clean":"2024-05-04T02:48:13.527857+0000","last_became_active":"2024-05-04T02:20:15.305941+0000","last_became_peered":"2024-05-04T02:20:15.305941+0000","last_unstale":"2024-05-04T02:48:13.527857+0000","last_undegraded":"2024-05-04T02:48:13.527857+0000","last_fullsized":"2024-05-04T02:48:13.527857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:33:31.416768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":3718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"25'4","reported_seq":38,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:04.954375+0000","last_change":"2024-05-04T02:20:14.294204+0000","last_active":"2024-05-04T02:48:04.954375+0000","last_peered":"2024-05-04T02:48:04.954375+0000","last_clean":"2024-05-04T02:48:04.954375+0000","last_became_active":"2024-05-04T02:20:14.293788+0000","last_became_peered":"2024-05-04T02:20:14.293788+0000","last_unstale":"2024-05-04T02:48:04.954375+0000","last_undegraded":"2024-05-04T02:48:04.954375+0000","last_fullsized":"2024-05-04T02:48:04.954375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:52:21.185127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"25'52","reported_seq":84,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.527627+0000","last_change":"2024-05-04T02:20:15.306357+0000","last_active":"2024-05-04T02:48:13.527627+0000","last_peered":"2024-05-04T02:48:13.527627+0000","last_clean":"2024-05-04T02:48:13.527627+0000","last_became_active":"2024-05-04T02:20:15.306050+0000","last_became_peered":"2024-05-04T02:20:15.306050+0000","last_unstale":"2024-05-04T02:48:13.527627+0000","last_undegraded":"2024-05-04T02:48:13.527627+0000","last_fullsized":"2024-05-04T02:48:13.527627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:39:18.114604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":4810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"25'1264","reported_seq":1298,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:08.375745+0000","last_change":"2024-05-04T02:20:14.357677+0000","last_active":"2024-05-04T02:48:08.375745+0000","last_peered":"2024-05-04T02:48:08.375745+0000","last_clean":"2024-05-04T02:48:08.375745+0000","last_became_active":"2024-05-04T02:20:14.357368+0000","last_became_peered":"2024-05-04T02:20:14.357368+0000","last_unstale":"2024-05-04T02:48:08.375745+0000","last_undegraded":"2024-05-04T02:48:08.375745+0000","last_fullsized":"2024-05-04T02:48:08.375745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":1264,"log_dups_size":0,"ondisk_log_size":1264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:10:19.934346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1255,"num_write_kb":8902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"25'94","reported_seq":133,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.712754+0000","last_change":"2024-05-04T02:20:53.107201+0000","last_active":"2024-05-04T02:48:13.712754+0000","last_peered":"2024-05-04T02:48:13.712754+0000","last_clean":"2024-05-04T02:48:13.712754+0000","last_became_active":"2024-05-04T02:20:53.106867+0000","last_became_peered":"2024-05-04T02:20:53.106867+0000","last_unstale":"2024-05-04T02:48:13.712754+0000","last_undegraded":"2024-05-04T02:48:13.712754+0000","last_fullsized":"2024-05-04T02:48:13.712754+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:44:55.968258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":7905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"25'740","reported_seq":777,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:10.614685+0000","last_change":"2024-05-04T02:20:14.291632+0000","last_active":"2024-05-04T02:48:10.614685+0000","last_peered":"2024-05-04T02:48:10.614685+0000","last_clean":"2024-05-04T02:48:10.614685+0000","last_became_active":"2024-05-04T02:20:14.291331+0000","last_became_peered":"2024-05-04T02:20:14.291331+0000","last_unstale":"2024-05-04T02:48:10.614685+0000","last_undegraded":"2024-05-04T02:48:10.614685+0000","last_fullsized":"2024-05-04T02:48:10.614685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":740,"log_dups_size":0,"ondisk_log_size":740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:22:31.905346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":732,"num_write_kb":4528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"25'50","reported_seq":85,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.569635+0000","last_change":"2024-05-04T02:20:15.294309+0000","last_active":"2024-05-04T02:48:13.569635+0000","last_peered":"2024-05-04T02:48:13.569635+0000","last_clean":"2024-05-04T02:48:13.569635+0000","last_became_active":"2024-05-04T02:20:15.294026+0000","last_became_peered":"2024-05-04T02:20:15.294026+0000","last_unstale":"2024-05-04T02:48:13.569635+0000","last_undegraded":"2024-05-04T02:48:13.569635+0000","last_fullsized":"2024-05-04T02:48:13.569635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:39:24.225985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":3304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"25'588","reported_seq":624,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:47:58.857763+0000","last_change":"2024-05-04T02:20:14.291633+0000","last_active":"2024-05-04T02:47:58.857763+0000","last_peered":"2024-05-04T02:47:58.857763+0000","last_clean":"2024-05-04T02:47:58.857763+0000","last_became_active":"2024-05-04T02:20:14.291313+0000","last_became_peered":"2024-05-04T02:20:14.291313+0000","last_unstale":"2024-05-04T02:47:58.857763+0000","last_undegraded":"2024-05-04T02:47:58.857763+0000","last_fullsized":"2024-05-04T02:47:58.857763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":588,"log_dups_size":0,"ondisk_log_size":588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:48:36.710163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":585,"num_write_kb":4378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3751,"num_write_kb":293548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4679,"ondisk_log_size":4679,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":37540595,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":841,"num_read_kb":897,"num_write":10488,"num_write_kb":42213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":48889856,"data_stored":75081190,"data_compressed":7496204,"data_compressed_allocated":11345920,"data_compressed_original":37601280,"omap_allocated":0,"internal_metadata":0},"log_size":8561,"ondisk_log_size":8561,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65100,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509784,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64824,"kb_used_data":15600,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94307016,"statfs":{"total":96636764160,"available":96570384384,"internally_reserved":0,"allocated":15974400,"data_stored":25462774,"data_compressed":2642721,"data_compressed_allocated":3952640,"data_compressed_original":13611008,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509784,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60228,"kb_used_data":11004,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94311612,"statfs":{"total":96636764160,"available":96575090688,"internally_reserved":0,"allocated":11268096,"data_stored":16874693,"data_compressed":1601255,"data_compressed_allocated":2412544,"data_compressed_original":8187904,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509784,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35592,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336248,"statfs":{"total":96636764160,"available":96600317952,"internally_reserved":0,"allocated":262144,"data_stored":96895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509784,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58680,"kb_used_data":9456,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94313160,"statfs":{"total":96636764160,"available":96576675840,"internally_reserved":0,"allocated":9682944,"data_stored":12861583,"data_compressed":1022835,"data_compressed_allocated":1699840,"data_compressed_original":5050368,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509784,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35768,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336072,"statfs":{"total":96636764160,"available":96600137728,"internally_reserved":0,"allocated":442368,"data_stored":277999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509783,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29248,"kb_used_data":2232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342592,"statfs":{"total":96636764160,"available":96606814208,"internally_reserved":0,"allocated":2285568,"data_stored":3900464,"data_compressed":519116,"data_compressed_allocated":720896,"data_compressed_original":2506752,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542488,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44836,"kb_used_data":5340,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94327004,"statfs":{"total":96636764160,"available":96590852096,"internally_reserved":0,"allocated":5468160,"data_stored":8485539,"data_compressed":908476,"data_compressed_allocated":1347584,"data_compressed_original":4538368,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575192,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32584,"kb_used_data":5568,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94339256,"statfs":{"total":96636764160,"available":96603398144,"internally_reserved":0,"allocated":5701632,"data_stored":9076419,"data_compressed":866901,"data_compressed_allocated":1302528,"data_compressed_original":4853760,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32550,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32550,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5378048,"data_stored":8389246,"data_compressed":834351,"data_compressed_allocated":1257472,"data_compressed_original":4280320,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2027520,"data_stored":3803659,"data_compressed":519116,"data_compressed_allocated":720896,"data_compressed_original":2506752,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":184320,"data_stored":181194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9424896,"data_stored":12764778,"data_compressed":1022835,"data_compressed_allocated":1699840,"data_compressed_original":5050368,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5210112,"data_stored":8388734,"data_compressed":908476,"data_compressed_allocated":1347584,"data_compressed_original":4538368,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":11010048,"data_stored":16777888,"data_compressed":1601255,"data_compressed_allocated":2412544,"data_compressed_original":8187904,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":15650816,"data_stored":24775601,"data_compressed":2610171,"data_compressed_allocated":3907584,"data_compressed_original":13037568,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-04T02:48:20.372 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-04T02:48:20.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:20.520+0000 7f4640843640 1 Processor -- start 2024-05-04T02:48:20.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:20.520+0000 7f4640843640 1 -- start start 2024-05-04T02:48:20.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:20.521+0000 7f4640843640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f463c0c7da0 0x7f463c15cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:20.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:20.521+0000 7f4640843640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f463c0cc590 0x7f463c0cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:20.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:20.521+0000 7f4640843640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f463c0cd6c0 con 0x7f463c0cde50 2024-05-04T02:48:20.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:20.521+0000 7f4640843640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f463c0c7070 con 0x7f463c0c7da0 2024-05-04T02:48:20.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:20.521+0000 7f4640843640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f463c0cd980 con 0x7f463c0cc590 2024-05-04T02:48:20.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:20.522+0000 7f4639d9b640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f463c0c7da0 0x7f463c15cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:20.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:20.522+0000 7f463ad9d640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f463c0cc590 0x7f463c0cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:20.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:20.522+0000 7f4639d9b640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f463c0c7da0 0x7f463c15cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37766/0 (socket says 172.21.15.1:37766) 2024-05-04T02:48:20.523 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:20.522+0000 7f4639d9b640 1 -- 172.21.15.1:0/4280504169 learned_addr learned my addr 172.21.15.1:0/4280504169 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:48:20.525 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:20.525+0000 7f4639d9b640 1 -- 172.21.15.1:0/4280504169 >> v2:172.21.15.107:3300/0 conn(0x7f463c0cc590 msgr2=0x7f463c0cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:48:20.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:20.525+0000 7f4639d9b640 1 --2- 172.21.15.1:0/4280504169 >> v2:172.21.15.107:3300/0 conn(0x7f463c0cc590 0x7f463c0cc9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:20.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:20.525+0000 7f4639d9b640 1 -- 172.21.15.1:0/4280504169 >> v1:172.21.15.107:6789/0 conn(0x7f463c0cde50 legacy=0x7f463c06c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:20.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:20.525+0000 7f4639d9b640 1 -- 172.21.15.1:0/4280504169 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f463c0c72c0 con 0x7f463c0c7da0 2024-05-04T02:48:20.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:20.527+0000 7f4639d9b640 1 --2- 172.21.15.1:0/4280504169 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f463c0c7da0 0x7f463c15cfb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f463c0c71f0 tx=0x7f462402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d68f1c5ec0e63d09 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:20.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:20.531+0000 7f463959a640 1 -- 172.21.15.1:0/4280504169 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4624037070 con 0x7f463c0c7da0 2024-05-04T02:48:20.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:20.531+0000 7f463959a640 1 -- 172.21.15.1:0/4280504169 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f462402ae50 con 0x7f463c0c7da0 2024-05-04T02:48:20.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:20.531+0000 7f463959a640 1 -- 172.21.15.1:0/4280504169 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4624032860 con 0x7f463c0c7da0 2024-05-04T02:48:20.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:20.531+0000 7f4640843640 1 -- 172.21.15.1:0/4280504169 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f463c0c7da0 msgr2=0x7f463c15cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:20.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:20.531+0000 7f4640843640 1 --2- 172.21.15.1:0/4280504169 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f463c0c7da0 0x7f463c15cfb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f463c0c71f0 tx=0x7f462402a300 comp rx=0 tx=0).stop 2024-05-04T02:48:20.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:20.532+0000 7f4640843640 1 -- 172.21.15.1:0/4280504169 shutdown_connections 2024-05-04T02:48:20.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:20.532+0000 7f4640843640 1 --2- 172.21.15.1:0/4280504169 >> v2:172.21.15.107:3300/0 conn(0x7f463c0cc590 0x7f463c0cc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:20.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:20.532+0000 7f4640843640 1 --2- 172.21.15.1:0/4280504169 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f463c0c7da0 0x7f463c15cfb0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:20.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:20.532+0000 7f4640843640 1 -- 172.21.15.1:0/4280504169 >> 172.21.15.1:0/4280504169 conn(0x7f463c0d2590 msgr2=0x7f463c0ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:48:20.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:20.532+0000 7f4640843640 1 -- 172.21.15.1:0/4280504169 shutdown_connections 2024-05-04T02:48:20.533 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:20.532+0000 7f4640843640 1 -- 172.21.15.1:0/4280504169 wait complete. 2024-05-04T02:48:20.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:20.534+0000 7f4640843640 1 Processor -- start 2024-05-04T02:48:20.534 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:20.534+0000 7f4640843640 1 -- start start 2024-05-04T02:48:20.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:20.535+0000 7f4640843640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f463c0c7da0 0x7f463c1604a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:20.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:20.535+0000 7f4640843640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f463c0cc590 0x7f463c06c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:20.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:20.535+0000 7f4640843640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f463c1511a0 0x7f463c14f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:20.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:20.535+0000 7f4640843640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f463c156b40 con 0x7f463c0c7da0 2024-05-04T02:48:20.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:20.535+0000 7f4640843640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f463c0c7880 con 0x7f463c1511a0 2024-05-04T02:48:20.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:20.535+0000 7f4640843640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f463c0cd310 con 0x7f463c0cc590 2024-05-04T02:48:20.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:20.535+0000 7f463a59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f463c0c7da0 0x7f463c1604a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:20.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:20.536+0000 7f463ad9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f463c1511a0 0x7f463c14f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:20.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:20.536+0000 7f4639d9b640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f463c0cc590 0x7f463c06c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:20.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:20.536+0000 7f463a59c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f463c0c7da0 0x7f463c1604a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37772/0 (socket says 172.21.15.1:37772) 2024-05-04T02:48:20.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:20.536+0000 7f463a59c640 1 -- 172.21.15.1:0/1518623329 learned_addr learned my addr 172.21.15.1:0/1518623329 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:48:20.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:20.540+0000 7f463a59c640 1 -- 172.21.15.1:0/1518623329 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f463c0cc590 msgr2=0x7f463c06c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:20.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:20.540+0000 7f463a59c640 1 --2- 172.21.15.1:0/1518623329 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f463c0cc590 0x7f463c06c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:20.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:20.540+0000 7f463a59c640 1 -- 172.21.15.1:0/1518623329 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f463c1511a0 msgr2=0x7f463c14f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:20.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:20.540+0000 7f463a59c640 1 --2- 172.21.15.1:0/1518623329 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f463c1511a0 0x7f463c14f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:20.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:20.540+0000 7f463a59c640 1 -- 172.21.15.1:0/1518623329 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f463c14ef80 con 0x7f463c0c7da0 2024-05-04T02:48:20.543 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:20.543+0000 7f463a59c640 1 --2- 172.21.15.1:0/1518623329 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f463c0c7da0 0x7f463c1604a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f463400c3a0 tx=0x7f463400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:20.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:20.547+0000 7f4632ffd640 1 -- 172.21.15.1:0/1518623329 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4634017070 con 0x7f463c0c7da0 2024-05-04T02:48:20.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:20.547+0000 7f4632ffd640 1 -- 172.21.15.1:0/1518623329 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46340052d0 con 0x7f463c0c7da0 2024-05-04T02:48:20.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:20.547+0000 7f4640843640 1 -- 172.21.15.1:0/1518623329 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f463c1f3240 con 0x7f463c0c7da0 2024-05-04T02:48:20.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:20.547+0000 7f4632ffd640 1 -- 172.21.15.1:0/1518623329 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4634003830 con 0x7f463c0c7da0 2024-05-04T02:48:20.548 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:20.547+0000 7f4640843640 1 -- 172.21.15.1:0/1518623329 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f463c150550 con 0x7f463c0c7da0 2024-05-04T02:48:20.549 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:20.548+0000 7f4640843640 1 -- 172.21.15.1:0/1518623329 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f463c15b400 con 0x7f463c0c7da0 2024-05-04T02:48:20.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:20.849+0000 7f4632ffd640 1 -- 172.21.15.1:0/1518623329 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f463401a070 con 0x7f463c0c7da0 2024-05-04T02:48:20.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:20.849+0000 7f4632ffd640 1 --2- 172.21.15.1:0/1518623329 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f461c076320 0x7f461c078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:20.850 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:20.850+0000 7f4639d9b640 1 --2- 172.21.15.1:0/1518623329 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f461c076320 0x7f461c078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:20.851 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:20.850+0000 7f4639d9b640 1 --2- 172.21.15.1:0/1518623329 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f461c076320 0x7f461c078830 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4624034000 tx=0x7f462402e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:20.867 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:20.866+0000 7f4632ffd640 1 -- 172.21.15.1:0/1518623329 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5854+0+0 (secure 0 0 0) 0x7f463405c240 con 0x7f463c0c7da0 2024-05-04T02:48:20.867 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:20.866+0000 7f4632ffd640 1 -- 172.21.15.1:0/1518623329 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f463c15b400 con 0x7f463c0c7da0 2024-05-04T02:48:21.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.058+0000 7f4640843640 1 -- 172.21.15.1:0/1518623329 --> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f463c069bc0 con 0x7f461c076320 2024-05-04T02:48:21.066 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.065+0000 7f4632ffd640 1 -- 172.21.15.1:0/1518623329 <== mgr.4108 v2:172.21.15.107:6800/3809222574 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+253080 (secure 0 0 0) 0x7f463c069bc0 con 0x7f461c076320 2024-05-04T02:48:21.068 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:48:21.070 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-05-04T02:48:21.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.068+0000 7f4640843640 1 -- 172.21.15.1:0/1518623329 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f461c076320 msgr2=0x7f461c078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:21.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.068+0000 7f4640843640 1 --2- 172.21.15.1:0/1518623329 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f461c076320 0x7f461c078830 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4624034000 tx=0x7f462402e000 comp rx=0 tx=0).stop 2024-05-04T02:48:21.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.068+0000 7f4640843640 1 -- 172.21.15.1:0/1518623329 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f463c0c7da0 msgr2=0x7f463c1604a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:21.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.068+0000 7f4640843640 1 --2- 172.21.15.1:0/1518623329 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f463c0c7da0 0x7f463c1604a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f463400c3a0 tx=0x7f463400c860 comp rx=0 tx=0).stop 2024-05-04T02:48:21.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.068+0000 7f4640843640 1 -- 172.21.15.1:0/1518623329 shutdown_connections 2024-05-04T02:48:21.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.068+0000 7f4640843640 1 --2- 172.21.15.1:0/1518623329 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f461c076320 0x7f461c078830 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:21.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.068+0000 7f4640843640 1 --2- 172.21.15.1:0/1518623329 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f463c1511a0 0x7f463c14f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:21.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.068+0000 7f4640843640 1 --2- 172.21.15.1:0/1518623329 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f463c0cc590 0x7f463c06c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:21.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.068+0000 7f4640843640 1 --2- 172.21.15.1:0/1518623329 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f463c0c7da0 0x7f463c1604a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:21.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.068+0000 7f4640843640 1 -- 172.21.15.1:0/1518623329 >> 172.21.15.1:0/1518623329 conn(0x7f463c0d2590 msgr2=0x7f463c15a350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:48:21.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.068+0000 7f4640843640 1 -- 172.21.15.1:0/1518623329 shutdown_connections 2024-05-04T02:48:21.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.068+0000 7f4640843640 1 -- 172.21.15.1:0/1518623329 wait complete. 2024-05-04T02:48:21.081 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":869,"stamp":"2024-05-04T02:48:19.514064+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":38130963,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":907,"num_read_kb":952,"num_write":14340,"num_write_kb":337389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13312,"ondisk_log_size":13312,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":361760,"kb_used_data":49888,"kb_used_omap":12,"kb_used_meta":311795,"kb_avail":754612960,"statfs":{"total":773094113280,"available":772723671040,"internally_reserved":0,"allocated":51085312,"data_stored":77036366,"data_compressed":7561304,"data_compressed_allocated":11436032,"data_compressed_original":38748160,"omap_allocated":12752,"internal_metadata":319278640},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":137460,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":47,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004187"},"pg_stats":[{"pgid":"3.3f","version":"25'66","reported_seq":89,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.484191+0000","last_change":"2024-05-04T02:20:53.380646+0000","last_active":"2024-05-04T02:48:13.484191+0000","last_peered":"2024-05-04T02:48:13.484191+0000","last_clean":"2024-05-04T02:48:13.484191+0000","last_became_active":"2024-05-04T02:20:53.380291+0000","last_became_peered":"2024-05-04T02:20:53.380291+0000","last_unstale":"2024-05-04T02:48:13.484191+0000","last_undegraded":"2024-05-04T02:48:13.484191+0000","last_fullsized":"2024-05-04T02:48:13.484191+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:40:37.553293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":3382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3e","version":"25'82","reported_seq":116,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.481403+0000","last_change":"2024-05-04T02:20:15.299265+0000","last_active":"2024-05-04T02:48:13.481403+0000","last_peered":"2024-05-04T02:48:13.481403+0000","last_clean":"2024-05-04T02:48:13.481403+0000","last_became_active":"2024-05-04T02:20:15.298956+0000","last_became_peered":"2024-05-04T02:20:15.298956+0000","last_unstale":"2024-05-04T02:48:13.481403+0000","last_undegraded":"2024-05-04T02:48:13.481403+0000","last_fullsized":"2024-05-04T02:48:13.481403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:23:25.157473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":2093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"25'86","reported_seq":120,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.710579+0000","last_change":"2024-05-04T02:20:15.297447+0000","last_active":"2024-05-04T02:48:13.710579+0000","last_peered":"2024-05-04T02:48:13.710579+0000","last_clean":"2024-05-04T02:48:13.710579+0000","last_became_active":"2024-05-04T02:20:15.297150+0000","last_became_peered":"2024-05-04T02:20:15.297150+0000","last_unstale":"2024-05-04T02:48:13.710579+0000","last_undegraded":"2024-05-04T02:48:13.710579+0000","last_fullsized":"2024-05-04T02:48:13.710579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:10:27.059401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":4094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"25'50","reported_seq":84,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.527559+0000","last_change":"2024-05-04T02:20:15.301427+0000","last_active":"2024-05-04T02:48:13.527559+0000","last_peered":"2024-05-04T02:48:13.527559+0000","last_clean":"2024-05-04T02:48:13.527559+0000","last_became_active":"2024-05-04T02:20:15.301113+0000","last_became_peered":"2024-05-04T02:20:15.301113+0000","last_unstale":"2024-05-04T02:48:13.527559+0000","last_undegraded":"2024-05-04T02:48:13.527559+0000","last_fullsized":"2024-05-04T02:48:13.527559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:06:48.185771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":1582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"25'54","reported_seq":86,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.604371+0000","last_change":"2024-05-04T02:20:15.297817+0000","last_active":"2024-05-04T02:48:13.604371+0000","last_peered":"2024-05-04T02:48:13.604371+0000","last_clean":"2024-05-04T02:48:13.604371+0000","last_became_active":"2024-05-04T02:20:15.297511+0000","last_became_peered":"2024-05-04T02:20:15.297511+0000","last_unstale":"2024-05-04T02:48:13.604371+0000","last_undegraded":"2024-05-04T02:48:13.604371+0000","last_fullsized":"2024-05-04T02:48:13.604371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:33:31.416768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":3466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"25'86","reported_seq":118,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.524090+0000","last_change":"2024-05-04T02:20:15.306853+0000","last_active":"2024-05-04T02:48:13.524090+0000","last_peered":"2024-05-04T02:48:13.524090+0000","last_clean":"2024-05-04T02:48:13.524090+0000","last_became_active":"2024-05-04T02:20:15.306537+0000","last_became_peered":"2024-05-04T02:20:15.306537+0000","last_unstale":"2024-05-04T02:48:13.524090+0000","last_undegraded":"2024-05-04T02:48:13.524090+0000","last_fullsized":"2024-05-04T02:48:13.524090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:35:15.732585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":4281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"25'87","reported_seq":119,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.615849+0000","last_change":"2024-05-04T02:20:15.299499+0000","last_active":"2024-05-04T02:48:13.615849+0000","last_peered":"2024-05-04T02:48:13.615849+0000","last_clean":"2024-05-04T02:48:13.615849+0000","last_became_active":"2024-05-04T02:20:15.299177+0000","last_became_peered":"2024-05-04T02:20:15.299177+0000","last_unstale":"2024-05-04T02:48:13.615849+0000","last_undegraded":"2024-05-04T02:48:13.615849+0000","last_fullsized":"2024-05-04T02:48:13.615849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:13:25.600467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75,"num_write_kb":3160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"25'62","reported_seq":94,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.571271+0000","last_change":"2024-05-04T02:20:15.306964+0000","last_active":"2024-05-04T02:48:13.571271+0000","last_peered":"2024-05-04T02:48:13.571271+0000","last_clean":"2024-05-04T02:48:13.571271+0000","last_became_active":"2024-05-04T02:20:15.306663+0000","last_became_peered":"2024-05-04T02:20:15.306663+0000","last_unstale":"2024-05-04T02:48:13.571271+0000","last_undegraded":"2024-05-04T02:48:13.571271+0000","last_fullsized":"2024-05-04T02:48:13.571271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:52:22.299082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":4413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"25'72","reported_seq":104,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.608102+0000","last_change":"2024-05-04T02:20:15.303354+0000","last_active":"2024-05-04T02:48:13.608102+0000","last_peered":"2024-05-04T02:48:13.608102+0000","last_clean":"2024-05-04T02:48:13.608102+0000","last_became_active":"2024-05-04T02:20:15.303055+0000","last_became_peered":"2024-05-04T02:20:15.303055+0000","last_unstale":"2024-05-04T02:48:13.608102+0000","last_undegraded":"2024-05-04T02:48:13.608102+0000","last_fullsized":"2024-05-04T02:48:13.608102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:22:30.839899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":5860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"25'70","reported_seq":102,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.625591+0000","last_change":"2024-05-04T02:20:15.307433+0000","last_active":"2024-05-04T02:48:13.625591+0000","last_peered":"2024-05-04T02:48:13.625591+0000","last_clean":"2024-05-04T02:48:13.625591+0000","last_became_active":"2024-05-04T02:20:15.307124+0000","last_became_peered":"2024-05-04T02:20:15.307124+0000","last_unstale":"2024-05-04T02:48:13.625591+0000","last_undegraded":"2024-05-04T02:48:13.625591+0000","last_fullsized":"2024-05-04T02:48:13.625591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:22:04.903746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":2059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"25'65","reported_seq":97,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.618354+0000","last_change":"2024-05-04T02:20:15.306714+0000","last_active":"2024-05-04T02:48:13.618354+0000","last_peered":"2024-05-04T02:48:13.618354+0000","last_clean":"2024-05-04T02:48:13.618354+0000","last_became_active":"2024-05-04T02:20:15.306409+0000","last_became_peered":"2024-05-04T02:20:15.306409+0000","last_unstale":"2024-05-04T02:48:13.618354+0000","last_undegraded":"2024-05-04T02:48:13.618354+0000","last_fullsized":"2024-05-04T02:48:13.618354+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:51:58.828664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"25'50","reported_seq":82,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.521353+0000","last_change":"2024-05-04T02:20:15.296940+0000","last_active":"2024-05-04T02:48:13.521353+0000","last_peered":"2024-05-04T02:48:13.521353+0000","last_clean":"2024-05-04T02:48:13.521353+0000","last_became_active":"2024-05-04T02:20:15.296640+0000","last_became_peered":"2024-05-04T02:20:15.296640+0000","last_unstale":"2024-05-04T02:48:13.521353+0000","last_undegraded":"2024-05-04T02:48:13.521353+0000","last_fullsized":"2024-05-04T02:48:13.521353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:25:44.598454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":2327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"25'84","reported_seq":116,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.572426+0000","last_change":"2024-05-04T02:20:15.294287+0000","last_active":"2024-05-04T02:48:13.572426+0000","last_peered":"2024-05-04T02:48:13.572426+0000","last_clean":"2024-05-04T02:48:13.572426+0000","last_became_active":"2024-05-04T02:20:15.293909+0000","last_became_peered":"2024-05-04T02:20:15.293909+0000","last_unstale":"2024-05-04T02:48:13.572426+0000","last_undegraded":"2024-05-04T02:48:13.572426+0000","last_fullsized":"2024-05-04T02:48:13.572426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:31:26.635672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":6748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"25'70","reported_seq":103,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.711912+0000","last_change":"2024-05-04T02:20:15.293837+0000","last_active":"2024-05-04T02:48:13.711912+0000","last_peered":"2024-05-04T02:48:13.711912+0000","last_clean":"2024-05-04T02:48:13.711912+0000","last_became_active":"2024-05-04T02:20:15.293550+0000","last_became_peered":"2024-05-04T02:20:15.293550+0000","last_unstale":"2024-05-04T02:48:13.711912+0000","last_undegraded":"2024-05-04T02:48:13.711912+0000","last_fullsized":"2024-05-04T02:48:13.711912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:55:35.975972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":6468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"25'94","reported_seq":127,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.488175+0000","last_change":"2024-05-04T02:20:15.306005+0000","last_active":"2024-05-04T02:48:13.488175+0000","last_peered":"2024-05-04T02:48:13.488175+0000","last_clean":"2024-05-04T02:48:13.488175+0000","last_became_active":"2024-05-04T02:20:15.305549+0000","last_became_peered":"2024-05-04T02:20:15.305549+0000","last_unstale":"2024-05-04T02:48:13.488175+0000","last_undegraded":"2024-05-04T02:48:13.488175+0000","last_fullsized":"2024-05-04T02:48:13.488175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:58:55.400048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":3628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"25'80","reported_seq":113,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.527476+0000","last_change":"2024-05-04T02:20:15.305322+0000","last_active":"2024-05-04T02:48:13.527476+0000","last_peered":"2024-05-04T02:48:13.527476+0000","last_clean":"2024-05-04T02:48:13.527476+0000","last_became_active":"2024-05-04T02:20:15.301515+0000","last_became_peered":"2024-05-04T02:20:15.301515+0000","last_unstale":"2024-05-04T02:48:13.527476+0000","last_undegraded":"2024-05-04T02:48:13.527476+0000","last_fullsized":"2024-05-04T02:48:13.527476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:10:21.048301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":4426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"25'78","reported_seq":111,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.529144+0000","last_change":"2024-05-04T02:20:15.301042+0000","last_active":"2024-05-04T02:48:13.529144+0000","last_peered":"2024-05-04T02:48:13.529144+0000","last_clean":"2024-05-04T02:48:13.529144+0000","last_became_active":"2024-05-04T02:20:15.300707+0000","last_became_peered":"2024-05-04T02:20:15.300707+0000","last_unstale":"2024-05-04T02:48:13.529144+0000","last_undegraded":"2024-05-04T02:48:13.529144+0000","last_fullsized":"2024-05-04T02:48:13.529144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:36:19.111702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":4257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"25'87","reported_seq":120,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.492002+0000","last_change":"2024-05-04T02:20:15.292059+0000","last_active":"2024-05-04T02:48:13.492002+0000","last_peered":"2024-05-04T02:48:13.492002+0000","last_clean":"2024-05-04T02:48:13.492002+0000","last_became_active":"2024-05-04T02:20:15.291766+0000","last_became_peered":"2024-05-04T02:20:15.291766+0000","last_unstale":"2024-05-04T02:48:13.492002+0000","last_undegraded":"2024-05-04T02:48:13.492002+0000","last_fullsized":"2024-05-04T02:48:13.492002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:49:41.728826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":5570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"25'65","reported_seq":98,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.604751+0000","last_change":"2024-05-04T02:20:15.297861+0000","last_active":"2024-05-04T02:48:13.604751+0000","last_peered":"2024-05-04T02:48:13.604751+0000","last_clean":"2024-05-04T02:48:13.604751+0000","last_became_active":"2024-05-04T02:20:15.297568+0000","last_became_peered":"2024-05-04T02:20:15.297568+0000","last_unstale":"2024-05-04T02:48:13.604751+0000","last_undegraded":"2024-05-04T02:48:13.604751+0000","last_fullsized":"2024-05-04T02:48:13.604751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:52:52.278453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":4387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"25'89","reported_seq":122,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.619958+0000","last_change":"2024-05-04T02:20:15.303036+0000","last_active":"2024-05-04T02:48:13.619958+0000","last_peered":"2024-05-04T02:48:13.619958+0000","last_clean":"2024-05-04T02:48:13.619958+0000","last_became_active":"2024-05-04T02:20:15.302743+0000","last_became_peered":"2024-05-04T02:20:15.302743+0000","last_unstale":"2024-05-04T02:48:13.619958+0000","last_undegraded":"2024-05-04T02:48:13.619958+0000","last_fullsized":"2024-05-04T02:48:13.619958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:58:55.400048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75,"num_write_kb":8052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"25'110","reported_seq":143,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.677669+0000","last_change":"2024-05-04T02:20:15.300987+0000","last_active":"2024-05-04T02:48:13.677669+0000","last_peered":"2024-05-04T02:48:13.677669+0000","last_clean":"2024-05-04T02:48:13.677669+0000","last_became_active":"2024-05-04T02:20:15.300709+0000","last_became_peered":"2024-05-04T02:20:15.300709+0000","last_unstale":"2024-05-04T02:48:13.677669+0000","last_undegraded":"2024-05-04T02:48:13.677669+0000","last_fullsized":"2024-05-04T02:48:13.677669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:15:46.319755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":9218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"25'64","reported_seq":97,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.528965+0000","last_change":"2024-05-04T02:20:15.301545+0000","last_active":"2024-05-04T02:48:13.528965+0000","last_peered":"2024-05-04T02:48:13.528965+0000","last_clean":"2024-05-04T02:48:13.528965+0000","last_became_active":"2024-05-04T02:20:15.300848+0000","last_became_peered":"2024-05-04T02:20:15.300848+0000","last_unstale":"2024-05-04T02:48:13.528965+0000","last_undegraded":"2024-05-04T02:48:13.528965+0000","last_fullsized":"2024-05-04T02:48:13.528965+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:26:17.650165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":2229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"25'75","reported_seq":108,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.567290+0000","last_change":"2024-05-04T02:20:15.302188+0000","last_active":"2024-05-04T02:48:13.567290+0000","last_peered":"2024-05-04T02:48:13.567290+0000","last_clean":"2024-05-04T02:48:13.567290+0000","last_became_active":"2024-05-04T02:20:15.301879+0000","last_became_peered":"2024-05-04T02:20:15.301879+0000","last_unstale":"2024-05-04T02:48:13.567290+0000","last_undegraded":"2024-05-04T02:48:13.567290+0000","last_fullsized":"2024-05-04T02:48:13.567290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:51:58.828664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":4046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"25'55","reported_seq":77,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.486920+0000","last_change":"2024-05-04T02:20:53.115860+0000","last_active":"2024-05-04T02:48:13.486920+0000","last_peered":"2024-05-04T02:48:13.486920+0000","last_clean":"2024-05-04T02:48:13.486920+0000","last_became_active":"2024-05-04T02:20:53.115499+0000","last_became_peered":"2024-05-04T02:20:53.115499+0000","last_unstale":"2024-05-04T02:48:13.486920+0000","last_undegraded":"2024-05-04T02:48:13.486920+0000","last_fullsized":"2024-05-04T02:48:13.486920+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:48:25.169824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":4120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"25'84","reported_seq":117,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.543660+0000","last_change":"2024-05-04T02:20:15.301659+0000","last_active":"2024-05-04T02:48:13.543660+0000","last_peered":"2024-05-04T02:48:13.543660+0000","last_clean":"2024-05-04T02:48:13.543660+0000","last_became_active":"2024-05-04T02:20:15.301363+0000","last_became_peered":"2024-05-04T02:20:15.301363+0000","last_unstale":"2024-05-04T02:48:13.543660+0000","last_undegraded":"2024-05-04T02:48:13.543660+0000","last_fullsized":"2024-05-04T02:48:13.543660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:23:25.157473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":4697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"25'75","reported_seq":108,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.623404+0000","last_change":"2024-05-04T02:20:15.295843+0000","last_active":"2024-05-04T02:48:13.623404+0000","last_peered":"2024-05-04T02:48:13.623404+0000","last_clean":"2024-05-04T02:48:13.623404+0000","last_became_active":"2024-05-04T02:20:15.295577+0000","last_became_peered":"2024-05-04T02:20:15.295577+0000","last_unstale":"2024-05-04T02:48:13.623404+0000","last_undegraded":"2024-05-04T02:48:13.623404+0000","last_fullsized":"2024-05-04T02:48:13.623404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:23:25.157473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":3524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"25'87","reported_seq":120,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.488294+0000","last_change":"2024-05-04T02:20:15.299661+0000","last_active":"2024-05-04T02:48:13.488294+0000","last_peered":"2024-05-04T02:48:13.488294+0000","last_clean":"2024-05-04T02:48:13.488294+0000","last_became_active":"2024-05-04T02:20:15.299230+0000","last_became_peered":"2024-05-04T02:20:15.299230+0000","last_unstale":"2024-05-04T02:48:13.488294+0000","last_undegraded":"2024-05-04T02:48:13.488294+0000","last_fullsized":"2024-05-04T02:48:13.488294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:51:58.828664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":4545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"25'51","reported_seq":84,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.572483+0000","last_change":"2024-05-04T02:20:15.302719+0000","last_active":"2024-05-04T02:48:13.572483+0000","last_peered":"2024-05-04T02:48:13.572483+0000","last_clean":"2024-05-04T02:48:13.572483+0000","last_became_active":"2024-05-04T02:20:15.302456+0000","last_became_peered":"2024-05-04T02:20:15.302456+0000","last_unstale":"2024-05-04T02:48:13.572483+0000","last_undegraded":"2024-05-04T02:48:13.572483+0000","last_fullsized":"2024-05-04T02:48:13.572483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:06:48.185771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":7049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"25'65","reported_seq":99,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.676535+0000","last_change":"2024-05-04T02:20:15.296567+0000","last_active":"2024-05-04T02:48:13.676535+0000","last_peered":"2024-05-04T02:48:13.676535+0000","last_clean":"2024-05-04T02:48:13.676535+0000","last_became_active":"2024-05-04T02:20:15.296235+0000","last_became_peered":"2024-05-04T02:20:15.296235+0000","last_unstale":"2024-05-04T02:48:13.676535+0000","last_undegraded":"2024-05-04T02:48:13.676535+0000","last_fullsized":"2024-05-04T02:48:13.676535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:32:20.652776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":6740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"25'135","reported_seq":158,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.482735+0000","last_change":"2024-05-04T02:20:53.116445+0000","last_active":"2024-05-04T02:48:13.482735+0000","last_peered":"2024-05-04T02:48:13.482735+0000","last_clean":"2024-05-04T02:48:13.482735+0000","last_became_active":"2024-05-04T02:20:53.116069+0000","last_became_peered":"2024-05-04T02:20:53.116069+0000","last_unstale":"2024-05-04T02:48:13.482735+0000","last_undegraded":"2024-05-04T02:48:13.482735+0000","last_fullsized":"2024-05-04T02:48:13.482735+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:57:11.656812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":7251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"25'77","reported_seq":111,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.488795+0000","last_change":"2024-05-04T02:20:15.301739+0000","last_active":"2024-05-04T02:48:13.488795+0000","last_peered":"2024-05-04T02:48:13.488795+0000","last_clean":"2024-05-04T02:48:13.488795+0000","last_became_active":"2024-05-04T02:20:15.301424+0000","last_became_peered":"2024-05-04T02:20:15.301424+0000","last_unstale":"2024-05-04T02:48:13.488795+0000","last_undegraded":"2024-05-04T02:48:13.488795+0000","last_fullsized":"2024-05-04T02:48:13.488795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:40:19.927293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":8003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"25'86","reported_seq":120,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.616633+0000","last_change":"2024-05-04T02:20:15.293189+0000","last_active":"2024-05-04T02:48:13.616633+0000","last_peered":"2024-05-04T02:48:13.616633+0000","last_clean":"2024-05-04T02:48:13.616633+0000","last_became_active":"2024-05-04T02:20:15.292840+0000","last_became_peered":"2024-05-04T02:20:15.292840+0000","last_unstale":"2024-05-04T02:48:13.616633+0000","last_undegraded":"2024-05-04T02:48:13.616633+0000","last_fullsized":"2024-05-04T02:48:13.616633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:01:57.617230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":6858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"25'66","reported_seq":98,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.520113+0000","last_change":"2024-05-04T02:20:15.297718+0000","last_active":"2024-05-04T02:48:13.520113+0000","last_peered":"2024-05-04T02:48:13.520113+0000","last_clean":"2024-05-04T02:48:13.520113+0000","last_became_active":"2024-05-04T02:20:15.297415+0000","last_became_peered":"2024-05-04T02:20:15.297415+0000","last_unstale":"2024-05-04T02:48:13.520113+0000","last_undegraded":"2024-05-04T02:48:13.520113+0000","last_fullsized":"2024-05-04T02:48:13.520113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:03:46.054307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":6149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"25'712","reported_seq":746,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:47:47.196612+0000","last_change":"2024-05-04T02:20:14.290469+0000","last_active":"2024-05-04T02:47:47.196612+0000","last_peered":"2024-05-04T02:47:47.196612+0000","last_clean":"2024-05-04T02:47:47.196612+0000","last_became_active":"2024-05-04T02:20:14.289651+0000","last_became_peered":"2024-05-04T02:20:14.289651+0000","last_unstale":"2024-05-04T02:47:47.196612+0000","last_undegraded":"2024-05-04T02:47:47.196612+0000","last_fullsized":"2024-05-04T02:47:47.196612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":712,"log_dups_size":0,"ondisk_log_size":712,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:57:10.542857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":710,"num_write_kb":4451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"25'81","reported_seq":113,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.678763+0000","last_change":"2024-05-04T02:20:15.305933+0000","last_active":"2024-05-04T02:48:13.678763+0000","last_peered":"2024-05-04T02:48:13.678763+0000","last_clean":"2024-05-04T02:48:13.678763+0000","last_became_active":"2024-05-04T02:20:15.305597+0000","last_became_peered":"2024-05-04T02:20:15.305597+0000","last_unstale":"2024-05-04T02:48:13.678763+0000","last_undegraded":"2024-05-04T02:48:13.678763+0000","last_fullsized":"2024-05-04T02:48:13.678763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:50:29.983685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":5085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"25'609","reported_seq":643,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:03.909161+0000","last_change":"2024-05-04T02:20:14.359094+0000","last_active":"2024-05-04T02:48:03.909161+0000","last_peered":"2024-05-04T02:48:03.909161+0000","last_clean":"2024-05-04T02:48:03.909161+0000","last_became_active":"2024-05-04T02:20:14.358394+0000","last_became_peered":"2024-05-04T02:20:14.358394+0000","last_unstale":"2024-05-04T02:48:03.909161+0000","last_undegraded":"2024-05-04T02:48:03.909161+0000","last_fullsized":"2024-05-04T02:48:03.909161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":609,"log_dups_size":0,"ondisk_log_size":609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:57:26.889464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":604,"num_write_kb":4430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"25'3","reported_seq":37,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:01.667263+0000","last_change":"2024-05-04T02:20:14.356259+0000","last_active":"2024-05-04T02:48:01.667263+0000","last_peered":"2024-05-04T02:48:01.667263+0000","last_clean":"2024-05-04T02:48:01.667263+0000","last_became_active":"2024-05-04T02:20:14.355988+0000","last_became_peered":"2024-05-04T02:20:14.355988+0000","last_unstale":"2024-05-04T02:48:01.667263+0000","last_undegraded":"2024-05-04T02:48:01.667263+0000","last_fullsized":"2024-05-04T02:48:01.667263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:40:36.439339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"25'73","reported_seq":105,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.568401+0000","last_change":"2024-05-04T02:20:15.295517+0000","last_active":"2024-05-04T02:48:13.568401+0000","last_peered":"2024-05-04T02:48:13.568401+0000","last_clean":"2024-05-04T02:48:13.568401+0000","last_became_active":"2024-05-04T02:20:15.295222+0000","last_became_peered":"2024-05-04T02:20:15.295222+0000","last_unstale":"2024-05-04T02:48:13.568401+0000","last_undegraded":"2024-05-04T02:48:13.568401+0000","last_fullsized":"2024-05-04T02:48:13.568401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:58:55.400048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":4655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"25'4","reported_seq":38,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:47:56.631136+0000","last_change":"2024-05-04T02:20:14.291543+0000","last_active":"2024-05-04T02:47:56.631136+0000","last_peered":"2024-05-04T02:47:56.631136+0000","last_clean":"2024-05-04T02:47:56.631136+0000","last_became_active":"2024-05-04T02:20:14.290893+0000","last_became_peered":"2024-05-04T02:20:14.290893+0000","last_unstale":"2024-05-04T02:47:56.631136+0000","last_undegraded":"2024-05-04T02:47:56.631136+0000","last_fullsized":"2024-05-04T02:47:56.631136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:57:10.542857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"25'86","reported_seq":118,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.493562+0000","last_change":"2024-05-04T02:20:15.291991+0000","last_active":"2024-05-04T02:48:13.493562+0000","last_peered":"2024-05-04T02:48:13.493562+0000","last_clean":"2024-05-04T02:48:13.493562+0000","last_became_active":"2024-05-04T02:20:15.291704+0000","last_became_peered":"2024-05-04T02:20:15.291704+0000","last_unstale":"2024-05-04T02:48:13.493562+0000","last_undegraded":"2024-05-04T02:48:13.493562+0000","last_fullsized":"2024-05-04T02:48:13.493562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:52:22.299082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":4969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"25'5","reported_seq":39,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:12.312177+0000","last_change":"2024-05-04T02:20:14.359336+0000","last_active":"2024-05-04T02:48:12.312177+0000","last_peered":"2024-05-04T02:48:12.312177+0000","last_clean":"2024-05-04T02:48:12.312177+0000","last_became_active":"2024-05-04T02:20:14.357940+0000","last_became_peered":"2024-05-04T02:20:14.357940+0000","last_unstale":"2024-05-04T02:48:12.312177+0000","last_undegraded":"2024-05-04T02:48:12.312177+0000","last_fullsized":"2024-05-04T02:48:12.312177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:48:24.055870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"25'92","reported_seq":124,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.529166+0000","last_change":"2024-05-04T02:20:15.301852+0000","last_active":"2024-05-04T02:48:13.529166+0000","last_peered":"2024-05-04T02:48:13.529166+0000","last_clean":"2024-05-04T02:48:13.529166+0000","last_became_active":"2024-05-04T02:20:15.300374+0000","last_became_peered":"2024-05-04T02:20:15.300374+0000","last_unstale":"2024-05-04T02:48:13.529166+0000","last_undegraded":"2024-05-04T02:48:13.529166+0000","last_fullsized":"2024-05-04T02:48:13.529166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:16:20.585860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":5924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"25'5","reported_seq":39,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:10.615618+0000","last_change":"2024-05-04T02:20:14.358952+0000","last_active":"2024-05-04T02:48:10.615618+0000","last_peered":"2024-05-04T02:48:10.615618+0000","last_clean":"2024-05-04T02:48:10.615618+0000","last_became_active":"2024-05-04T02:20:14.358625+0000","last_became_peered":"2024-05-04T02:20:14.358625+0000","last_unstale":"2024-05-04T02:48:10.615618+0000","last_undegraded":"2024-05-04T02:48:10.615618+0000","last_fullsized":"2024-05-04T02:48:10.615618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:52:21.185127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"25'59","reported_seq":91,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.610978+0000","last_change":"2024-05-04T02:20:15.307242+0000","last_active":"2024-05-04T02:48:13.610978+0000","last_peered":"2024-05-04T02:48:13.610978+0000","last_clean":"2024-05-04T02:48:13.610978+0000","last_became_active":"2024-05-04T02:20:15.306572+0000","last_became_peered":"2024-05-04T02:20:15.306572+0000","last_unstale":"2024-05-04T02:48:13.610978+0000","last_undegraded":"2024-05-04T02:48:13.610978+0000","last_fullsized":"2024-05-04T02:48:13.610978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:31:36.578679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":3639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"25'609","reported_seq":643,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:12.326866+0000","last_change":"2024-05-04T02:20:14.292979+0000","last_active":"2024-05-04T02:48:12.326866+0000","last_peered":"2024-05-04T02:48:12.326866+0000","last_clean":"2024-05-04T02:48:12.326866+0000","last_became_active":"2024-05-04T02:20:14.292564+0000","last_became_peered":"2024-05-04T02:20:14.292564+0000","last_unstale":"2024-05-04T02:48:12.326866+0000","last_undegraded":"2024-05-04T02:48:12.326866+0000","last_fullsized":"2024-05-04T02:48:12.326866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":609,"log_dups_size":0,"ondisk_log_size":609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:34:37.703735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":607,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"25'71","reported_seq":104,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.528110+0000","last_change":"2024-05-04T02:20:15.298392+0000","last_active":"2024-05-04T02:48:13.528110+0000","last_peered":"2024-05-04T02:48:13.528110+0000","last_clean":"2024-05-04T02:48:13.528110+0000","last_became_active":"2024-05-04T02:20:15.298018+0000","last_became_peered":"2024-05-04T02:20:15.298018+0000","last_unstale":"2024-05-04T02:48:13.528110+0000","last_undegraded":"2024-05-04T02:48:13.528110+0000","last_fullsized":"2024-05-04T02:48:13.528110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:42:57.398678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":3497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"25'829","reported_seq":863,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:47:54.393924+0000","last_change":"2024-05-04T02:20:14.360237+0000","last_active":"2024-05-04T02:47:54.393924+0000","last_peered":"2024-05-04T02:47:54.393924+0000","last_clean":"2024-05-04T02:47:54.393924+0000","last_became_active":"2024-05-04T02:20:14.359886+0000","last_became_peered":"2024-05-04T02:20:14.359886+0000","last_unstale":"2024-05-04T02:47:54.393924+0000","last_undegraded":"2024-05-04T02:47:54.393924+0000","last_fullsized":"2024-05-04T02:47:54.393924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":829,"log_dups_size":0,"ondisk_log_size":829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:34:37.703735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":826,"num_write_kb":4535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"25'64","reported_seq":101,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.606294+0000","last_change":"2024-05-04T02:20:53.117045+0000","last_active":"2024-05-04T02:48:13.606294+0000","last_peered":"2024-05-04T02:48:13.606294+0000","last_clean":"2024-05-04T02:48:13.606294+0000","last_became_active":"2024-05-04T02:20:53.116761+0000","last_became_peered":"2024-05-04T02:20:53.116761+0000","last_unstale":"2024-05-04T02:48:13.606294+0000","last_undegraded":"2024-05-04T02:48:13.606294+0000","last_fullsized":"2024-05-04T02:48:13.606294+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:30:15.675774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":3872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"25'9","reported_seq":44,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:03.919461+0000","last_change":"2024-05-04T02:20:14.274932+0000","last_active":"2024-05-04T02:48:03.919461+0000","last_peered":"2024-05-04T02:48:03.919461+0000","last_clean":"2024-05-04T02:48:03.919461+0000","last_became_active":"2024-05-04T02:20:14.274604+0000","last_became_peered":"2024-05-04T02:20:14.274604+0000","last_unstale":"2024-05-04T02:48:03.919461+0000","last_undegraded":"2024-05-04T02:48:03.919461+0000","last_fullsized":"2024-05-04T02:48:03.919461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:35:43.182599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"25'79","reported_seq":112,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.713302+0000","last_change":"2024-05-04T02:20:15.300355+0000","last_active":"2024-05-04T02:48:13.713302+0000","last_peered":"2024-05-04T02:48:13.713302+0000","last_clean":"2024-05-04T02:48:13.713302+0000","last_became_active":"2024-05-04T02:20:15.300052+0000","last_became_peered":"2024-05-04T02:20:15.300052+0000","last_unstale":"2024-05-04T02:48:13.713302+0000","last_undegraded":"2024-05-04T02:48:13.713302+0000","last_fullsized":"2024-05-04T02:48:13.713302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:06:27.072275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":4963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"25'6","reported_seq":41,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.822797+0000","last_change":"2024-05-04T02:20:14.290125+0000","last_active":"2024-05-04T02:48:13.822797+0000","last_peered":"2024-05-04T02:48:13.822797+0000","last_clean":"2024-05-04T02:48:13.822797+0000","last_became_active":"2024-05-04T02:20:14.289826+0000","last_became_peered":"2024-05-04T02:20:14.289826+0000","last_unstale":"2024-05-04T02:48:13.822797+0000","last_undegraded":"2024-05-04T02:48:13.822797+0000","last_fullsized":"2024-05-04T02:48:13.822797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:39:23.112031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"25'96","reported_seq":129,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.608379+0000","last_change":"2024-05-04T02:20:15.303257+0000","last_active":"2024-05-04T02:48:13.608379+0000","last_peered":"2024-05-04T02:48:13.608379+0000","last_clean":"2024-05-04T02:48:13.608379+0000","last_became_active":"2024-05-04T02:20:15.302963+0000","last_became_peered":"2024-05-04T02:20:15.302963+0000","last_unstale":"2024-05-04T02:48:13.608379+0000","last_undegraded":"2024-05-04T02:48:13.608379+0000","last_fullsized":"2024-05-04T02:48:13.608379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:05:46.729556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":14780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"25'5","reported_seq":40,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:01.665098+0000","last_change":"2024-05-04T02:20:14.359226+0000","last_active":"2024-05-04T02:48:01.665098+0000","last_peered":"2024-05-04T02:48:01.665098+0000","last_clean":"2024-05-04T02:48:01.665098+0000","last_became_active":"2024-05-04T02:20:14.358494+0000","last_became_peered":"2024-05-04T02:20:14.358494+0000","last_unstale":"2024-05-04T02:48:01.665098+0000","last_undegraded":"2024-05-04T02:48:01.665098+0000","last_fullsized":"2024-05-04T02:48:01.665098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:43:19.283728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"25'51","reported_seq":84,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.610357+0000","last_change":"2024-05-04T02:20:15.294689+0000","last_active":"2024-05-04T02:48:13.610357+0000","last_peered":"2024-05-04T02:48:13.610357+0000","last_clean":"2024-05-04T02:48:13.610357+0000","last_became_active":"2024-05-04T02:20:15.294400+0000","last_became_peered":"2024-05-04T02:20:15.294400+0000","last_unstale":"2024-05-04T02:48:13.610357+0000","last_undegraded":"2024-05-04T02:48:13.610357+0000","last_fullsized":"2024-05-04T02:48:13.610357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:22:33.019301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":2930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"25'12","reported_seq":47,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:12.313149+0000","last_change":"2024-05-04T02:20:14.269539+0000","last_active":"2024-05-04T02:48:12.313149+0000","last_peered":"2024-05-04T02:48:12.313149+0000","last_clean":"2024-05-04T02:48:12.313149+0000","last_became_active":"2024-05-04T02:20:14.269238+0000","last_became_peered":"2024-05-04T02:20:14.269238+0000","last_unstale":"2024-05-04T02:48:12.313149+0000","last_undegraded":"2024-05-04T02:48:12.313149+0000","last_fullsized":"2024-05-04T02:48:12.313149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:19:48.082162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"25'64","reported_seq":97,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.606107+0000","last_change":"2024-05-04T02:20:15.304355+0000","last_active":"2024-05-04T02:48:13.606107+0000","last_peered":"2024-05-04T02:48:13.606107+0000","last_clean":"2024-05-04T02:48:13.606107+0000","last_became_active":"2024-05-04T02:20:15.302736+0000","last_became_peered":"2024-05-04T02:20:15.302736+0000","last_unstale":"2024-05-04T02:48:13.606107+0000","last_undegraded":"2024-05-04T02:48:13.606107+0000","last_fullsized":"2024-05-04T02:48:13.606107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:35:15.732585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":3572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'5","reported_seq":40,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:10.617362+0000","last_change":"2024-05-04T02:20:14.272218+0000","last_active":"2024-05-04T02:48:10.617362+0000","last_peered":"2024-05-04T02:48:10.617362+0000","last_clean":"2024-05-04T02:48:10.617362+0000","last_became_active":"2024-05-04T02:20:14.271883+0000","last_became_peered":"2024-05-04T02:20:14.271883+0000","last_unstale":"2024-05-04T02:48:10.617362+0000","last_undegraded":"2024-05-04T02:48:10.617362+0000","last_fullsized":"2024-05-04T02:48:10.617362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:32:55.463882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"25'35","reported_seq":68,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.605988+0000","last_change":"2024-05-04T02:20:15.302202+0000","last_active":"2024-05-04T02:48:13.605988+0000","last_peered":"2024-05-04T02:48:13.605988+0000","last_clean":"2024-05-04T02:48:13.605988+0000","last_became_active":"2024-05-04T02:20:15.301880+0000","last_became_peered":"2024-05-04T02:20:15.301880+0000","last_unstale":"2024-05-04T02:48:13.605988+0000","last_undegraded":"2024-05-04T02:48:13.605988+0000","last_fullsized":"2024-05-04T02:48:13.605988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:32:43.559282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":1775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'4","reported_seq":39,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:04.961049+0000","last_change":"2024-05-04T02:20:14.292107+0000","last_active":"2024-05-04T02:48:04.961049+0000","last_peered":"2024-05-04T02:48:04.961049+0000","last_clean":"2024-05-04T02:48:04.961049+0000","last_became_active":"2024-05-04T02:20:14.290132+0000","last_became_peered":"2024-05-04T02:20:14.290132+0000","last_unstale":"2024-05-04T02:48:04.961049+0000","last_undegraded":"2024-05-04T02:48:04.961049+0000","last_fullsized":"2024-05-04T02:48:04.961049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:40:35.516308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"25'56","reported_seq":89,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.607231+0000","last_change":"2024-05-04T02:20:15.302140+0000","last_active":"2024-05-04T02:48:13.607231+0000","last_peered":"2024-05-04T02:48:13.607231+0000","last_clean":"2024-05-04T02:48:13.607231+0000","last_became_active":"2024-05-04T02:20:15.301798+0000","last_became_peered":"2024-05-04T02:20:15.301798+0000","last_unstale":"2024-05-04T02:48:13.607231+0000","last_undegraded":"2024-05-04T02:48:13.607231+0000","last_fullsized":"2024-05-04T02:48:13.607231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:20:28.069809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":3906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":36,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:45:01.187324+0000","last_change":"2024-05-04T02:20:14.274965+0000","last_active":"2024-05-04T02:45:01.187324+0000","last_peered":"2024-05-04T02:45:01.187324+0000","last_clean":"2024-05-04T02:45:01.187324+0000","last_became_active":"2024-05-04T02:20:14.274609+0000","last_became_peered":"2024-05-04T02:20:14.274609+0000","last_unstale":"2024-05-04T02:45:01.187324+0000","last_undegraded":"2024-05-04T02:45:01.187324+0000","last_fullsized":"2024-05-04T02:45:01.187324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:43:19.283728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"25'84","reported_seq":117,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.520405+0000","last_change":"2024-05-04T02:20:15.305486+0000","last_active":"2024-05-04T02:48:13.520405+0000","last_peered":"2024-05-04T02:48:13.520405+0000","last_clean":"2024-05-04T02:48:13.520405+0000","last_became_active":"2024-05-04T02:20:15.301880+0000","last_became_peered":"2024-05-04T02:20:15.301880+0000","last_unstale":"2024-05-04T02:48:13.520405+0000","last_undegraded":"2024-05-04T02:48:13.520405+0000","last_fullsized":"2024-05-04T02:48:13.520405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:13:25.600467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70,"num_write_kb":6433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"25'2","reported_seq":37,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:47:56.668241+0000","last_change":"2024-05-04T02:20:14.288834+0000","last_active":"2024-05-04T02:47:56.668241+0000","last_peered":"2024-05-04T02:47:56.668241+0000","last_clean":"2024-05-04T02:47:56.668241+0000","last_became_active":"2024-05-04T02:20:14.287992+0000","last_became_peered":"2024-05-04T02:20:14.287992+0000","last_unstale":"2024-05-04T02:47:56.668241+0000","last_undegraded":"2024-05-04T02:47:56.668241+0000","last_fullsized":"2024-05-04T02:47:56.668241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:39:08.143762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"25'61","reported_seq":94,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.608504+0000","last_change":"2024-05-04T02:20:15.303880+0000","last_active":"2024-05-04T02:48:13.608504+0000","last_peered":"2024-05-04T02:48:13.608504+0000","last_clean":"2024-05-04T02:48:13.608504+0000","last_became_active":"2024-05-04T02:20:15.303601+0000","last_became_peered":"2024-05-04T02:20:15.303601+0000","last_unstale":"2024-05-04T02:48:13.608504+0000","last_undegraded":"2024-05-04T02:48:13.608504+0000","last_fullsized":"2024-05-04T02:48:13.608504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:26:17.650165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":2391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":132,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:46:07.109143+0000","last_change":"2024-05-04T02:20:02.920020+0000","last_active":"2024-05-04T02:46:07.109143+0000","last_peered":"2024-05-04T02:46:07.109143+0000","last_clean":"2024-05-04T02:46:07.109143+0000","last_became_active":"2024-05-04T02:20:02.918859+0000","last_became_peered":"2024-05-04T02:20:02.918859+0000","last_unstale":"2024-05-04T02:46:07.109143+0000","last_undegraded":"2024-05-04T02:46:07.109143+0000","last_fullsized":"2024-05-04T02:46:07.109143+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:00.162760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:00.162760+0000","last_clean_scrub_stamp":"2024-05-04T02:20:00.162760+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:25:04.934922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"25'1","reported_seq":37,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:47:22.179461+0000","last_change":"2024-05-04T02:20:14.290136+0000","last_active":"2024-05-04T02:47:22.179461+0000","last_peered":"2024-05-04T02:47:22.179461+0000","last_clean":"2024-05-04T02:47:22.179461+0000","last_became_active":"2024-05-04T02:20:14.289597+0000","last_became_peered":"2024-05-04T02:20:14.289597+0000","last_unstale":"2024-05-04T02:47:22.179461+0000","last_undegraded":"2024-05-04T02:47:22.179461+0000","last_fullsized":"2024-05-04T02:47:22.179461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:43:19.283728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"25'46","reported_seq":80,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.561859+0000","last_change":"2024-05-04T02:20:15.306971+0000","last_active":"2024-05-04T02:48:13.561859+0000","last_peered":"2024-05-04T02:48:13.561859+0000","last_clean":"2024-05-04T02:48:13.561859+0000","last_became_active":"2024-05-04T02:20:15.306640+0000","last_became_peered":"2024-05-04T02:20:15.306640+0000","last_unstale":"2024-05-04T02:48:13.561859+0000","last_undegraded":"2024-05-04T02:48:13.561859+0000","last_fullsized":"2024-05-04T02:48:13.561859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:22:04.903746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":2916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"25'362","reported_seq":398,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.277721+0000","last_change":"2024-05-04T02:20:14.291379+0000","last_active":"2024-05-04T02:48:13.277721+0000","last_peered":"2024-05-04T02:48:13.277721+0000","last_clean":"2024-05-04T02:48:13.277721+0000","last_became_active":"2024-05-04T02:20:14.291044+0000","last_became_peered":"2024-05-04T02:20:14.291044+0000","last_unstale":"2024-05-04T02:48:13.277721+0000","last_undegraded":"2024-05-04T02:48:13.277721+0000","last_fullsized":"2024-05-04T02:48:13.277721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:58:54.286093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3803499,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":356,"num_write_kb":3902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"25'52","reported_seq":86,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.710319+0000","last_change":"2024-05-04T02:20:15.305870+0000","last_active":"2024-05-04T02:48:13.710319+0000","last_peered":"2024-05-04T02:48:13.710319+0000","last_clean":"2024-05-04T02:48:13.710319+0000","last_became_active":"2024-05-04T02:20:15.305512+0000","last_became_peered":"2024-05-04T02:20:15.305512+0000","last_unstale":"2024-05-04T02:48:13.710319+0000","last_undegraded":"2024-05-04T02:48:13.710319+0000","last_fullsized":"2024-05-04T02:48:13.710319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:11:17.529449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":2895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"25'849","reported_seq":1726,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.493399+0000","last_change":"2024-05-04T02:20:14.287676+0000","last_active":"2024-05-04T02:48:13.493399+0000","last_peered":"2024-05-04T02:48:13.493399+0000","last_clean":"2024-05-04T02:48:13.493399+0000","last_became_active":"2024-05-04T02:20:14.287335+0000","last_became_peered":"2024-05-04T02:20:14.287335+0000","last_unstale":"2024-05-04T02:48:13.493399+0000","last_undegraded":"2024-05-04T02:48:13.493399+0000","last_fullsized":"2024-05-04T02:48:13.493399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":849,"log_dups_size":0,"ondisk_log_size":849,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:54:20.482900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":181194,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":841,"num_read_kb":897,"num_write":844,"num_write_kb":899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"25'71","reported_seq":106,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.491490+0000","last_change":"2024-05-04T02:20:15.297316+0000","last_active":"2024-05-04T02:48:13.491490+0000","last_peered":"2024-05-04T02:48:13.491490+0000","last_clean":"2024-05-04T02:48:13.491490+0000","last_became_active":"2024-05-04T02:20:15.297010+0000","last_became_peered":"2024-05-04T02:20:15.297010+0000","last_unstale":"2024-05-04T02:48:13.491490+0000","last_undegraded":"2024-05-04T02:48:13.491490+0000","last_fullsized":"2024-05-04T02:48:13.491490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:22:33.019301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":1942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"25'5","reported_seq":41,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:01.666970+0000","last_change":"2024-05-04T02:20:14.292802+0000","last_active":"2024-05-04T02:48:01.666970+0000","last_peered":"2024-05-04T02:48:01.666970+0000","last_clean":"2024-05-04T02:48:01.666970+0000","last_became_active":"2024-05-04T02:20:14.292595+0000","last_became_peered":"2024-05-04T02:20:14.292595+0000","last_unstale":"2024-05-04T02:48:01.666970+0000","last_undegraded":"2024-05-04T02:48:01.666970+0000","last_fullsized":"2024-05-04T02:48:01.666970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:31:25.521717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"25'85","reported_seq":119,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.517744+0000","last_change":"2024-05-04T02:20:15.296358+0000","last_active":"2024-05-04T02:48:13.517744+0000","last_peered":"2024-05-04T02:48:13.517744+0000","last_clean":"2024-05-04T02:48:13.517744+0000","last_became_active":"2024-05-04T02:20:15.296075+0000","last_became_peered":"2024-05-04T02:20:15.296075+0000","last_unstale":"2024-05-04T02:48:13.517744+0000","last_undegraded":"2024-05-04T02:48:13.517744+0000","last_fullsized":"2024-05-04T02:48:13.517744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:30:50.014584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":6268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"25'3","reported_seq":39,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:03.908572+0000","last_change":"2024-05-04T02:20:14.253846+0000","last_active":"2024-05-04T02:48:03.908572+0000","last_peered":"2024-05-04T02:48:03.908572+0000","last_clean":"2024-05-04T02:48:03.908572+0000","last_became_active":"2024-05-04T02:20:14.253513+0000","last_became_peered":"2024-05-04T02:20:14.253513+0000","last_unstale":"2024-05-04T02:48:03.908572+0000","last_undegraded":"2024-05-04T02:48:03.908572+0000","last_fullsized":"2024-05-04T02:48:03.908572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:40:36.439339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"25'68","reported_seq":102,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.524589+0000","last_change":"2024-05-04T02:20:15.300702+0000","last_active":"2024-05-04T02:48:13.524589+0000","last_peered":"2024-05-04T02:48:13.524589+0000","last_clean":"2024-05-04T02:48:13.524589+0000","last_became_active":"2024-05-04T02:20:15.300251+0000","last_became_peered":"2024-05-04T02:20:15.300251+0000","last_unstale":"2024-05-04T02:48:13.524589+0000","last_undegraded":"2024-05-04T02:48:13.524589+0000","last_fullsized":"2024-05-04T02:48:13.524589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:05:46.729556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":2367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"25'2","reported_seq":38,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:08.375514+0000","last_change":"2024-05-04T02:20:14.291304+0000","last_active":"2024-05-04T02:48:08.375514+0000","last_peered":"2024-05-04T02:48:08.375514+0000","last_clean":"2024-05-04T02:48:08.375514+0000","last_became_active":"2024-05-04T02:20:14.290952+0000","last_became_peered":"2024-05-04T02:20:14.290952+0000","last_unstale":"2024-05-04T02:48:08.375514+0000","last_undegraded":"2024-05-04T02:48:08.375514+0000","last_fullsized":"2024-05-04T02:48:08.375514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:15:55.478496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"25'68","reported_seq":102,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.487241+0000","last_change":"2024-05-04T02:20:15.296895+0000","last_active":"2024-05-04T02:48:13.487241+0000","last_peered":"2024-05-04T02:48:13.487241+0000","last_clean":"2024-05-04T02:48:13.487241+0000","last_became_active":"2024-05-04T02:20:15.296562+0000","last_became_peered":"2024-05-04T02:20:15.296562+0000","last_unstale":"2024-05-04T02:48:13.487241+0000","last_undegraded":"2024-05-04T02:48:13.487241+0000","last_fullsized":"2024-05-04T02:48:13.487241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:22:04.903746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":2660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"25'1353","reported_seq":1388,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:12.524952+0000","last_change":"2024-05-04T02:20:14.358920+0000","last_active":"2024-05-04T02:48:12.524952+0000","last_peered":"2024-05-04T02:48:12.524952+0000","last_clean":"2024-05-04T02:48:12.524952+0000","last_became_active":"2024-05-04T02:20:14.358621+0000","last_became_peered":"2024-05-04T02:20:14.358621+0000","last_unstale":"2024-05-04T02:48:12.524952+0000","last_undegraded":"2024-05-04T02:48:12.524952+0000","last_fullsized":"2024-05-04T02:48:12.524952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":1353,"log_dups_size":0,"ondisk_log_size":1353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:57:10.542857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3394,"num_write_kb":1205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"25'74","reported_seq":107,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.570662+0000","last_change":"2024-05-04T02:20:15.299992+0000","last_active":"2024-05-04T02:48:13.570662+0000","last_peered":"2024-05-04T02:48:13.570662+0000","last_clean":"2024-05-04T02:48:13.570662+0000","last_became_active":"2024-05-04T02:20:15.299678+0000","last_became_peered":"2024-05-04T02:20:15.299678+0000","last_unstale":"2024-05-04T02:48:13.570662+0000","last_undegraded":"2024-05-04T02:48:13.570662+0000","last_fullsized":"2024-05-04T02:48:13.570662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:39:43.029499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":5134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"25'6","reported_seq":41,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:08.260550+0000","last_change":"2024-05-04T02:20:14.359479+0000","last_active":"2024-05-04T02:48:08.260550+0000","last_peered":"2024-05-04T02:48:08.260550+0000","last_clean":"2024-05-04T02:48:08.260550+0000","last_became_active":"2024-05-04T02:20:14.358524+0000","last_became_peered":"2024-05-04T02:20:14.358524+0000","last_unstale":"2024-05-04T02:48:08.260550+0000","last_undegraded":"2024-05-04T02:48:08.260550+0000","last_fullsized":"2024-05-04T02:48:08.260550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:40:36.439339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"25'73","reported_seq":106,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.677570+0000","last_change":"2024-05-04T02:20:15.293908+0000","last_active":"2024-05-04T02:48:13.677570+0000","last_peered":"2024-05-04T02:48:13.677570+0000","last_clean":"2024-05-04T02:48:13.677570+0000","last_became_active":"2024-05-04T02:20:15.293602+0000","last_became_peered":"2024-05-04T02:20:15.293602+0000","last_unstale":"2024-05-04T02:48:13.677570+0000","last_undegraded":"2024-05-04T02:48:13.677570+0000","last_fullsized":"2024-05-04T02:48:13.677570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:18:03.065030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":2324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"25'6","reported_seq":41,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:08.375521+0000","last_change":"2024-05-04T02:20:14.291515+0000","last_active":"2024-05-04T02:48:08.375521+0000","last_peered":"2024-05-04T02:48:08.375521+0000","last_clean":"2024-05-04T02:48:08.375521+0000","last_became_active":"2024-05-04T02:20:14.291068+0000","last_became_peered":"2024-05-04T02:20:14.291068+0000","last_unstale":"2024-05-04T02:48:08.375521+0000","last_undegraded":"2024-05-04T02:48:08.375521+0000","last_fullsized":"2024-05-04T02:48:08.375521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:57:10.542857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"25'72","reported_seq":105,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:47:44.471584+0000","last_change":"2024-05-04T02:20:15.247885+0000","last_active":"2024-05-04T02:47:44.471584+0000","last_peered":"2024-05-04T02:47:44.471584+0000","last_clean":"2024-05-04T02:47:44.471584+0000","last_became_active":"2024-05-04T02:20:15.247583+0000","last_became_peered":"2024-05-04T02:20:15.247583+0000","last_unstale":"2024-05-04T02:47:44.471584+0000","last_undegraded":"2024-05-04T02:47:44.471584+0000","last_fullsized":"2024-05-04T02:47:44.471584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:39:16.967443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":6637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"25'3","reported_seq":38,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:47:56.665578+0000","last_change":"2024-05-04T02:20:14.289690+0000","last_active":"2024-05-04T02:47:56.665578+0000","last_peered":"2024-05-04T02:47:56.665578+0000","last_clean":"2024-05-04T02:47:56.665578+0000","last_became_active":"2024-05-04T02:20:14.289360+0000","last_became_peered":"2024-05-04T02:20:14.289360+0000","last_unstale":"2024-05-04T02:47:56.665578+0000","last_undegraded":"2024-05-04T02:47:56.665578+0000","last_fullsized":"2024-05-04T02:47:56.665578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:57:26.889464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"25'64","reported_seq":97,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.566262+0000","last_change":"2024-05-04T02:20:15.296623+0000","last_active":"2024-05-04T02:48:13.566262+0000","last_peered":"2024-05-04T02:48:13.566262+0000","last_clean":"2024-05-04T02:48:13.566262+0000","last_became_active":"2024-05-04T02:20:15.296330+0000","last_became_peered":"2024-05-04T02:20:15.296330+0000","last_unstale":"2024-05-04T02:48:13.566262+0000","last_undegraded":"2024-05-04T02:48:13.566262+0000","last_fullsized":"2024-05-04T02:48:13.566262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:39:18.114604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":4339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":35,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:44:06.182275+0000","last_change":"2024-05-04T02:20:14.289113+0000","last_active":"2024-05-04T02:44:06.182275+0000","last_peered":"2024-05-04T02:44:06.182275+0000","last_clean":"2024-05-04T02:44:06.182275+0000","last_became_active":"2024-05-04T02:20:14.288769+0000","last_became_peered":"2024-05-04T02:20:14.288769+0000","last_unstale":"2024-05-04T02:44:06.182275+0000","last_undegraded":"2024-05-04T02:44:06.182275+0000","last_fullsized":"2024-05-04T02:44:06.182275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:48:24.055870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"25'89","reported_seq":122,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.562700+0000","last_change":"2024-05-04T02:20:15.295428+0000","last_active":"2024-05-04T02:48:13.562700+0000","last_peered":"2024-05-04T02:48:13.562700+0000","last_clean":"2024-05-04T02:48:13.562700+0000","last_became_active":"2024-05-04T02:20:15.295128+0000","last_became_peered":"2024-05-04T02:20:15.295128+0000","last_unstale":"2024-05-04T02:48:13.562700+0000","last_undegraded":"2024-05-04T02:48:13.562700+0000","last_fullsized":"2024-05-04T02:48:13.562700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:10:21.048301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":2421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"25'555","reported_seq":590,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:04.961493+0000","last_change":"2024-05-04T02:20:14.294321+0000","last_active":"2024-05-04T02:48:04.961493+0000","last_peered":"2024-05-04T02:48:04.961493+0000","last_clean":"2024-05-04T02:48:04.961493+0000","last_became_active":"2024-05-04T02:20:14.293862+0000","last_became_peered":"2024-05-04T02:20:14.293862+0000","last_unstale":"2024-05-04T02:48:04.961493+0000","last_undegraded":"2024-05-04T02:48:04.961493+0000","last_fullsized":"2024-05-04T02:48:04.961493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":555,"log_dups_size":0,"ondisk_log_size":555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:39:17.000649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":4370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"25'73","reported_seq":106,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.623295+0000","last_change":"2024-05-04T02:20:15.296883+0000","last_active":"2024-05-04T02:48:13.623295+0000","last_peered":"2024-05-04T02:48:13.623295+0000","last_clean":"2024-05-04T02:48:13.623295+0000","last_became_active":"2024-05-04T02:20:15.296544+0000","last_became_peered":"2024-05-04T02:20:15.296544+0000","last_unstale":"2024-05-04T02:48:13.623295+0000","last_undegraded":"2024-05-04T02:48:13.623295+0000","last_fullsized":"2024-05-04T02:48:13.623295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:52:22.299082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":1715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"25'89","reported_seq":121,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.527857+0000","last_change":"2024-05-04T02:20:15.306263+0000","last_active":"2024-05-04T02:48:13.527857+0000","last_peered":"2024-05-04T02:48:13.527857+0000","last_clean":"2024-05-04T02:48:13.527857+0000","last_became_active":"2024-05-04T02:20:15.305941+0000","last_became_peered":"2024-05-04T02:20:15.305941+0000","last_unstale":"2024-05-04T02:48:13.527857+0000","last_undegraded":"2024-05-04T02:48:13.527857+0000","last_fullsized":"2024-05-04T02:48:13.527857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:33:31.416768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":3718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"25'4","reported_seq":38,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:04.954375+0000","last_change":"2024-05-04T02:20:14.294204+0000","last_active":"2024-05-04T02:48:04.954375+0000","last_peered":"2024-05-04T02:48:04.954375+0000","last_clean":"2024-05-04T02:48:04.954375+0000","last_became_active":"2024-05-04T02:20:14.293788+0000","last_became_peered":"2024-05-04T02:20:14.293788+0000","last_unstale":"2024-05-04T02:48:04.954375+0000","last_undegraded":"2024-05-04T02:48:04.954375+0000","last_fullsized":"2024-05-04T02:48:04.954375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:52:21.185127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"25'52","reported_seq":84,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.527627+0000","last_change":"2024-05-04T02:20:15.306357+0000","last_active":"2024-05-04T02:48:13.527627+0000","last_peered":"2024-05-04T02:48:13.527627+0000","last_clean":"2024-05-04T02:48:13.527627+0000","last_became_active":"2024-05-04T02:20:15.306050+0000","last_became_peered":"2024-05-04T02:20:15.306050+0000","last_unstale":"2024-05-04T02:48:13.527627+0000","last_undegraded":"2024-05-04T02:48:13.527627+0000","last_fullsized":"2024-05-04T02:48:13.527627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:39:18.114604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":4810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"25'1264","reported_seq":1298,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:08.375745+0000","last_change":"2024-05-04T02:20:14.357677+0000","last_active":"2024-05-04T02:48:08.375745+0000","last_peered":"2024-05-04T02:48:08.375745+0000","last_clean":"2024-05-04T02:48:08.375745+0000","last_became_active":"2024-05-04T02:20:14.357368+0000","last_became_peered":"2024-05-04T02:20:14.357368+0000","last_unstale":"2024-05-04T02:48:08.375745+0000","last_undegraded":"2024-05-04T02:48:08.375745+0000","last_fullsized":"2024-05-04T02:48:08.375745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":1264,"log_dups_size":0,"ondisk_log_size":1264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:10:19.934346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1255,"num_write_kb":8902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"25'94","reported_seq":133,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.712754+0000","last_change":"2024-05-04T02:20:53.107201+0000","last_active":"2024-05-04T02:48:13.712754+0000","last_peered":"2024-05-04T02:48:13.712754+0000","last_clean":"2024-05-04T02:48:13.712754+0000","last_became_active":"2024-05-04T02:20:53.106867+0000","last_became_peered":"2024-05-04T02:20:53.106867+0000","last_unstale":"2024-05-04T02:48:13.712754+0000","last_undegraded":"2024-05-04T02:48:13.712754+0000","last_fullsized":"2024-05-04T02:48:13.712754+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:44:55.968258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":7905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"25'740","reported_seq":777,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:10.614685+0000","last_change":"2024-05-04T02:20:14.291632+0000","last_active":"2024-05-04T02:48:10.614685+0000","last_peered":"2024-05-04T02:48:10.614685+0000","last_clean":"2024-05-04T02:48:10.614685+0000","last_became_active":"2024-05-04T02:20:14.291331+0000","last_became_peered":"2024-05-04T02:20:14.291331+0000","last_unstale":"2024-05-04T02:48:10.614685+0000","last_undegraded":"2024-05-04T02:48:10.614685+0000","last_fullsized":"2024-05-04T02:48:10.614685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":740,"log_dups_size":0,"ondisk_log_size":740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:22:31.905346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":732,"num_write_kb":4528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"25'50","reported_seq":85,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.569635+0000","last_change":"2024-05-04T02:20:15.294309+0000","last_active":"2024-05-04T02:48:13.569635+0000","last_peered":"2024-05-04T02:48:13.569635+0000","last_clean":"2024-05-04T02:48:13.569635+0000","last_became_active":"2024-05-04T02:20:15.294026+0000","last_became_peered":"2024-05-04T02:20:15.294026+0000","last_unstale":"2024-05-04T02:48:13.569635+0000","last_undegraded":"2024-05-04T02:48:13.569635+0000","last_fullsized":"2024-05-04T02:48:13.569635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:39:24.225985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":3304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"25'588","reported_seq":624,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:47:58.857763+0000","last_change":"2024-05-04T02:20:14.291633+0000","last_active":"2024-05-04T02:47:58.857763+0000","last_peered":"2024-05-04T02:47:58.857763+0000","last_clean":"2024-05-04T02:47:58.857763+0000","last_became_active":"2024-05-04T02:20:14.291313+0000","last_became_peered":"2024-05-04T02:20:14.291313+0000","last_unstale":"2024-05-04T02:47:58.857763+0000","last_undegraded":"2024-05-04T02:47:58.857763+0000","last_fullsized":"2024-05-04T02:47:58.857763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":588,"log_dups_size":0,"ondisk_log_size":588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:48:36.710163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":585,"num_write_kb":4378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3751,"num_write_kb":293548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4679,"ondisk_log_size":4679,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":37540595,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":841,"num_read_kb":897,"num_write":10488,"num_write_kb":42213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":48889856,"data_stored":75081190,"data_compressed":7496204,"data_compressed_allocated":11345920,"data_compressed_original":37601280,"omap_allocated":0,"internal_metadata":0},"log_size":8561,"ondisk_log_size":8561,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65100,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509784,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64824,"kb_used_data":15600,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94307016,"statfs":{"total":96636764160,"available":96570384384,"internally_reserved":0,"allocated":15974400,"data_stored":25462774,"data_compressed":2642721,"data_compressed_allocated":3952640,"data_compressed_original":13611008,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509784,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60228,"kb_used_data":11004,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94311612,"statfs":{"total":96636764160,"available":96575090688,"internally_reserved":0,"allocated":11268096,"data_stored":16874693,"data_compressed":1601255,"data_compressed_allocated":2412544,"data_compressed_original":8187904,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509784,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35592,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336248,"statfs":{"total":96636764160,"available":96600317952,"internally_reserved":0,"allocated":262144,"data_stored":96895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509784,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58680,"kb_used_data":9456,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94313160,"statfs":{"total":96636764160,"available":96576675840,"internally_reserved":0,"allocated":9682944,"data_stored":12861583,"data_compressed":1022835,"data_compressed_allocated":1699840,"data_compressed_original":5050368,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509784,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35768,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336072,"statfs":{"total":96636764160,"available":96600137728,"internally_reserved":0,"allocated":442368,"data_stored":277999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509783,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29248,"kb_used_data":2232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342592,"statfs":{"total":96636764160,"available":96606814208,"internally_reserved":0,"allocated":2285568,"data_stored":3900464,"data_compressed":519116,"data_compressed_allocated":720896,"data_compressed_original":2506752,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542488,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44836,"kb_used_data":5340,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94327004,"statfs":{"total":96636764160,"available":96590852096,"internally_reserved":0,"allocated":5468160,"data_stored":8485539,"data_compressed":908476,"data_compressed_allocated":1347584,"data_compressed_original":4538368,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575192,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32584,"kb_used_data":5568,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94339256,"statfs":{"total":96636764160,"available":96603398144,"internally_reserved":0,"allocated":5701632,"data_stored":9076419,"data_compressed":866901,"data_compressed_allocated":1302528,"data_compressed_original":4853760,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32550,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32550,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5378048,"data_stored":8389246,"data_compressed":834351,"data_compressed_allocated":1257472,"data_compressed_original":4280320,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2027520,"data_stored":3803659,"data_compressed":519116,"data_compressed_allocated":720896,"data_compressed_original":2506752,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":184320,"data_stored":181194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9424896,"data_stored":12764778,"data_compressed":1022835,"data_compressed_allocated":1699840,"data_compressed_original":5050368,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5210112,"data_stored":8388734,"data_compressed":908476,"data_compressed_allocated":1347584,"data_compressed_original":4538368,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":11010048,"data_stored":16777888,"data_compressed":1601255,"data_compressed_allocated":2412544,"data_compressed_original":8187904,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":15650816,"data_stored":24775601,"data_compressed":2610171,"data_compressed_allocated":3907584,"data_compressed_original":13037568,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-04T02:48:21.086 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-04T02:48:21.086 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-04T02:48:21.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.234+0000 7fe59dc92640 1 Processor -- start 2024-05-04T02:48:21.235 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.234+0000 7fe59dc92640 1 -- start start 2024-05-04T02:48:21.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.235+0000 7fe59dc92640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe598156b40 0x7fe5980c7240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:21.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.235+0000 7fe59dc92640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe598160bb0 con 0x7fe5980cd480 2024-05-04T02:48:21.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.235+0000 7fe59dc92640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe59815fd00 con 0x7fe5981607a0 2024-05-04T02:48:21.236 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.235+0000 7fe59dc92640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fe598160310 con 0x7fe598156b40 2024-05-04T02:48:21.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.236+0000 7fe596ffd640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fe5980cd480 0x7fe5980b60c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:55384/0 (socket says 172.21.15.1:55384) 2024-05-04T02:48:21.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.236+0000 7fe5977fe640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe598156b40 0x7fe5980c7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:21.237 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.236+0000 7fe596ffd640 1 -- 172.21.15.1:0/1952827362 learned_addr learned my addr 172.21.15.1:0/1952827362 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-05-04T02:48:21.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.239+0000 7fe5967fc640 1 -- 172.21.15.1:0/1952827362 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4003148405 0 0) 0x7fe58c001110 con 0x7fe5980cd480 2024-05-04T02:48:21.239 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.239+0000 7fe5967fc640 1 -- 172.21.15.1:0/1952827362 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe580003520 con 0x7fe5980cd480 2024-05-04T02:48:21.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.240+0000 7fe5977fe640 1 -- 172.21.15.1:0/1952827362 >> v1:172.21.15.107:6789/0 conn(0x7fe5981607a0 legacy=0x7fe5980b67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:21.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.240+0000 7fe5977fe640 1 -- 172.21.15.1:0/1952827362 >> v1:172.21.15.1:6789/0 conn(0x7fe5980cd480 legacy=0x7fe5980b60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:21.240 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.240+0000 7fe5977fe640 1 -- 172.21.15.1:0/1952827362 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5980c68a0 con 0x7fe598156b40 2024-05-04T02:48:21.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.245+0000 7fe5977fe640 1 --2- 172.21.15.1:0/1952827362 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe598156b40 0x7fe5980c7240 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe598160490 tx=0x7fe58802a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9bb1c6e27a2bd038 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:21.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.249+0000 7fe5967fc640 1 -- 172.21.15.1:0/1952827362 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe588037070 con 0x7fe598156b40 2024-05-04T02:48:21.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.249+0000 7fe5967fc640 1 -- 172.21.15.1:0/1952827362 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe588032440 con 0x7fe598156b40 2024-05-04T02:48:21.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.249+0000 7fe5967fc640 1 -- 172.21.15.1:0/1952827362 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe588032810 con 0x7fe598156b40 2024-05-04T02:48:21.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.250+0000 7fe59dc92640 1 -- 172.21.15.1:0/1952827362 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe598156b40 msgr2=0x7fe5980c7240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:21.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.250+0000 7fe59dc92640 1 --2- 172.21.15.1:0/1952827362 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe598156b40 0x7fe5980c7240 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe598160490 tx=0x7fe58802a210 comp rx=0 tx=0).stop 2024-05-04T02:48:21.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.250+0000 7fe59dc92640 1 -- 172.21.15.1:0/1952827362 shutdown_connections 2024-05-04T02:48:21.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.250+0000 7fe59dc92640 1 --2- 172.21.15.1:0/1952827362 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe598156b40 0x7fe5980c7240 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:21.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.250+0000 7fe59dc92640 1 -- 172.21.15.1:0/1952827362 >> 172.21.15.1:0/1952827362 conn(0x7fe5980ce560 msgr2=0x7fe5980ce970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:48:21.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.250+0000 7fe59dc92640 1 -- 172.21.15.1:0/1952827362 shutdown_connections 2024-05-04T02:48:21.251 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.250+0000 7fe59dc92640 1 -- 172.21.15.1:0/1952827362 wait complete. 2024-05-04T02:48:21.252 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.252+0000 7fe59dc92640 1 Processor -- start 2024-05-04T02:48:21.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.252+0000 7fe59dc92640 1 -- start start 2024-05-04T02:48:21.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.253+0000 7fe59dc92640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe5980cd480 0x7fe5980d00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:21.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.253+0000 7fe59dc92640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe598156b40 0x7fe598151710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:21.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.253+0000 7fe59dc92640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe5981607a0 0x7fe598159490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:21.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.253+0000 7fe59dc92640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe5980c6b80 con 0x7fe5981607a0 2024-05-04T02:48:21.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.253+0000 7fe59dc92640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe5980b6ee0 con 0x7fe598156b40 2024-05-04T02:48:21.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.253+0000 7fe59dc92640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe5980b46e0 con 0x7fe5980cd480 2024-05-04T02:48:21.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.254+0000 7fe597fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe5981607a0 0x7fe598159490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:21.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.254+0000 7fe597fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe5981607a0 0x7fe598159490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37786/0 (socket says 172.21.15.1:37786) 2024-05-04T02:48:21.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.254+0000 7fe597fff640 1 -- 172.21.15.1:0/1596929500 learned_addr learned my addr 172.21.15.1:0/1596929500 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:48:21.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.254+0000 7fe596ffd640 1 --2- 172.21.15.1:0/1596929500 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe598156b40 0x7fe598151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:21.255 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.254+0000 7fe5977fe640 1 --2- 172.21.15.1:0/1596929500 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe5980cd480 0x7fe5980d00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:21.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.258+0000 7fe597fff640 1 -- 172.21.15.1:0/1596929500 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe5980cd480 msgr2=0x7fe5980d00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:21.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.258+0000 7fe597fff640 1 --2- 172.21.15.1:0/1596929500 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe5980cd480 0x7fe5980d00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:21.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.258+0000 7fe597fff640 1 -- 172.21.15.1:0/1596929500 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe598156b40 msgr2=0x7fe598151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:21.259 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.258+0000 7fe597fff640 1 --2- 172.21.15.1:0/1596929500 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe598156b40 0x7fe598151710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:21.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.258+0000 7fe597fff640 1 -- 172.21.15.1:0/1596929500 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5980d05e0 con 0x7fe5981607a0 2024-05-04T02:48:21.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.261+0000 7fe597fff640 1 --2- 172.21.15.1:0/1596929500 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe5981607a0 0x7fe598159490 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe59000c730 tx=0x7fe59000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:21.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.265+0000 7fe57ffff640 1 -- 172.21.15.1:0/1596929500 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe590003b70 con 0x7fe5981607a0 2024-05-04T02:48:21.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.265+0000 7fe57ffff640 1 -- 172.21.15.1:0/1596929500 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe590003d10 con 0x7fe5981607a0 2024-05-04T02:48:21.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.265+0000 7fe57ffff640 1 -- 172.21.15.1:0/1596929500 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe59000aa70 con 0x7fe5981607a0 2024-05-04T02:48:21.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.265+0000 7fe59dc92640 1 -- 172.21.15.1:0/1596929500 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5981f5db0 con 0x7fe5981607a0 2024-05-04T02:48:21.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.265+0000 7fe59dc92640 1 -- 172.21.15.1:0/1596929500 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5981f6370 con 0x7fe5981607a0 2024-05-04T02:48:21.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.266+0000 7fe59dc92640 1 -- 172.21.15.1:0/1596929500 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe598150180 con 0x7fe5981607a0 2024-05-04T02:48:21.289 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.289+0000 7fe57ffff640 1 -- 172.21.15.1:0/1596929500 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe59000ac10 con 0x7fe5981607a0 2024-05-04T02:48:21.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.289+0000 7fe57ffff640 1 --2- 172.21.15.1:0/1596929500 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fe584076320 0x7fe584078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:21.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.289+0000 7fe5977fe640 1 --2- 172.21.15.1:0/1596929500 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fe584076320 0x7fe584078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:21.290 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.290+0000 7fe5977fe640 1 --2- 172.21.15.1:0/1596929500 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fe584076320 0x7fe584078830 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe588034000 tx=0x7fe58802e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:21.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.294+0000 7fe57ffff640 1 -- 172.21.15.1:0/1596929500 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5854+0+0 (secure 0 0 0) 0x7fe59005d380 con 0x7fe5981607a0 2024-05-04T02:48:21.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.607+0000 7fe57ffff640 1 -- 172.21.15.1:0/1596929500 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe598150180 con 0x7fe5981607a0 2024-05-04T02:48:21.806 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.805+0000 7fe59dc92640 1 -- 172.21.15.1:0/1596929500 --> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe598069bc0 con 0x7fe584076320 2024-05-04T02:48:21.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.812+0000 7fe57ffff640 1 -- 172.21.15.1:0/1596929500 <== mgr.4108 v2:172.21.15.107:6800/3809222574 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+253068 (secure 0 0 0) 0x7fe598069bc0 con 0x7fe584076320 2024-05-04T02:48:21.815 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:48:21.817 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-05-04T02:48:21.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.815+0000 7fe59dc92640 1 -- 172.21.15.1:0/1596929500 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fe584076320 msgr2=0x7fe584078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:21.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.815+0000 7fe59dc92640 1 --2- 172.21.15.1:0/1596929500 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fe584076320 0x7fe584078830 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe588034000 tx=0x7fe58802e000 comp rx=0 tx=0).stop 2024-05-04T02:48:21.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.815+0000 7fe59dc92640 1 -- 172.21.15.1:0/1596929500 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe5981607a0 msgr2=0x7fe598159490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:21.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.815+0000 7fe59dc92640 1 --2- 172.21.15.1:0/1596929500 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe5981607a0 0x7fe598159490 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe59000c730 tx=0x7fe59000cbf0 comp rx=0 tx=0).stop 2024-05-04T02:48:21.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.815+0000 7fe59dc92640 1 -- 172.21.15.1:0/1596929500 shutdown_connections 2024-05-04T02:48:21.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.815+0000 7fe59dc92640 1 --2- 172.21.15.1:0/1596929500 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fe584076320 0x7fe584078830 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:21.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.815+0000 7fe59dc92640 1 --2- 172.21.15.1:0/1596929500 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe5981607a0 0x7fe598159490 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:21.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.815+0000 7fe59dc92640 1 --2- 172.21.15.1:0/1596929500 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe598156b40 0x7fe598151710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:21.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.815+0000 7fe59dc92640 1 --2- 172.21.15.1:0/1596929500 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe5980cd480 0x7fe5980d00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:21.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.815+0000 7fe59dc92640 1 -- 172.21.15.1:0/1596929500 >> 172.21.15.1:0/1596929500 conn(0x7fe5980ce560 msgr2=0x7fe5980c7e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:48:21.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.815+0000 7fe59dc92640 1 -- 172.21.15.1:0/1596929500 shutdown_connections 2024-05-04T02:48:21.819 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.815+0000 7fe59dc92640 1 -- 172.21.15.1:0/1596929500 wait complete. 2024-05-04T02:48:21.828 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":870,"stamp":"2024-05-04T02:48:21.514585+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":38130963,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":907,"num_read_kb":952,"num_write":14340,"num_write_kb":337389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13312,"ondisk_log_size":13312,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":361760,"kb_used_data":49888,"kb_used_omap":12,"kb_used_meta":311795,"kb_avail":754612960,"statfs":{"total":773094113280,"available":772723671040,"internally_reserved":0,"allocated":51085312,"data_stored":77037504,"data_compressed":7561304,"data_compressed_allocated":11436032,"data_compressed_original":38748160,"omap_allocated":12752,"internal_metadata":319278640},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":137460,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":47,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003973"},"pg_stats":[{"pgid":"3.3f","version":"25'66","reported_seq":89,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.484191+0000","last_change":"2024-05-04T02:20:53.380646+0000","last_active":"2024-05-04T02:48:13.484191+0000","last_peered":"2024-05-04T02:48:13.484191+0000","last_clean":"2024-05-04T02:48:13.484191+0000","last_became_active":"2024-05-04T02:20:53.380291+0000","last_became_peered":"2024-05-04T02:20:53.380291+0000","last_unstale":"2024-05-04T02:48:13.484191+0000","last_undegraded":"2024-05-04T02:48:13.484191+0000","last_fullsized":"2024-05-04T02:48:13.484191+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:40:37.553293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":3382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3e","version":"25'82","reported_seq":116,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.481403+0000","last_change":"2024-05-04T02:20:15.299265+0000","last_active":"2024-05-04T02:48:13.481403+0000","last_peered":"2024-05-04T02:48:13.481403+0000","last_clean":"2024-05-04T02:48:13.481403+0000","last_became_active":"2024-05-04T02:20:15.298956+0000","last_became_peered":"2024-05-04T02:20:15.298956+0000","last_unstale":"2024-05-04T02:48:13.481403+0000","last_undegraded":"2024-05-04T02:48:13.481403+0000","last_fullsized":"2024-05-04T02:48:13.481403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:23:25.157473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":2093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"25'86","reported_seq":120,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.710579+0000","last_change":"2024-05-04T02:20:15.297447+0000","last_active":"2024-05-04T02:48:13.710579+0000","last_peered":"2024-05-04T02:48:13.710579+0000","last_clean":"2024-05-04T02:48:13.710579+0000","last_became_active":"2024-05-04T02:20:15.297150+0000","last_became_peered":"2024-05-04T02:20:15.297150+0000","last_unstale":"2024-05-04T02:48:13.710579+0000","last_undegraded":"2024-05-04T02:48:13.710579+0000","last_fullsized":"2024-05-04T02:48:13.710579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:10:27.059401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":4094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"25'50","reported_seq":84,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.527559+0000","last_change":"2024-05-04T02:20:15.301427+0000","last_active":"2024-05-04T02:48:13.527559+0000","last_peered":"2024-05-04T02:48:13.527559+0000","last_clean":"2024-05-04T02:48:13.527559+0000","last_became_active":"2024-05-04T02:20:15.301113+0000","last_became_peered":"2024-05-04T02:20:15.301113+0000","last_unstale":"2024-05-04T02:48:13.527559+0000","last_undegraded":"2024-05-04T02:48:13.527559+0000","last_fullsized":"2024-05-04T02:48:13.527559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:06:48.185771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":1582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"25'54","reported_seq":86,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.604371+0000","last_change":"2024-05-04T02:20:15.297817+0000","last_active":"2024-05-04T02:48:13.604371+0000","last_peered":"2024-05-04T02:48:13.604371+0000","last_clean":"2024-05-04T02:48:13.604371+0000","last_became_active":"2024-05-04T02:20:15.297511+0000","last_became_peered":"2024-05-04T02:20:15.297511+0000","last_unstale":"2024-05-04T02:48:13.604371+0000","last_undegraded":"2024-05-04T02:48:13.604371+0000","last_fullsized":"2024-05-04T02:48:13.604371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:33:31.416768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":3466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"25'86","reported_seq":118,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.524090+0000","last_change":"2024-05-04T02:20:15.306853+0000","last_active":"2024-05-04T02:48:13.524090+0000","last_peered":"2024-05-04T02:48:13.524090+0000","last_clean":"2024-05-04T02:48:13.524090+0000","last_became_active":"2024-05-04T02:20:15.306537+0000","last_became_peered":"2024-05-04T02:20:15.306537+0000","last_unstale":"2024-05-04T02:48:13.524090+0000","last_undegraded":"2024-05-04T02:48:13.524090+0000","last_fullsized":"2024-05-04T02:48:13.524090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:35:15.732585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":4281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"25'87","reported_seq":119,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.615849+0000","last_change":"2024-05-04T02:20:15.299499+0000","last_active":"2024-05-04T02:48:13.615849+0000","last_peered":"2024-05-04T02:48:13.615849+0000","last_clean":"2024-05-04T02:48:13.615849+0000","last_became_active":"2024-05-04T02:20:15.299177+0000","last_became_peered":"2024-05-04T02:20:15.299177+0000","last_unstale":"2024-05-04T02:48:13.615849+0000","last_undegraded":"2024-05-04T02:48:13.615849+0000","last_fullsized":"2024-05-04T02:48:13.615849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:13:25.600467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75,"num_write_kb":3160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"25'62","reported_seq":94,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.571271+0000","last_change":"2024-05-04T02:20:15.306964+0000","last_active":"2024-05-04T02:48:13.571271+0000","last_peered":"2024-05-04T02:48:13.571271+0000","last_clean":"2024-05-04T02:48:13.571271+0000","last_became_active":"2024-05-04T02:20:15.306663+0000","last_became_peered":"2024-05-04T02:20:15.306663+0000","last_unstale":"2024-05-04T02:48:13.571271+0000","last_undegraded":"2024-05-04T02:48:13.571271+0000","last_fullsized":"2024-05-04T02:48:13.571271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:52:22.299082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":4413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"25'72","reported_seq":104,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.608102+0000","last_change":"2024-05-04T02:20:15.303354+0000","last_active":"2024-05-04T02:48:13.608102+0000","last_peered":"2024-05-04T02:48:13.608102+0000","last_clean":"2024-05-04T02:48:13.608102+0000","last_became_active":"2024-05-04T02:20:15.303055+0000","last_became_peered":"2024-05-04T02:20:15.303055+0000","last_unstale":"2024-05-04T02:48:13.608102+0000","last_undegraded":"2024-05-04T02:48:13.608102+0000","last_fullsized":"2024-05-04T02:48:13.608102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:22:30.839899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":5860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"25'70","reported_seq":102,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.625591+0000","last_change":"2024-05-04T02:20:15.307433+0000","last_active":"2024-05-04T02:48:13.625591+0000","last_peered":"2024-05-04T02:48:13.625591+0000","last_clean":"2024-05-04T02:48:13.625591+0000","last_became_active":"2024-05-04T02:20:15.307124+0000","last_became_peered":"2024-05-04T02:20:15.307124+0000","last_unstale":"2024-05-04T02:48:13.625591+0000","last_undegraded":"2024-05-04T02:48:13.625591+0000","last_fullsized":"2024-05-04T02:48:13.625591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:22:04.903746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":2059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"25'65","reported_seq":97,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.618354+0000","last_change":"2024-05-04T02:20:15.306714+0000","last_active":"2024-05-04T02:48:13.618354+0000","last_peered":"2024-05-04T02:48:13.618354+0000","last_clean":"2024-05-04T02:48:13.618354+0000","last_became_active":"2024-05-04T02:20:15.306409+0000","last_became_peered":"2024-05-04T02:20:15.306409+0000","last_unstale":"2024-05-04T02:48:13.618354+0000","last_undegraded":"2024-05-04T02:48:13.618354+0000","last_fullsized":"2024-05-04T02:48:13.618354+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:51:58.828664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"25'50","reported_seq":82,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.521353+0000","last_change":"2024-05-04T02:20:15.296940+0000","last_active":"2024-05-04T02:48:13.521353+0000","last_peered":"2024-05-04T02:48:13.521353+0000","last_clean":"2024-05-04T02:48:13.521353+0000","last_became_active":"2024-05-04T02:20:15.296640+0000","last_became_peered":"2024-05-04T02:20:15.296640+0000","last_unstale":"2024-05-04T02:48:13.521353+0000","last_undegraded":"2024-05-04T02:48:13.521353+0000","last_fullsized":"2024-05-04T02:48:13.521353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:25:44.598454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":2327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"25'84","reported_seq":116,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.572426+0000","last_change":"2024-05-04T02:20:15.294287+0000","last_active":"2024-05-04T02:48:13.572426+0000","last_peered":"2024-05-04T02:48:13.572426+0000","last_clean":"2024-05-04T02:48:13.572426+0000","last_became_active":"2024-05-04T02:20:15.293909+0000","last_became_peered":"2024-05-04T02:20:15.293909+0000","last_unstale":"2024-05-04T02:48:13.572426+0000","last_undegraded":"2024-05-04T02:48:13.572426+0000","last_fullsized":"2024-05-04T02:48:13.572426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:31:26.635672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":6748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"25'70","reported_seq":103,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.711912+0000","last_change":"2024-05-04T02:20:15.293837+0000","last_active":"2024-05-04T02:48:13.711912+0000","last_peered":"2024-05-04T02:48:13.711912+0000","last_clean":"2024-05-04T02:48:13.711912+0000","last_became_active":"2024-05-04T02:20:15.293550+0000","last_became_peered":"2024-05-04T02:20:15.293550+0000","last_unstale":"2024-05-04T02:48:13.711912+0000","last_undegraded":"2024-05-04T02:48:13.711912+0000","last_fullsized":"2024-05-04T02:48:13.711912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:55:35.975972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":6468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"25'94","reported_seq":127,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.488175+0000","last_change":"2024-05-04T02:20:15.306005+0000","last_active":"2024-05-04T02:48:13.488175+0000","last_peered":"2024-05-04T02:48:13.488175+0000","last_clean":"2024-05-04T02:48:13.488175+0000","last_became_active":"2024-05-04T02:20:15.305549+0000","last_became_peered":"2024-05-04T02:20:15.305549+0000","last_unstale":"2024-05-04T02:48:13.488175+0000","last_undegraded":"2024-05-04T02:48:13.488175+0000","last_fullsized":"2024-05-04T02:48:13.488175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:58:55.400048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":3628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"25'80","reported_seq":113,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.527476+0000","last_change":"2024-05-04T02:20:15.305322+0000","last_active":"2024-05-04T02:48:13.527476+0000","last_peered":"2024-05-04T02:48:13.527476+0000","last_clean":"2024-05-04T02:48:13.527476+0000","last_became_active":"2024-05-04T02:20:15.301515+0000","last_became_peered":"2024-05-04T02:20:15.301515+0000","last_unstale":"2024-05-04T02:48:13.527476+0000","last_undegraded":"2024-05-04T02:48:13.527476+0000","last_fullsized":"2024-05-04T02:48:13.527476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:10:21.048301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":4426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"25'78","reported_seq":111,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.529144+0000","last_change":"2024-05-04T02:20:15.301042+0000","last_active":"2024-05-04T02:48:13.529144+0000","last_peered":"2024-05-04T02:48:13.529144+0000","last_clean":"2024-05-04T02:48:13.529144+0000","last_became_active":"2024-05-04T02:20:15.300707+0000","last_became_peered":"2024-05-04T02:20:15.300707+0000","last_unstale":"2024-05-04T02:48:13.529144+0000","last_undegraded":"2024-05-04T02:48:13.529144+0000","last_fullsized":"2024-05-04T02:48:13.529144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:36:19.111702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":4257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"25'87","reported_seq":120,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.492002+0000","last_change":"2024-05-04T02:20:15.292059+0000","last_active":"2024-05-04T02:48:13.492002+0000","last_peered":"2024-05-04T02:48:13.492002+0000","last_clean":"2024-05-04T02:48:13.492002+0000","last_became_active":"2024-05-04T02:20:15.291766+0000","last_became_peered":"2024-05-04T02:20:15.291766+0000","last_unstale":"2024-05-04T02:48:13.492002+0000","last_undegraded":"2024-05-04T02:48:13.492002+0000","last_fullsized":"2024-05-04T02:48:13.492002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:49:41.728826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":5570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"25'65","reported_seq":98,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.604751+0000","last_change":"2024-05-04T02:20:15.297861+0000","last_active":"2024-05-04T02:48:13.604751+0000","last_peered":"2024-05-04T02:48:13.604751+0000","last_clean":"2024-05-04T02:48:13.604751+0000","last_became_active":"2024-05-04T02:20:15.297568+0000","last_became_peered":"2024-05-04T02:20:15.297568+0000","last_unstale":"2024-05-04T02:48:13.604751+0000","last_undegraded":"2024-05-04T02:48:13.604751+0000","last_fullsized":"2024-05-04T02:48:13.604751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:52:52.278453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":4387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"25'89","reported_seq":122,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.619958+0000","last_change":"2024-05-04T02:20:15.303036+0000","last_active":"2024-05-04T02:48:13.619958+0000","last_peered":"2024-05-04T02:48:13.619958+0000","last_clean":"2024-05-04T02:48:13.619958+0000","last_became_active":"2024-05-04T02:20:15.302743+0000","last_became_peered":"2024-05-04T02:20:15.302743+0000","last_unstale":"2024-05-04T02:48:13.619958+0000","last_undegraded":"2024-05-04T02:48:13.619958+0000","last_fullsized":"2024-05-04T02:48:13.619958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:58:55.400048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75,"num_write_kb":8052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"25'110","reported_seq":143,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.677669+0000","last_change":"2024-05-04T02:20:15.300987+0000","last_active":"2024-05-04T02:48:13.677669+0000","last_peered":"2024-05-04T02:48:13.677669+0000","last_clean":"2024-05-04T02:48:13.677669+0000","last_became_active":"2024-05-04T02:20:15.300709+0000","last_became_peered":"2024-05-04T02:20:15.300709+0000","last_unstale":"2024-05-04T02:48:13.677669+0000","last_undegraded":"2024-05-04T02:48:13.677669+0000","last_fullsized":"2024-05-04T02:48:13.677669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:15:46.319755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":9218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"25'64","reported_seq":97,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.528965+0000","last_change":"2024-05-04T02:20:15.301545+0000","last_active":"2024-05-04T02:48:13.528965+0000","last_peered":"2024-05-04T02:48:13.528965+0000","last_clean":"2024-05-04T02:48:13.528965+0000","last_became_active":"2024-05-04T02:20:15.300848+0000","last_became_peered":"2024-05-04T02:20:15.300848+0000","last_unstale":"2024-05-04T02:48:13.528965+0000","last_undegraded":"2024-05-04T02:48:13.528965+0000","last_fullsized":"2024-05-04T02:48:13.528965+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:26:17.650165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":2229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"25'75","reported_seq":108,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.567290+0000","last_change":"2024-05-04T02:20:15.302188+0000","last_active":"2024-05-04T02:48:13.567290+0000","last_peered":"2024-05-04T02:48:13.567290+0000","last_clean":"2024-05-04T02:48:13.567290+0000","last_became_active":"2024-05-04T02:20:15.301879+0000","last_became_peered":"2024-05-04T02:20:15.301879+0000","last_unstale":"2024-05-04T02:48:13.567290+0000","last_undegraded":"2024-05-04T02:48:13.567290+0000","last_fullsized":"2024-05-04T02:48:13.567290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:51:58.828664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":4046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"25'55","reported_seq":77,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.486920+0000","last_change":"2024-05-04T02:20:53.115860+0000","last_active":"2024-05-04T02:48:13.486920+0000","last_peered":"2024-05-04T02:48:13.486920+0000","last_clean":"2024-05-04T02:48:13.486920+0000","last_became_active":"2024-05-04T02:20:53.115499+0000","last_became_peered":"2024-05-04T02:20:53.115499+0000","last_unstale":"2024-05-04T02:48:13.486920+0000","last_undegraded":"2024-05-04T02:48:13.486920+0000","last_fullsized":"2024-05-04T02:48:13.486920+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:48:25.169824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":4120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"25'84","reported_seq":117,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.543660+0000","last_change":"2024-05-04T02:20:15.301659+0000","last_active":"2024-05-04T02:48:13.543660+0000","last_peered":"2024-05-04T02:48:13.543660+0000","last_clean":"2024-05-04T02:48:13.543660+0000","last_became_active":"2024-05-04T02:20:15.301363+0000","last_became_peered":"2024-05-04T02:20:15.301363+0000","last_unstale":"2024-05-04T02:48:13.543660+0000","last_undegraded":"2024-05-04T02:48:13.543660+0000","last_fullsized":"2024-05-04T02:48:13.543660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:23:25.157473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":4697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"25'75","reported_seq":108,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.623404+0000","last_change":"2024-05-04T02:20:15.295843+0000","last_active":"2024-05-04T02:48:13.623404+0000","last_peered":"2024-05-04T02:48:13.623404+0000","last_clean":"2024-05-04T02:48:13.623404+0000","last_became_active":"2024-05-04T02:20:15.295577+0000","last_became_peered":"2024-05-04T02:20:15.295577+0000","last_unstale":"2024-05-04T02:48:13.623404+0000","last_undegraded":"2024-05-04T02:48:13.623404+0000","last_fullsized":"2024-05-04T02:48:13.623404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:23:25.157473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":3524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"25'87","reported_seq":120,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.488294+0000","last_change":"2024-05-04T02:20:15.299661+0000","last_active":"2024-05-04T02:48:13.488294+0000","last_peered":"2024-05-04T02:48:13.488294+0000","last_clean":"2024-05-04T02:48:13.488294+0000","last_became_active":"2024-05-04T02:20:15.299230+0000","last_became_peered":"2024-05-04T02:20:15.299230+0000","last_unstale":"2024-05-04T02:48:13.488294+0000","last_undegraded":"2024-05-04T02:48:13.488294+0000","last_fullsized":"2024-05-04T02:48:13.488294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:51:58.828664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":4545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"25'51","reported_seq":84,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.572483+0000","last_change":"2024-05-04T02:20:15.302719+0000","last_active":"2024-05-04T02:48:13.572483+0000","last_peered":"2024-05-04T02:48:13.572483+0000","last_clean":"2024-05-04T02:48:13.572483+0000","last_became_active":"2024-05-04T02:20:15.302456+0000","last_became_peered":"2024-05-04T02:20:15.302456+0000","last_unstale":"2024-05-04T02:48:13.572483+0000","last_undegraded":"2024-05-04T02:48:13.572483+0000","last_fullsized":"2024-05-04T02:48:13.572483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:06:48.185771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":7049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"25'65","reported_seq":99,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.676535+0000","last_change":"2024-05-04T02:20:15.296567+0000","last_active":"2024-05-04T02:48:13.676535+0000","last_peered":"2024-05-04T02:48:13.676535+0000","last_clean":"2024-05-04T02:48:13.676535+0000","last_became_active":"2024-05-04T02:20:15.296235+0000","last_became_peered":"2024-05-04T02:20:15.296235+0000","last_unstale":"2024-05-04T02:48:13.676535+0000","last_undegraded":"2024-05-04T02:48:13.676535+0000","last_fullsized":"2024-05-04T02:48:13.676535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:32:20.652776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":6740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"25'135","reported_seq":158,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.482735+0000","last_change":"2024-05-04T02:20:53.116445+0000","last_active":"2024-05-04T02:48:13.482735+0000","last_peered":"2024-05-04T02:48:13.482735+0000","last_clean":"2024-05-04T02:48:13.482735+0000","last_became_active":"2024-05-04T02:20:53.116069+0000","last_became_peered":"2024-05-04T02:20:53.116069+0000","last_unstale":"2024-05-04T02:48:13.482735+0000","last_undegraded":"2024-05-04T02:48:13.482735+0000","last_fullsized":"2024-05-04T02:48:13.482735+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:57:11.656812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":7251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"25'77","reported_seq":111,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.488795+0000","last_change":"2024-05-04T02:20:15.301739+0000","last_active":"2024-05-04T02:48:13.488795+0000","last_peered":"2024-05-04T02:48:13.488795+0000","last_clean":"2024-05-04T02:48:13.488795+0000","last_became_active":"2024-05-04T02:20:15.301424+0000","last_became_peered":"2024-05-04T02:20:15.301424+0000","last_unstale":"2024-05-04T02:48:13.488795+0000","last_undegraded":"2024-05-04T02:48:13.488795+0000","last_fullsized":"2024-05-04T02:48:13.488795+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:40:19.927293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":8003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"25'86","reported_seq":120,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.616633+0000","last_change":"2024-05-04T02:20:15.293189+0000","last_active":"2024-05-04T02:48:13.616633+0000","last_peered":"2024-05-04T02:48:13.616633+0000","last_clean":"2024-05-04T02:48:13.616633+0000","last_became_active":"2024-05-04T02:20:15.292840+0000","last_became_peered":"2024-05-04T02:20:15.292840+0000","last_unstale":"2024-05-04T02:48:13.616633+0000","last_undegraded":"2024-05-04T02:48:13.616633+0000","last_fullsized":"2024-05-04T02:48:13.616633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:01:57.617230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":6858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"25'66","reported_seq":98,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.520113+0000","last_change":"2024-05-04T02:20:15.297718+0000","last_active":"2024-05-04T02:48:13.520113+0000","last_peered":"2024-05-04T02:48:13.520113+0000","last_clean":"2024-05-04T02:48:13.520113+0000","last_became_active":"2024-05-04T02:20:15.297415+0000","last_became_peered":"2024-05-04T02:20:15.297415+0000","last_unstale":"2024-05-04T02:48:13.520113+0000","last_undegraded":"2024-05-04T02:48:13.520113+0000","last_fullsized":"2024-05-04T02:48:13.520113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:03:46.054307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":6149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"25'712","reported_seq":746,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:47:47.196612+0000","last_change":"2024-05-04T02:20:14.290469+0000","last_active":"2024-05-04T02:47:47.196612+0000","last_peered":"2024-05-04T02:47:47.196612+0000","last_clean":"2024-05-04T02:47:47.196612+0000","last_became_active":"2024-05-04T02:20:14.289651+0000","last_became_peered":"2024-05-04T02:20:14.289651+0000","last_unstale":"2024-05-04T02:47:47.196612+0000","last_undegraded":"2024-05-04T02:47:47.196612+0000","last_fullsized":"2024-05-04T02:47:47.196612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":712,"log_dups_size":0,"ondisk_log_size":712,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:57:10.542857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":710,"num_write_kb":4451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"25'81","reported_seq":113,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.678763+0000","last_change":"2024-05-04T02:20:15.305933+0000","last_active":"2024-05-04T02:48:13.678763+0000","last_peered":"2024-05-04T02:48:13.678763+0000","last_clean":"2024-05-04T02:48:13.678763+0000","last_became_active":"2024-05-04T02:20:15.305597+0000","last_became_peered":"2024-05-04T02:20:15.305597+0000","last_unstale":"2024-05-04T02:48:13.678763+0000","last_undegraded":"2024-05-04T02:48:13.678763+0000","last_fullsized":"2024-05-04T02:48:13.678763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:50:29.983685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":5085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"25'609","reported_seq":643,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:03.909161+0000","last_change":"2024-05-04T02:20:14.359094+0000","last_active":"2024-05-04T02:48:03.909161+0000","last_peered":"2024-05-04T02:48:03.909161+0000","last_clean":"2024-05-04T02:48:03.909161+0000","last_became_active":"2024-05-04T02:20:14.358394+0000","last_became_peered":"2024-05-04T02:20:14.358394+0000","last_unstale":"2024-05-04T02:48:03.909161+0000","last_undegraded":"2024-05-04T02:48:03.909161+0000","last_fullsized":"2024-05-04T02:48:03.909161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":609,"log_dups_size":0,"ondisk_log_size":609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:57:26.889464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":604,"num_write_kb":4430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"25'3","reported_seq":37,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:01.667263+0000","last_change":"2024-05-04T02:20:14.356259+0000","last_active":"2024-05-04T02:48:01.667263+0000","last_peered":"2024-05-04T02:48:01.667263+0000","last_clean":"2024-05-04T02:48:01.667263+0000","last_became_active":"2024-05-04T02:20:14.355988+0000","last_became_peered":"2024-05-04T02:20:14.355988+0000","last_unstale":"2024-05-04T02:48:01.667263+0000","last_undegraded":"2024-05-04T02:48:01.667263+0000","last_fullsized":"2024-05-04T02:48:01.667263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:40:36.439339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"25'73","reported_seq":105,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.568401+0000","last_change":"2024-05-04T02:20:15.295517+0000","last_active":"2024-05-04T02:48:13.568401+0000","last_peered":"2024-05-04T02:48:13.568401+0000","last_clean":"2024-05-04T02:48:13.568401+0000","last_became_active":"2024-05-04T02:20:15.295222+0000","last_became_peered":"2024-05-04T02:20:15.295222+0000","last_unstale":"2024-05-04T02:48:13.568401+0000","last_undegraded":"2024-05-04T02:48:13.568401+0000","last_fullsized":"2024-05-04T02:48:13.568401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:58:55.400048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":4655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"25'4","reported_seq":38,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:47:56.631136+0000","last_change":"2024-05-04T02:20:14.291543+0000","last_active":"2024-05-04T02:47:56.631136+0000","last_peered":"2024-05-04T02:47:56.631136+0000","last_clean":"2024-05-04T02:47:56.631136+0000","last_became_active":"2024-05-04T02:20:14.290893+0000","last_became_peered":"2024-05-04T02:20:14.290893+0000","last_unstale":"2024-05-04T02:47:56.631136+0000","last_undegraded":"2024-05-04T02:47:56.631136+0000","last_fullsized":"2024-05-04T02:47:56.631136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:57:10.542857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"25'86","reported_seq":118,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.493562+0000","last_change":"2024-05-04T02:20:15.291991+0000","last_active":"2024-05-04T02:48:13.493562+0000","last_peered":"2024-05-04T02:48:13.493562+0000","last_clean":"2024-05-04T02:48:13.493562+0000","last_became_active":"2024-05-04T02:20:15.291704+0000","last_became_peered":"2024-05-04T02:20:15.291704+0000","last_unstale":"2024-05-04T02:48:13.493562+0000","last_undegraded":"2024-05-04T02:48:13.493562+0000","last_fullsized":"2024-05-04T02:48:13.493562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:52:22.299082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":4969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"25'5","reported_seq":39,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:12.312177+0000","last_change":"2024-05-04T02:20:14.359336+0000","last_active":"2024-05-04T02:48:12.312177+0000","last_peered":"2024-05-04T02:48:12.312177+0000","last_clean":"2024-05-04T02:48:12.312177+0000","last_became_active":"2024-05-04T02:20:14.357940+0000","last_became_peered":"2024-05-04T02:20:14.357940+0000","last_unstale":"2024-05-04T02:48:12.312177+0000","last_undegraded":"2024-05-04T02:48:12.312177+0000","last_fullsized":"2024-05-04T02:48:12.312177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:48:24.055870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"25'92","reported_seq":124,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.529166+0000","last_change":"2024-05-04T02:20:15.301852+0000","last_active":"2024-05-04T02:48:13.529166+0000","last_peered":"2024-05-04T02:48:13.529166+0000","last_clean":"2024-05-04T02:48:13.529166+0000","last_became_active":"2024-05-04T02:20:15.300374+0000","last_became_peered":"2024-05-04T02:20:15.300374+0000","last_unstale":"2024-05-04T02:48:13.529166+0000","last_undegraded":"2024-05-04T02:48:13.529166+0000","last_fullsized":"2024-05-04T02:48:13.529166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:16:20.585860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":5924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"25'5","reported_seq":39,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:10.615618+0000","last_change":"2024-05-04T02:20:14.358952+0000","last_active":"2024-05-04T02:48:10.615618+0000","last_peered":"2024-05-04T02:48:10.615618+0000","last_clean":"2024-05-04T02:48:10.615618+0000","last_became_active":"2024-05-04T02:20:14.358625+0000","last_became_peered":"2024-05-04T02:20:14.358625+0000","last_unstale":"2024-05-04T02:48:10.615618+0000","last_undegraded":"2024-05-04T02:48:10.615618+0000","last_fullsized":"2024-05-04T02:48:10.615618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:52:21.185127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"25'59","reported_seq":91,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.610978+0000","last_change":"2024-05-04T02:20:15.307242+0000","last_active":"2024-05-04T02:48:13.610978+0000","last_peered":"2024-05-04T02:48:13.610978+0000","last_clean":"2024-05-04T02:48:13.610978+0000","last_became_active":"2024-05-04T02:20:15.306572+0000","last_became_peered":"2024-05-04T02:20:15.306572+0000","last_unstale":"2024-05-04T02:48:13.610978+0000","last_undegraded":"2024-05-04T02:48:13.610978+0000","last_fullsized":"2024-05-04T02:48:13.610978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:31:36.578679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":3639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"25'609","reported_seq":643,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:12.326866+0000","last_change":"2024-05-04T02:20:14.292979+0000","last_active":"2024-05-04T02:48:12.326866+0000","last_peered":"2024-05-04T02:48:12.326866+0000","last_clean":"2024-05-04T02:48:12.326866+0000","last_became_active":"2024-05-04T02:20:14.292564+0000","last_became_peered":"2024-05-04T02:20:14.292564+0000","last_unstale":"2024-05-04T02:48:12.326866+0000","last_undegraded":"2024-05-04T02:48:12.326866+0000","last_fullsized":"2024-05-04T02:48:12.326866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":609,"log_dups_size":0,"ondisk_log_size":609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:34:37.703735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":607,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"25'71","reported_seq":104,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.528110+0000","last_change":"2024-05-04T02:20:15.298392+0000","last_active":"2024-05-04T02:48:13.528110+0000","last_peered":"2024-05-04T02:48:13.528110+0000","last_clean":"2024-05-04T02:48:13.528110+0000","last_became_active":"2024-05-04T02:20:15.298018+0000","last_became_peered":"2024-05-04T02:20:15.298018+0000","last_unstale":"2024-05-04T02:48:13.528110+0000","last_undegraded":"2024-05-04T02:48:13.528110+0000","last_fullsized":"2024-05-04T02:48:13.528110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:42:57.398678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":3497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"25'829","reported_seq":863,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:47:54.393924+0000","last_change":"2024-05-04T02:20:14.360237+0000","last_active":"2024-05-04T02:47:54.393924+0000","last_peered":"2024-05-04T02:47:54.393924+0000","last_clean":"2024-05-04T02:47:54.393924+0000","last_became_active":"2024-05-04T02:20:14.359886+0000","last_became_peered":"2024-05-04T02:20:14.359886+0000","last_unstale":"2024-05-04T02:47:54.393924+0000","last_undegraded":"2024-05-04T02:47:54.393924+0000","last_fullsized":"2024-05-04T02:47:54.393924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":829,"log_dups_size":0,"ondisk_log_size":829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:34:37.703735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":826,"num_write_kb":4535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"25'64","reported_seq":101,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.606294+0000","last_change":"2024-05-04T02:20:53.117045+0000","last_active":"2024-05-04T02:48:13.606294+0000","last_peered":"2024-05-04T02:48:13.606294+0000","last_clean":"2024-05-04T02:48:13.606294+0000","last_became_active":"2024-05-04T02:20:53.116761+0000","last_became_peered":"2024-05-04T02:20:53.116761+0000","last_unstale":"2024-05-04T02:48:13.606294+0000","last_undegraded":"2024-05-04T02:48:13.606294+0000","last_fullsized":"2024-05-04T02:48:13.606294+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:30:15.675774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":3872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"25'9","reported_seq":44,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:03.919461+0000","last_change":"2024-05-04T02:20:14.274932+0000","last_active":"2024-05-04T02:48:03.919461+0000","last_peered":"2024-05-04T02:48:03.919461+0000","last_clean":"2024-05-04T02:48:03.919461+0000","last_became_active":"2024-05-04T02:20:14.274604+0000","last_became_peered":"2024-05-04T02:20:14.274604+0000","last_unstale":"2024-05-04T02:48:03.919461+0000","last_undegraded":"2024-05-04T02:48:03.919461+0000","last_fullsized":"2024-05-04T02:48:03.919461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:35:43.182599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"25'79","reported_seq":112,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.713302+0000","last_change":"2024-05-04T02:20:15.300355+0000","last_active":"2024-05-04T02:48:13.713302+0000","last_peered":"2024-05-04T02:48:13.713302+0000","last_clean":"2024-05-04T02:48:13.713302+0000","last_became_active":"2024-05-04T02:20:15.300052+0000","last_became_peered":"2024-05-04T02:20:15.300052+0000","last_unstale":"2024-05-04T02:48:13.713302+0000","last_undegraded":"2024-05-04T02:48:13.713302+0000","last_fullsized":"2024-05-04T02:48:13.713302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:06:27.072275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":4963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"25'6","reported_seq":41,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.822797+0000","last_change":"2024-05-04T02:20:14.290125+0000","last_active":"2024-05-04T02:48:13.822797+0000","last_peered":"2024-05-04T02:48:13.822797+0000","last_clean":"2024-05-04T02:48:13.822797+0000","last_became_active":"2024-05-04T02:20:14.289826+0000","last_became_peered":"2024-05-04T02:20:14.289826+0000","last_unstale":"2024-05-04T02:48:13.822797+0000","last_undegraded":"2024-05-04T02:48:13.822797+0000","last_fullsized":"2024-05-04T02:48:13.822797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:39:23.112031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"25'96","reported_seq":129,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.608379+0000","last_change":"2024-05-04T02:20:15.303257+0000","last_active":"2024-05-04T02:48:13.608379+0000","last_peered":"2024-05-04T02:48:13.608379+0000","last_clean":"2024-05-04T02:48:13.608379+0000","last_became_active":"2024-05-04T02:20:15.302963+0000","last_became_peered":"2024-05-04T02:20:15.302963+0000","last_unstale":"2024-05-04T02:48:13.608379+0000","last_undegraded":"2024-05-04T02:48:13.608379+0000","last_fullsized":"2024-05-04T02:48:13.608379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:05:46.729556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":14780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"25'5","reported_seq":40,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:01.665098+0000","last_change":"2024-05-04T02:20:14.359226+0000","last_active":"2024-05-04T02:48:01.665098+0000","last_peered":"2024-05-04T02:48:01.665098+0000","last_clean":"2024-05-04T02:48:01.665098+0000","last_became_active":"2024-05-04T02:20:14.358494+0000","last_became_peered":"2024-05-04T02:20:14.358494+0000","last_unstale":"2024-05-04T02:48:01.665098+0000","last_undegraded":"2024-05-04T02:48:01.665098+0000","last_fullsized":"2024-05-04T02:48:01.665098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:43:19.283728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"25'51","reported_seq":84,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.610357+0000","last_change":"2024-05-04T02:20:15.294689+0000","last_active":"2024-05-04T02:48:13.610357+0000","last_peered":"2024-05-04T02:48:13.610357+0000","last_clean":"2024-05-04T02:48:13.610357+0000","last_became_active":"2024-05-04T02:20:15.294400+0000","last_became_peered":"2024-05-04T02:20:15.294400+0000","last_unstale":"2024-05-04T02:48:13.610357+0000","last_undegraded":"2024-05-04T02:48:13.610357+0000","last_fullsized":"2024-05-04T02:48:13.610357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:22:33.019301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":2930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"25'12","reported_seq":47,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:12.313149+0000","last_change":"2024-05-04T02:20:14.269539+0000","last_active":"2024-05-04T02:48:12.313149+0000","last_peered":"2024-05-04T02:48:12.313149+0000","last_clean":"2024-05-04T02:48:12.313149+0000","last_became_active":"2024-05-04T02:20:14.269238+0000","last_became_peered":"2024-05-04T02:20:14.269238+0000","last_unstale":"2024-05-04T02:48:12.313149+0000","last_undegraded":"2024-05-04T02:48:12.313149+0000","last_fullsized":"2024-05-04T02:48:12.313149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:19:48.082162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"25'64","reported_seq":97,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.606107+0000","last_change":"2024-05-04T02:20:15.304355+0000","last_active":"2024-05-04T02:48:13.606107+0000","last_peered":"2024-05-04T02:48:13.606107+0000","last_clean":"2024-05-04T02:48:13.606107+0000","last_became_active":"2024-05-04T02:20:15.302736+0000","last_became_peered":"2024-05-04T02:20:15.302736+0000","last_unstale":"2024-05-04T02:48:13.606107+0000","last_undegraded":"2024-05-04T02:48:13.606107+0000","last_fullsized":"2024-05-04T02:48:13.606107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:35:15.732585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":3572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'5","reported_seq":40,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:10.617362+0000","last_change":"2024-05-04T02:20:14.272218+0000","last_active":"2024-05-04T02:48:10.617362+0000","last_peered":"2024-05-04T02:48:10.617362+0000","last_clean":"2024-05-04T02:48:10.617362+0000","last_became_active":"2024-05-04T02:20:14.271883+0000","last_became_peered":"2024-05-04T02:20:14.271883+0000","last_unstale":"2024-05-04T02:48:10.617362+0000","last_undegraded":"2024-05-04T02:48:10.617362+0000","last_fullsized":"2024-05-04T02:48:10.617362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:32:55.463882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"25'35","reported_seq":68,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.605988+0000","last_change":"2024-05-04T02:20:15.302202+0000","last_active":"2024-05-04T02:48:13.605988+0000","last_peered":"2024-05-04T02:48:13.605988+0000","last_clean":"2024-05-04T02:48:13.605988+0000","last_became_active":"2024-05-04T02:20:15.301880+0000","last_became_peered":"2024-05-04T02:20:15.301880+0000","last_unstale":"2024-05-04T02:48:13.605988+0000","last_undegraded":"2024-05-04T02:48:13.605988+0000","last_fullsized":"2024-05-04T02:48:13.605988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:32:43.559282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":1775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'4","reported_seq":39,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:04.961049+0000","last_change":"2024-05-04T02:20:14.292107+0000","last_active":"2024-05-04T02:48:04.961049+0000","last_peered":"2024-05-04T02:48:04.961049+0000","last_clean":"2024-05-04T02:48:04.961049+0000","last_became_active":"2024-05-04T02:20:14.290132+0000","last_became_peered":"2024-05-04T02:20:14.290132+0000","last_unstale":"2024-05-04T02:48:04.961049+0000","last_undegraded":"2024-05-04T02:48:04.961049+0000","last_fullsized":"2024-05-04T02:48:04.961049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:40:35.516308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"25'56","reported_seq":89,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.607231+0000","last_change":"2024-05-04T02:20:15.302140+0000","last_active":"2024-05-04T02:48:13.607231+0000","last_peered":"2024-05-04T02:48:13.607231+0000","last_clean":"2024-05-04T02:48:13.607231+0000","last_became_active":"2024-05-04T02:20:15.301798+0000","last_became_peered":"2024-05-04T02:20:15.301798+0000","last_unstale":"2024-05-04T02:48:13.607231+0000","last_undegraded":"2024-05-04T02:48:13.607231+0000","last_fullsized":"2024-05-04T02:48:13.607231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:20:28.069809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":3906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":36,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:45:01.187324+0000","last_change":"2024-05-04T02:20:14.274965+0000","last_active":"2024-05-04T02:45:01.187324+0000","last_peered":"2024-05-04T02:45:01.187324+0000","last_clean":"2024-05-04T02:45:01.187324+0000","last_became_active":"2024-05-04T02:20:14.274609+0000","last_became_peered":"2024-05-04T02:20:14.274609+0000","last_unstale":"2024-05-04T02:45:01.187324+0000","last_undegraded":"2024-05-04T02:45:01.187324+0000","last_fullsized":"2024-05-04T02:45:01.187324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:43:19.283728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"25'84","reported_seq":117,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.520405+0000","last_change":"2024-05-04T02:20:15.305486+0000","last_active":"2024-05-04T02:48:13.520405+0000","last_peered":"2024-05-04T02:48:13.520405+0000","last_clean":"2024-05-04T02:48:13.520405+0000","last_became_active":"2024-05-04T02:20:15.301880+0000","last_became_peered":"2024-05-04T02:20:15.301880+0000","last_unstale":"2024-05-04T02:48:13.520405+0000","last_undegraded":"2024-05-04T02:48:13.520405+0000","last_fullsized":"2024-05-04T02:48:13.520405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:13:25.600467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70,"num_write_kb":6433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"25'2","reported_seq":37,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:47:56.668241+0000","last_change":"2024-05-04T02:20:14.288834+0000","last_active":"2024-05-04T02:47:56.668241+0000","last_peered":"2024-05-04T02:47:56.668241+0000","last_clean":"2024-05-04T02:47:56.668241+0000","last_became_active":"2024-05-04T02:20:14.287992+0000","last_became_peered":"2024-05-04T02:20:14.287992+0000","last_unstale":"2024-05-04T02:47:56.668241+0000","last_undegraded":"2024-05-04T02:47:56.668241+0000","last_fullsized":"2024-05-04T02:47:56.668241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:39:08.143762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"25'61","reported_seq":94,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.608504+0000","last_change":"2024-05-04T02:20:15.303880+0000","last_active":"2024-05-04T02:48:13.608504+0000","last_peered":"2024-05-04T02:48:13.608504+0000","last_clean":"2024-05-04T02:48:13.608504+0000","last_became_active":"2024-05-04T02:20:15.303601+0000","last_became_peered":"2024-05-04T02:20:15.303601+0000","last_unstale":"2024-05-04T02:48:13.608504+0000","last_undegraded":"2024-05-04T02:48:13.608504+0000","last_fullsized":"2024-05-04T02:48:13.608504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:26:17.650165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":2391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":132,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:46:07.109143+0000","last_change":"2024-05-04T02:20:02.920020+0000","last_active":"2024-05-04T02:46:07.109143+0000","last_peered":"2024-05-04T02:46:07.109143+0000","last_clean":"2024-05-04T02:46:07.109143+0000","last_became_active":"2024-05-04T02:20:02.918859+0000","last_became_peered":"2024-05-04T02:20:02.918859+0000","last_unstale":"2024-05-04T02:46:07.109143+0000","last_undegraded":"2024-05-04T02:46:07.109143+0000","last_fullsized":"2024-05-04T02:46:07.109143+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:00.162760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:00.162760+0000","last_clean_scrub_stamp":"2024-05-04T02:20:00.162760+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:25:04.934922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"25'1","reported_seq":37,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:47:22.179461+0000","last_change":"2024-05-04T02:20:14.290136+0000","last_active":"2024-05-04T02:47:22.179461+0000","last_peered":"2024-05-04T02:47:22.179461+0000","last_clean":"2024-05-04T02:47:22.179461+0000","last_became_active":"2024-05-04T02:20:14.289597+0000","last_became_peered":"2024-05-04T02:20:14.289597+0000","last_unstale":"2024-05-04T02:47:22.179461+0000","last_undegraded":"2024-05-04T02:47:22.179461+0000","last_fullsized":"2024-05-04T02:47:22.179461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:43:19.283728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"25'46","reported_seq":80,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.561859+0000","last_change":"2024-05-04T02:20:15.306971+0000","last_active":"2024-05-04T02:48:13.561859+0000","last_peered":"2024-05-04T02:48:13.561859+0000","last_clean":"2024-05-04T02:48:13.561859+0000","last_became_active":"2024-05-04T02:20:15.306640+0000","last_became_peered":"2024-05-04T02:20:15.306640+0000","last_unstale":"2024-05-04T02:48:13.561859+0000","last_undegraded":"2024-05-04T02:48:13.561859+0000","last_fullsized":"2024-05-04T02:48:13.561859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:22:04.903746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":2916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"25'362","reported_seq":398,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.277721+0000","last_change":"2024-05-04T02:20:14.291379+0000","last_active":"2024-05-04T02:48:13.277721+0000","last_peered":"2024-05-04T02:48:13.277721+0000","last_clean":"2024-05-04T02:48:13.277721+0000","last_became_active":"2024-05-04T02:20:14.291044+0000","last_became_peered":"2024-05-04T02:20:14.291044+0000","last_unstale":"2024-05-04T02:48:13.277721+0000","last_undegraded":"2024-05-04T02:48:13.277721+0000","last_fullsized":"2024-05-04T02:48:13.277721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":362,"log_dups_size":0,"ondisk_log_size":362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:58:54.286093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3803499,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":356,"num_write_kb":3902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"25'52","reported_seq":86,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.710319+0000","last_change":"2024-05-04T02:20:15.305870+0000","last_active":"2024-05-04T02:48:13.710319+0000","last_peered":"2024-05-04T02:48:13.710319+0000","last_clean":"2024-05-04T02:48:13.710319+0000","last_became_active":"2024-05-04T02:20:15.305512+0000","last_became_peered":"2024-05-04T02:20:15.305512+0000","last_unstale":"2024-05-04T02:48:13.710319+0000","last_undegraded":"2024-05-04T02:48:13.710319+0000","last_fullsized":"2024-05-04T02:48:13.710319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:11:17.529449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":2895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"25'849","reported_seq":1726,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.493399+0000","last_change":"2024-05-04T02:20:14.287676+0000","last_active":"2024-05-04T02:48:13.493399+0000","last_peered":"2024-05-04T02:48:13.493399+0000","last_clean":"2024-05-04T02:48:13.493399+0000","last_became_active":"2024-05-04T02:20:14.287335+0000","last_became_peered":"2024-05-04T02:20:14.287335+0000","last_unstale":"2024-05-04T02:48:13.493399+0000","last_undegraded":"2024-05-04T02:48:13.493399+0000","last_fullsized":"2024-05-04T02:48:13.493399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":849,"log_dups_size":0,"ondisk_log_size":849,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:54:20.482900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":181194,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":841,"num_read_kb":897,"num_write":844,"num_write_kb":899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"25'71","reported_seq":106,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.491490+0000","last_change":"2024-05-04T02:20:15.297316+0000","last_active":"2024-05-04T02:48:13.491490+0000","last_peered":"2024-05-04T02:48:13.491490+0000","last_clean":"2024-05-04T02:48:13.491490+0000","last_became_active":"2024-05-04T02:20:15.297010+0000","last_became_peered":"2024-05-04T02:20:15.297010+0000","last_unstale":"2024-05-04T02:48:13.491490+0000","last_undegraded":"2024-05-04T02:48:13.491490+0000","last_fullsized":"2024-05-04T02:48:13.491490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:22:33.019301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":1942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"25'5","reported_seq":41,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:01.666970+0000","last_change":"2024-05-04T02:20:14.292802+0000","last_active":"2024-05-04T02:48:01.666970+0000","last_peered":"2024-05-04T02:48:01.666970+0000","last_clean":"2024-05-04T02:48:01.666970+0000","last_became_active":"2024-05-04T02:20:14.292595+0000","last_became_peered":"2024-05-04T02:20:14.292595+0000","last_unstale":"2024-05-04T02:48:01.666970+0000","last_undegraded":"2024-05-04T02:48:01.666970+0000","last_fullsized":"2024-05-04T02:48:01.666970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:31:25.521717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"25'85","reported_seq":119,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.517744+0000","last_change":"2024-05-04T02:20:15.296358+0000","last_active":"2024-05-04T02:48:13.517744+0000","last_peered":"2024-05-04T02:48:13.517744+0000","last_clean":"2024-05-04T02:48:13.517744+0000","last_became_active":"2024-05-04T02:20:15.296075+0000","last_became_peered":"2024-05-04T02:20:15.296075+0000","last_unstale":"2024-05-04T02:48:13.517744+0000","last_undegraded":"2024-05-04T02:48:13.517744+0000","last_fullsized":"2024-05-04T02:48:13.517744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:30:50.014584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":6268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"25'3","reported_seq":39,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:03.908572+0000","last_change":"2024-05-04T02:20:14.253846+0000","last_active":"2024-05-04T02:48:03.908572+0000","last_peered":"2024-05-04T02:48:03.908572+0000","last_clean":"2024-05-04T02:48:03.908572+0000","last_became_active":"2024-05-04T02:20:14.253513+0000","last_became_peered":"2024-05-04T02:20:14.253513+0000","last_unstale":"2024-05-04T02:48:03.908572+0000","last_undegraded":"2024-05-04T02:48:03.908572+0000","last_fullsized":"2024-05-04T02:48:03.908572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:40:36.439339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"25'68","reported_seq":102,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.524589+0000","last_change":"2024-05-04T02:20:15.300702+0000","last_active":"2024-05-04T02:48:13.524589+0000","last_peered":"2024-05-04T02:48:13.524589+0000","last_clean":"2024-05-04T02:48:13.524589+0000","last_became_active":"2024-05-04T02:20:15.300251+0000","last_became_peered":"2024-05-04T02:20:15.300251+0000","last_unstale":"2024-05-04T02:48:13.524589+0000","last_undegraded":"2024-05-04T02:48:13.524589+0000","last_fullsized":"2024-05-04T02:48:13.524589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:05:46.729556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":2367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"25'2","reported_seq":38,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:08.375514+0000","last_change":"2024-05-04T02:20:14.291304+0000","last_active":"2024-05-04T02:48:08.375514+0000","last_peered":"2024-05-04T02:48:08.375514+0000","last_clean":"2024-05-04T02:48:08.375514+0000","last_became_active":"2024-05-04T02:20:14.290952+0000","last_became_peered":"2024-05-04T02:20:14.290952+0000","last_unstale":"2024-05-04T02:48:08.375514+0000","last_undegraded":"2024-05-04T02:48:08.375514+0000","last_fullsized":"2024-05-04T02:48:08.375514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:15:55.478496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"25'68","reported_seq":102,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.487241+0000","last_change":"2024-05-04T02:20:15.296895+0000","last_active":"2024-05-04T02:48:13.487241+0000","last_peered":"2024-05-04T02:48:13.487241+0000","last_clean":"2024-05-04T02:48:13.487241+0000","last_became_active":"2024-05-04T02:20:15.296562+0000","last_became_peered":"2024-05-04T02:20:15.296562+0000","last_unstale":"2024-05-04T02:48:13.487241+0000","last_undegraded":"2024-05-04T02:48:13.487241+0000","last_fullsized":"2024-05-04T02:48:13.487241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:22:04.903746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":2660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"25'1353","reported_seq":1388,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:12.524952+0000","last_change":"2024-05-04T02:20:14.358920+0000","last_active":"2024-05-04T02:48:12.524952+0000","last_peered":"2024-05-04T02:48:12.524952+0000","last_clean":"2024-05-04T02:48:12.524952+0000","last_became_active":"2024-05-04T02:20:14.358621+0000","last_became_peered":"2024-05-04T02:20:14.358621+0000","last_unstale":"2024-05-04T02:48:12.524952+0000","last_undegraded":"2024-05-04T02:48:12.524952+0000","last_fullsized":"2024-05-04T02:48:12.524952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":1353,"log_dups_size":0,"ondisk_log_size":1353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:57:10.542857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3394,"num_write_kb":1205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"25'74","reported_seq":107,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.570662+0000","last_change":"2024-05-04T02:20:15.299992+0000","last_active":"2024-05-04T02:48:13.570662+0000","last_peered":"2024-05-04T02:48:13.570662+0000","last_clean":"2024-05-04T02:48:13.570662+0000","last_became_active":"2024-05-04T02:20:15.299678+0000","last_became_peered":"2024-05-04T02:20:15.299678+0000","last_unstale":"2024-05-04T02:48:13.570662+0000","last_undegraded":"2024-05-04T02:48:13.570662+0000","last_fullsized":"2024-05-04T02:48:13.570662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:39:43.029499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":5134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"25'6","reported_seq":41,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:08.260550+0000","last_change":"2024-05-04T02:20:14.359479+0000","last_active":"2024-05-04T02:48:08.260550+0000","last_peered":"2024-05-04T02:48:08.260550+0000","last_clean":"2024-05-04T02:48:08.260550+0000","last_became_active":"2024-05-04T02:20:14.358524+0000","last_became_peered":"2024-05-04T02:20:14.358524+0000","last_unstale":"2024-05-04T02:48:08.260550+0000","last_undegraded":"2024-05-04T02:48:08.260550+0000","last_fullsized":"2024-05-04T02:48:08.260550+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:40:36.439339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"25'73","reported_seq":106,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.677570+0000","last_change":"2024-05-04T02:20:15.293908+0000","last_active":"2024-05-04T02:48:13.677570+0000","last_peered":"2024-05-04T02:48:13.677570+0000","last_clean":"2024-05-04T02:48:13.677570+0000","last_became_active":"2024-05-04T02:20:15.293602+0000","last_became_peered":"2024-05-04T02:20:15.293602+0000","last_unstale":"2024-05-04T02:48:13.677570+0000","last_undegraded":"2024-05-04T02:48:13.677570+0000","last_fullsized":"2024-05-04T02:48:13.677570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:18:03.065030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":2324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"25'6","reported_seq":41,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:08.375521+0000","last_change":"2024-05-04T02:20:14.291515+0000","last_active":"2024-05-04T02:48:08.375521+0000","last_peered":"2024-05-04T02:48:08.375521+0000","last_clean":"2024-05-04T02:48:08.375521+0000","last_became_active":"2024-05-04T02:20:14.291068+0000","last_became_peered":"2024-05-04T02:20:14.291068+0000","last_unstale":"2024-05-04T02:48:08.375521+0000","last_undegraded":"2024-05-04T02:48:08.375521+0000","last_fullsized":"2024-05-04T02:48:08.375521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:57:10.542857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"25'72","reported_seq":105,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:47:44.471584+0000","last_change":"2024-05-04T02:20:15.247885+0000","last_active":"2024-05-04T02:47:44.471584+0000","last_peered":"2024-05-04T02:47:44.471584+0000","last_clean":"2024-05-04T02:47:44.471584+0000","last_became_active":"2024-05-04T02:20:15.247583+0000","last_became_peered":"2024-05-04T02:20:15.247583+0000","last_unstale":"2024-05-04T02:47:44.471584+0000","last_undegraded":"2024-05-04T02:47:44.471584+0000","last_fullsized":"2024-05-04T02:47:44.471584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:39:16.967443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":6637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"25'3","reported_seq":38,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:47:56.665578+0000","last_change":"2024-05-04T02:20:14.289690+0000","last_active":"2024-05-04T02:47:56.665578+0000","last_peered":"2024-05-04T02:47:56.665578+0000","last_clean":"2024-05-04T02:47:56.665578+0000","last_became_active":"2024-05-04T02:20:14.289360+0000","last_became_peered":"2024-05-04T02:20:14.289360+0000","last_unstale":"2024-05-04T02:47:56.665578+0000","last_undegraded":"2024-05-04T02:47:56.665578+0000","last_fullsized":"2024-05-04T02:47:56.665578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:57:26.889464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"25'64","reported_seq":97,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.566262+0000","last_change":"2024-05-04T02:20:15.296623+0000","last_active":"2024-05-04T02:48:13.566262+0000","last_peered":"2024-05-04T02:48:13.566262+0000","last_clean":"2024-05-04T02:48:13.566262+0000","last_became_active":"2024-05-04T02:20:15.296330+0000","last_became_peered":"2024-05-04T02:20:15.296330+0000","last_unstale":"2024-05-04T02:48:13.566262+0000","last_undegraded":"2024-05-04T02:48:13.566262+0000","last_fullsized":"2024-05-04T02:48:13.566262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:39:18.114604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":4339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":35,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:44:06.182275+0000","last_change":"2024-05-04T02:20:14.289113+0000","last_active":"2024-05-04T02:44:06.182275+0000","last_peered":"2024-05-04T02:44:06.182275+0000","last_clean":"2024-05-04T02:44:06.182275+0000","last_became_active":"2024-05-04T02:20:14.288769+0000","last_became_peered":"2024-05-04T02:20:14.288769+0000","last_unstale":"2024-05-04T02:44:06.182275+0000","last_undegraded":"2024-05-04T02:44:06.182275+0000","last_fullsized":"2024-05-04T02:44:06.182275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:48:24.055870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"25'89","reported_seq":122,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.562700+0000","last_change":"2024-05-04T02:20:15.295428+0000","last_active":"2024-05-04T02:48:13.562700+0000","last_peered":"2024-05-04T02:48:13.562700+0000","last_clean":"2024-05-04T02:48:13.562700+0000","last_became_active":"2024-05-04T02:20:15.295128+0000","last_became_peered":"2024-05-04T02:20:15.295128+0000","last_unstale":"2024-05-04T02:48:13.562700+0000","last_undegraded":"2024-05-04T02:48:13.562700+0000","last_fullsized":"2024-05-04T02:48:13.562700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:10:21.048301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":2421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"25'555","reported_seq":590,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:04.961493+0000","last_change":"2024-05-04T02:20:14.294321+0000","last_active":"2024-05-04T02:48:04.961493+0000","last_peered":"2024-05-04T02:48:04.961493+0000","last_clean":"2024-05-04T02:48:04.961493+0000","last_became_active":"2024-05-04T02:20:14.293862+0000","last_became_peered":"2024-05-04T02:20:14.293862+0000","last_unstale":"2024-05-04T02:48:04.961493+0000","last_undegraded":"2024-05-04T02:48:04.961493+0000","last_fullsized":"2024-05-04T02:48:04.961493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":555,"log_dups_size":0,"ondisk_log_size":555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:39:17.000649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":4370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"25'73","reported_seq":106,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.623295+0000","last_change":"2024-05-04T02:20:15.296883+0000","last_active":"2024-05-04T02:48:13.623295+0000","last_peered":"2024-05-04T02:48:13.623295+0000","last_clean":"2024-05-04T02:48:13.623295+0000","last_became_active":"2024-05-04T02:20:15.296544+0000","last_became_peered":"2024-05-04T02:20:15.296544+0000","last_unstale":"2024-05-04T02:48:13.623295+0000","last_undegraded":"2024-05-04T02:48:13.623295+0000","last_fullsized":"2024-05-04T02:48:13.623295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:52:22.299082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":1715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"25'89","reported_seq":121,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.527857+0000","last_change":"2024-05-04T02:20:15.306263+0000","last_active":"2024-05-04T02:48:13.527857+0000","last_peered":"2024-05-04T02:48:13.527857+0000","last_clean":"2024-05-04T02:48:13.527857+0000","last_became_active":"2024-05-04T02:20:15.305941+0000","last_became_peered":"2024-05-04T02:20:15.305941+0000","last_unstale":"2024-05-04T02:48:13.527857+0000","last_undegraded":"2024-05-04T02:48:13.527857+0000","last_fullsized":"2024-05-04T02:48:13.527857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:33:31.416768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":3718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"25'4","reported_seq":38,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:04.954375+0000","last_change":"2024-05-04T02:20:14.294204+0000","last_active":"2024-05-04T02:48:04.954375+0000","last_peered":"2024-05-04T02:48:04.954375+0000","last_clean":"2024-05-04T02:48:04.954375+0000","last_became_active":"2024-05-04T02:20:14.293788+0000","last_became_peered":"2024-05-04T02:20:14.293788+0000","last_unstale":"2024-05-04T02:48:04.954375+0000","last_undegraded":"2024-05-04T02:48:04.954375+0000","last_fullsized":"2024-05-04T02:48:04.954375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:52:21.185127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"25'52","reported_seq":84,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.527627+0000","last_change":"2024-05-04T02:20:15.306357+0000","last_active":"2024-05-04T02:48:13.527627+0000","last_peered":"2024-05-04T02:48:13.527627+0000","last_clean":"2024-05-04T02:48:13.527627+0000","last_became_active":"2024-05-04T02:20:15.306050+0000","last_became_peered":"2024-05-04T02:20:15.306050+0000","last_unstale":"2024-05-04T02:48:13.527627+0000","last_undegraded":"2024-05-04T02:48:13.527627+0000","last_fullsized":"2024-05-04T02:48:13.527627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:39:18.114604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":4810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"25'1264","reported_seq":1298,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:08.375745+0000","last_change":"2024-05-04T02:20:14.357677+0000","last_active":"2024-05-04T02:48:08.375745+0000","last_peered":"2024-05-04T02:48:08.375745+0000","last_clean":"2024-05-04T02:48:08.375745+0000","last_became_active":"2024-05-04T02:20:14.357368+0000","last_became_peered":"2024-05-04T02:20:14.357368+0000","last_unstale":"2024-05-04T02:48:08.375745+0000","last_undegraded":"2024-05-04T02:48:08.375745+0000","last_fullsized":"2024-05-04T02:48:08.375745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":1264,"log_dups_size":0,"ondisk_log_size":1264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:10:19.934346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1255,"num_write_kb":8902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"25'94","reported_seq":133,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.712754+0000","last_change":"2024-05-04T02:20:53.107201+0000","last_active":"2024-05-04T02:48:13.712754+0000","last_peered":"2024-05-04T02:48:13.712754+0000","last_clean":"2024-05-04T02:48:13.712754+0000","last_became_active":"2024-05-04T02:20:53.106867+0000","last_became_peered":"2024-05-04T02:20:53.106867+0000","last_unstale":"2024-05-04T02:48:13.712754+0000","last_undegraded":"2024-05-04T02:48:13.712754+0000","last_fullsized":"2024-05-04T02:48:13.712754+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:44:55.968258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":7905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"25'740","reported_seq":777,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:10.614685+0000","last_change":"2024-05-04T02:20:14.291632+0000","last_active":"2024-05-04T02:48:10.614685+0000","last_peered":"2024-05-04T02:48:10.614685+0000","last_clean":"2024-05-04T02:48:10.614685+0000","last_became_active":"2024-05-04T02:20:14.291331+0000","last_became_peered":"2024-05-04T02:20:14.291331+0000","last_unstale":"2024-05-04T02:48:10.614685+0000","last_undegraded":"2024-05-04T02:48:10.614685+0000","last_fullsized":"2024-05-04T02:48:10.614685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":740,"log_dups_size":0,"ondisk_log_size":740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:22:31.905346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":732,"num_write_kb":4528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"25'50","reported_seq":85,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.569635+0000","last_change":"2024-05-04T02:20:15.294309+0000","last_active":"2024-05-04T02:48:13.569635+0000","last_peered":"2024-05-04T02:48:13.569635+0000","last_clean":"2024-05-04T02:48:13.569635+0000","last_became_active":"2024-05-04T02:20:15.294026+0000","last_became_peered":"2024-05-04T02:20:15.294026+0000","last_unstale":"2024-05-04T02:48:13.569635+0000","last_undegraded":"2024-05-04T02:48:13.569635+0000","last_fullsized":"2024-05-04T02:48:13.569635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:39:24.225985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":3304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"25'588","reported_seq":624,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:47:58.857763+0000","last_change":"2024-05-04T02:20:14.291633+0000","last_active":"2024-05-04T02:47:58.857763+0000","last_peered":"2024-05-04T02:47:58.857763+0000","last_clean":"2024-05-04T02:47:58.857763+0000","last_became_active":"2024-05-04T02:20:14.291313+0000","last_became_peered":"2024-05-04T02:20:14.291313+0000","last_unstale":"2024-05-04T02:47:58.857763+0000","last_undegraded":"2024-05-04T02:47:58.857763+0000","last_fullsized":"2024-05-04T02:47:58.857763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":588,"log_dups_size":0,"ondisk_log_size":588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:48:36.710163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":585,"num_write_kb":4378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3751,"num_write_kb":293548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4679,"ondisk_log_size":4679,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":37540595,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":841,"num_read_kb":897,"num_write":10488,"num_write_kb":42213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":48889856,"data_stored":75082328,"data_compressed":7496204,"data_compressed_allocated":11345920,"data_compressed_original":37601280,"omap_allocated":0,"internal_metadata":0},"log_size":8561,"ondisk_log_size":8561,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65100,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509784,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64824,"kb_used_data":15600,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94307016,"statfs":{"total":96636764160,"available":96570384384,"internally_reserved":0,"allocated":15974400,"data_stored":25462774,"data_compressed":2642721,"data_compressed_allocated":3952640,"data_compressed_original":13611008,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509784,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60228,"kb_used_data":11004,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94311612,"statfs":{"total":96636764160,"available":96575090688,"internally_reserved":0,"allocated":11268096,"data_stored":16874693,"data_compressed":1601255,"data_compressed_allocated":2412544,"data_compressed_original":8187904,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509784,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35592,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336248,"statfs":{"total":96636764160,"available":96600317952,"internally_reserved":0,"allocated":262144,"data_stored":96895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509784,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58680,"kb_used_data":9456,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94313160,"statfs":{"total":96636764160,"available":96576675840,"internally_reserved":0,"allocated":9682944,"data_stored":12861583,"data_compressed":1022835,"data_compressed_allocated":1699840,"data_compressed_original":5050368,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509784,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35768,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336072,"statfs":{"total":96636764160,"available":96600137728,"internally_reserved":0,"allocated":442368,"data_stored":277999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509784,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29248,"kb_used_data":2232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342592,"statfs":{"total":96636764160,"available":96606814208,"internally_reserved":0,"allocated":2285568,"data_stored":3901602,"data_compressed":519116,"data_compressed_allocated":720896,"data_compressed_original":2506752,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542489,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44836,"kb_used_data":5340,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94327004,"statfs":{"total":96636764160,"available":96590852096,"internally_reserved":0,"allocated":5468160,"data_stored":8485539,"data_compressed":908476,"data_compressed_allocated":1347584,"data_compressed_original":4538368,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575192,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32584,"kb_used_data":5568,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94339256,"statfs":{"total":96636764160,"available":96603398144,"internally_reserved":0,"allocated":5701632,"data_stored":9076419,"data_compressed":866901,"data_compressed_allocated":1302528,"data_compressed_original":4853760,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32550,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32550,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5378048,"data_stored":8389246,"data_compressed":834351,"data_compressed_allocated":1257472,"data_compressed_original":4280320,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2027520,"data_stored":3804797,"data_compressed":519116,"data_compressed_allocated":720896,"data_compressed_original":2506752,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":184320,"data_stored":181194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9424896,"data_stored":12764778,"data_compressed":1022835,"data_compressed_allocated":1699840,"data_compressed_original":5050368,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5210112,"data_stored":8388734,"data_compressed":908476,"data_compressed_allocated":1347584,"data_compressed_original":4538368,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":11010048,"data_stored":16777888,"data_compressed":1601255,"data_compressed_allocated":2412544,"data_compressed_original":8187904,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":15650816,"data_stored":24775601,"data_compressed":2610171,"data_compressed_allocated":3907584,"data_compressed_original":13037568,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-04T02:48:21.832 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-04T02:48:21.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.982+0000 7fe7d72e2640 1 Processor -- start 2024-05-04T02:48:21.983 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.982+0000 7fe7d72e2640 1 -- start start 2024-05-04T02:48:21.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.983+0000 7fe7d72e2640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe7d01546d0 0x7fe7d015ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:21.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.983+0000 7fe7d72e2640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe7d00cb4d0 0x7fe7d00cb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:21.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.983+0000 7fe7d72e2640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7d015d6e0 con 0x7fe7d00b5170 2024-05-04T02:48:21.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.983+0000 7fe7d72e2640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fe7d00cbe20 con 0x7fe7d00cb4d0 2024-05-04T02:48:21.984 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.983+0000 7fe7d72e2640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe7d015b370 con 0x7fe7d01546d0 2024-05-04T02:48:21.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.987+0000 7fe7d507e640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fe7d00b5170 0x7fe7d00702a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:55394/0 (socket says 172.21.15.1:55394) 2024-05-04T02:48:21.987 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.987+0000 7fe7d507e640 1 -- 172.21.15.1:0/2264891381 learned_addr learned my addr 172.21.15.1:0/2264891381 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-05-04T02:48:21.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.989+0000 7fe7c7fff640 1 -- 172.21.15.1:0/2264891381 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2325823486 0 0) 0x7fe7d015d6e0 con 0x7fe7d00b5170 2024-05-04T02:48:21.990 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.989+0000 7fe7c7fff640 1 -- 172.21.15.1:0/2264891381 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe7bc003520 con 0x7fe7d00b5170 2024-05-04T02:48:21.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.993+0000 7fe7c7fff640 1 -- 172.21.15.1:0/2264891381 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2916915619 0 0) 0x7fe7bc003520 con 0x7fe7d00b5170 2024-05-04T02:48:21.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.993+0000 7fe7c7fff640 1 -- 172.21.15.1:0/2264891381 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe7d01546d0 msgr2=0x7fe7d015ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:48:21.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.993+0000 7fe7c7fff640 1 --2- 172.21.15.1:0/2264891381 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe7d01546d0 0x7fe7d015ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:21.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.993+0000 7fe7c7fff640 1 -- 172.21.15.1:0/2264891381 >> v2:172.21.15.107:3300/0 conn(0x7fe7d00cb4d0 msgr2=0x7fe7d00cb8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:48:21.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.993+0000 7fe7c7fff640 1 --2- 172.21.15.1:0/2264891381 >> v2:172.21.15.107:3300/0 conn(0x7fe7d00cb4d0 0x7fe7d00cb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:21.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.993+0000 7fe7c7fff640 1 -- 172.21.15.1:0/2264891381 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7d00ca190 con 0x7fe7d00b5170 2024-05-04T02:48:21.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.993+0000 7fe7c7fff640 1 -- 172.21.15.1:0/2264891381 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1418761865 0 0) 0x7fe7cc0016f0 con 0x7fe7d00b5170 2024-05-04T02:48:21.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.993+0000 7fe7c7fff640 1 -- 172.21.15.1:0/2264891381 >> v1:172.21.15.1:6789/0 conn(0x7fe7d00b5170 legacy=0x7fe7d00702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:21.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.993+0000 7fe7c7fff640 1 --2- 172.21.15.1:0/2264891381 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe7d01546d0 0x7fe7bc003a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:21.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.994+0000 7fe7c7fff640 1 --2- 172.21.15.1:0/2264891381 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe7bc0041b0 0x7fe7bc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:21.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.994+0000 7fe7c7fff640 1 --2- 172.21.15.1:0/2264891381 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7bc004f40 0x7fe7bc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:21.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.994+0000 7fe7c7fff640 1 -- 172.21.15.1:0/2264891381 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d015b370 con 0x7fe7bc0041b0 2024-05-04T02:48:21.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.994+0000 7fe7c7fff640 1 -- 172.21.15.1:0/2264891381 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe7bc00bf00 con 0x7fe7bc004f40 2024-05-04T02:48:21.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.994+0000 7fe7c7fff640 1 -- 172.21.15.1:0/2264891381 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe7bc00c080 con 0x7fe7d01546d0 2024-05-04T02:48:21.997 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:21.997+0000 7fe7d487d640 1 --2- 172.21.15.1:0/2264891381 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe7bc0041b0 0x7fe7bc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:22.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:22.000+0000 7fe7d487d640 1 -- 172.21.15.1:0/2264891381 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe7d01546d0 msgr2=0x7fe7bc003a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:48:22.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:22.000+0000 7fe7d487d640 1 --2- 172.21.15.1:0/2264891381 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe7d01546d0 0x7fe7bc003a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:22.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:22.000+0000 7fe7d487d640 1 -- 172.21.15.1:0/2264891381 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7bc004f40 msgr2=0x7fe7bc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:48:22.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:22.000+0000 7fe7d487d640 1 --2- 172.21.15.1:0/2264891381 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7bc004f40 0x7fe7bc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:22.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:22.000+0000 7fe7d487d640 1 -- 172.21.15.1:0/2264891381 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7bc003520 con 0x7fe7bc0041b0 2024-05-04T02:48:22.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:22.002+0000 7fe7d487d640 1 --2- 172.21.15.1:0/2264891381 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe7bc0041b0 0x7fe7bc004800 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe7d00c2ca0 tx=0x7fe7bc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb21d55687f64f5b server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:22.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:22.006+0000 7fe7c7fff640 1 -- 172.21.15.1:0/2264891381 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c0037070 con 0x7fe7bc0041b0 2024-05-04T02:48:22.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:22.006+0000 7fe7c7fff640 1 -- 172.21.15.1:0/2264891381 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7c002aa50 con 0x7fe7bc0041b0 2024-05-04T02:48:22.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:22.006+0000 7fe7c7fff640 1 -- 172.21.15.1:0/2264891381 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c0009460 con 0x7fe7bc0041b0 2024-05-04T02:48:22.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:22.007+0000 7fe7d72e2640 1 -- 172.21.15.1:0/2264891381 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe7bc0041b0 msgr2=0x7fe7bc004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:22.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:22.007+0000 7fe7d72e2640 1 --2- 172.21.15.1:0/2264891381 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe7bc0041b0 0x7fe7bc004800 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe7d00c2ca0 tx=0x7fe7bc005830 comp rx=0 tx=0).stop 2024-05-04T02:48:22.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:22.007+0000 7fe7d587f640 1 -- 172.21.15.1:0/2264891381 reap_dead start 2024-05-04T02:48:22.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:22.007+0000 7fe7d72e2640 1 -- 172.21.15.1:0/2264891381 shutdown_connections 2024-05-04T02:48:22.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:22.007+0000 7fe7d72e2640 1 -- 172.21.15.1:0/2264891381 >> 172.21.15.1:0/2264891381 conn(0x7fe7d00cf6e0 msgr2=0x7fe7d00cfaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:48:22.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:22.007+0000 7fe7d72e2640 1 -- 172.21.15.1:0/2264891381 shutdown_connections 2024-05-04T02:48:22.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:22.007+0000 7fe7d72e2640 1 -- 172.21.15.1:0/2264891381 wait complete. 2024-05-04T02:48:22.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:22.009+0000 7fe7d72e2640 1 Processor -- start 2024-05-04T02:48:22.010 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:22.009+0000 7fe7d72e2640 1 -- start start 2024-05-04T02:48:22.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:22.010+0000 7fe7d72e2640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7bc0041b0 0x7fe7d00c54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:22.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:22.010+0000 7fe7d72e2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe7d0157ca0 0x7fe7d00c39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:22.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:22.010+0000 7fe7d72e2640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe7d0153930 0x7fe7d0153d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:22.011 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:22.010+0000 7fe7d72e2640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d00ca9f0 con 0x7fe7d0157ca0 2024-05-04T02:48:22.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:22.010+0000 7fe7d72e2640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d00ca710 con 0x7fe7bc0041b0 2024-05-04T02:48:22.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:22.010+0000 7fe7d72e2640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe7d00cacd0 con 0x7fe7d0153930 2024-05-04T02:48:22.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:22.011+0000 7fe7d487d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe7d0157ca0 0x7fe7d00c39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:22.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:22.011+0000 7fe7d487d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe7d0157ca0 0x7fe7d00c39d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37804/0 (socket says 172.21.15.1:37804) 2024-05-04T02:48:22.012 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:22.011+0000 7fe7d487d640 1 -- 172.21.15.1:0/1223479452 learned_addr learned my addr 172.21.15.1:0/1223479452 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:48:22.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:22.015+0000 7fe7d487d640 1 -- 172.21.15.1:0/1223479452 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe7d0153930 msgr2=0x7fe7d0153d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:22.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:22.015+0000 7fe7d487d640 1 --2- 172.21.15.1:0/1223479452 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe7d0153930 0x7fe7d0153d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:22.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:22.015+0000 7fe7d487d640 1 -- 172.21.15.1:0/1223479452 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7bc0041b0 msgr2=0x7fe7d00c54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:22.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:22.015+0000 7fe7d487d640 1 --2- 172.21.15.1:0/1223479452 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7bc0041b0 0x7fe7d00c54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:22.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:22.015+0000 7fe7d487d640 1 -- 172.21.15.1:0/1223479452 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7d00c48b0 con 0x7fe7d0157ca0 2024-05-04T02:48:22.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:22.017+0000 7fe7d487d640 1 --2- 172.21.15.1:0/1223479452 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe7d0157ca0 0x7fe7d00c39d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe7c0004700 tx=0x7fe7c00047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:22.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:22.021+0000 7fe7c5ffb640 1 -- 172.21.15.1:0/1223479452 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c0042020 con 0x7fe7d0157ca0 2024-05-04T02:48:22.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:22.021+0000 7fe7c5ffb640 1 -- 172.21.15.1:0/1223479452 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7c0038040 con 0x7fe7d0157ca0 2024-05-04T02:48:22.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:22.021+0000 7fe7c5ffb640 1 -- 172.21.15.1:0/1223479452 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c0037070 con 0x7fe7d0157ca0 2024-05-04T02:48:22.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:22.021+0000 7fe7d72e2640 1 -- 172.21.15.1:0/1223479452 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7d00c4b70 con 0x7fe7d0157ca0 2024-05-04T02:48:22.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:22.022+0000 7fe7d72e2640 1 -- 172.21.15.1:0/1223479452 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7d01574a0 con 0x7fe7d0157ca0 2024-05-04T02:48:22.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:22.022+0000 7fe7d72e2640 1 -- 172.21.15.1:0/1223479452 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7d0076740 con 0x7fe7d0157ca0 2024-05-04T02:48:22.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:22.047+0000 7fe7c5ffb640 1 -- 172.21.15.1:0/1223479452 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe7c0045020 con 0x7fe7d0157ca0 2024-05-04T02:48:22.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:22.047+0000 7fe7c5ffb640 1 --2- 172.21.15.1:0/1223479452 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fe7b4076300 0x7fe7b4078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:22.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:22.047+0000 7fe7d507e640 1 --2- 172.21.15.1:0/1223479452 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fe7b4076300 0x7fe7b4078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:22.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:22.048+0000 7fe7d507e640 1 --2- 172.21.15.1:0/1223479452 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fe7b4076300 0x7fe7b4078810 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc0079b0 tx=0x7fe7cc001610 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:22.052 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:22.052+0000 7fe7c5ffb640 1 -- 172.21.15.1:0/1223479452 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5854+0+0 (secure 0 0 0) 0x7fe7c007ce50 con 0x7fe7d0157ca0 2024-05-04T02:48:22.343 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:22.342+0000 7fe7c5ffb640 1 -- 172.21.15.1:0/1223479452 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe7c004c070 con 0x7fe7d0157ca0 2024-05-04T02:48:22.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:22.536+0000 7fe7d72e2640 1 -- 172.21.15.1:0/1223479452 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe7d01e5a10 con 0x7fe7d0157ca0 2024-05-04T02:48:22.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:22.586+0000 7fe7c5ffb640 1 -- 172.21.15.1:0/1223479452 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+16842 (secure 0 0 0) 0x7fe7c0081350 con 0x7fe7d0157ca0 2024-05-04T02:48:22.587 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:48:22.587 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":25,"fsid":"b45b4a9a-b84c-4a66-907b-43f0ca45e7c0","created":"2024-05-04T02:19:44.555410+0000","modified":"2024-05-04T02:20:52.916817+0000","last_up_change":"2024-05-04T02:20:00.162760+0000","last_in_change":"2024-05-04T02:19:50.811018+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-04T02:19:59.664283+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-04T02:20:12.783217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-04T02:20:13.872502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d8ad7964-7bd6-4ba9-ae4f-b55d7566b18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":2338132980},{"type":"v1","addr":"172.21.15.1:6801","nonce":2338132980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":2338132980},{"type":"v1","addr":"172.21.15.1:6803","nonce":2338132980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":2338132980},{"type":"v1","addr":"172.21.15.1:6807","nonce":2338132980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":2338132980},{"type":"v1","addr":"172.21.15.1:6805","nonce":2338132980}]},"public_addr":"172.21.15.1:6801/2338132980","cluster_addr":"172.21.15.1:6803/2338132980","heartbeat_back_addr":"172.21.15.1:6807/2338132980","heartbeat_front_addr":"172.21.15.1:6805/2338132980","state":["exists","up"]},{"osd":1,"uuid":"ce155f6d-7e0c-47c8-a0e0-fb53ff0c7726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":459131368},{"type":"v1","addr":"172.21.15.1:6817","nonce":459131368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":459131368},{"type":"v1","addr":"172.21.15.1:6819","nonce":459131368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":459131368},{"type":"v1","addr":"172.21.15.1:6823","nonce":459131368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":459131368},{"type":"v1","addr":"172.21.15.1:6821","nonce":459131368}]},"public_addr":"172.21.15.1:6817/459131368","cluster_addr":"172.21.15.1:6819/459131368","heartbeat_back_addr":"172.21.15.1:6823/459131368","heartbeat_front_addr":"172.21.15.1:6821/459131368","state":["exists","up"]},{"osd":2,"uuid":"7847c281-5da0-4d7d-b888-7f49d99a50b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":3463851105},{"type":"v1","addr":"172.21.15.1:6809","nonce":3463851105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":3463851105},{"type":"v1","addr":"172.21.15.1:6811","nonce":3463851105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":3463851105},{"type":"v1","addr":"172.21.15.1:6815","nonce":3463851105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":3463851105},{"type":"v1","addr":"172.21.15.1:6813","nonce":3463851105}]},"public_addr":"172.21.15.1:6809/3463851105","cluster_addr":"172.21.15.1:6811/3463851105","heartbeat_back_addr":"172.21.15.1:6815/3463851105","heartbeat_front_addr":"172.21.15.1:6813/3463851105","state":["exists","up"]},{"osd":3,"uuid":"26386eba-d106-4abe-8d6b-7dccdd106cb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":3859721636},{"type":"v1","addr":"172.21.15.1:6825","nonce":3859721636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":3859721636},{"type":"v1","addr":"172.21.15.1:6827","nonce":3859721636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":3859721636},{"type":"v1","addr":"172.21.15.1:6831","nonce":3859721636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":3859721636},{"type":"v1","addr":"172.21.15.1:6829","nonce":3859721636}]},"public_addr":"172.21.15.1:6825/3859721636","cluster_addr":"172.21.15.1:6827/3859721636","heartbeat_back_addr":"172.21.15.1:6831/3859721636","heartbeat_front_addr":"172.21.15.1:6829/3859721636","state":["exists","up"]},{"osd":4,"uuid":"2ba3d1b3-c5fa-4ff4-bf5d-772e77d79c59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":2335597098},{"type":"v1","addr":"172.21.15.107:6803","nonce":2335597098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":2335597098},{"type":"v1","addr":"172.21.15.107:6805","nonce":2335597098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2335597098},{"type":"v1","addr":"172.21.15.107:6810","nonce":2335597098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":2335597098},{"type":"v1","addr":"172.21.15.107:6807","nonce":2335597098}]},"public_addr":"172.21.15.107:6803/2335597098","cluster_addr":"172.21.15.107:6805/2335597098","heartbeat_back_addr":"172.21.15.107:6810/2335597098","heartbeat_front_addr":"172.21.15.107:6807/2335597098","state":["exists","up"]},{"osd":5,"uuid":"c42646eb-6e14-4b42-a7a3-54f99f1662bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":1274544305},{"type":"v1","addr":"172.21.15.107:6819","nonce":1274544305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":1274544305},{"type":"v1","addr":"172.21.15.107:6821","nonce":1274544305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":1274544305},{"type":"v1","addr":"172.21.15.107:6825","nonce":1274544305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":1274544305},{"type":"v1","addr":"172.21.15.107:6823","nonce":1274544305}]},"public_addr":"172.21.15.107:6819/1274544305","cluster_addr":"172.21.15.107:6821/1274544305","heartbeat_back_addr":"172.21.15.107:6825/1274544305","heartbeat_front_addr":"172.21.15.107:6823/1274544305","state":["exists","up"]},{"osd":6,"uuid":"a8a2dbb8-0107-4b8e-93c3-5fa7e6af15a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6809","nonce":941385299},{"type":"v1","addr":"172.21.15.107:6811","nonce":941385299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":941385299},{"type":"v1","addr":"172.21.15.107:6813","nonce":941385299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":941385299},{"type":"v1","addr":"172.21.15.107:6817","nonce":941385299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":941385299},{"type":"v1","addr":"172.21.15.107:6815","nonce":941385299}]},"public_addr":"172.21.15.107:6811/941385299","cluster_addr":"172.21.15.107:6813/941385299","heartbeat_back_addr":"172.21.15.107:6817/941385299","heartbeat_front_addr":"172.21.15.107:6815/941385299","state":["exists","up"]},{"osd":7,"uuid":"3b9bdc70-8831-4df9-8d50-362aa0f02aed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":1723298539},{"type":"v1","addr":"172.21.15.107:6827","nonce":1723298539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":1723298539},{"type":"v1","addr":"172.21.15.107:6829","nonce":1723298539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":1723298539},{"type":"v1","addr":"172.21.15.107:6833","nonce":1723298539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":1723298539},{"type":"v1","addr":"172.21.15.107:6831","nonce":1723298539}]},"public_addr":"172.21.15.107:6827/1723298539","cluster_addr":"172.21.15.107:6829/1723298539","heartbeat_back_addr":"172.21.15.107:6833/1723298539","heartbeat_front_addr":"172.21.15.107:6831/1723298539","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T02:19:56.277538+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T02:19:56.402984+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T02:19:56.374787+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T02:19:56.461914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T02:19:56.384856+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T02:19:56.469958+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T02:19:56.489376+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T02:19:56.393205+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.15","mappings":[{"from":3,"to":1}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.3f","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-04T02:48:22.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:22.588+0000 7fe7d72e2640 1 -- 172.21.15.1:0/1223479452 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fe7b4076300 msgr2=0x7fe7b4078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:22.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:22.588+0000 7fe7d72e2640 1 --2- 172.21.15.1:0/1223479452 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fe7b4076300 0x7fe7b4078810 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc0079b0 tx=0x7fe7cc001610 comp rx=0 tx=0).stop 2024-05-04T02:48:22.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:22.588+0000 7fe7d72e2640 1 -- 172.21.15.1:0/1223479452 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe7d0157ca0 msgr2=0x7fe7d00c39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:22.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:22.588+0000 7fe7d72e2640 1 --2- 172.21.15.1:0/1223479452 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe7d0157ca0 0x7fe7d00c39d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe7c0004700 tx=0x7fe7c00047d0 comp rx=0 tx=0).stop 2024-05-04T02:48:22.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:22.588+0000 7fe7d72e2640 1 -- 172.21.15.1:0/1223479452 shutdown_connections 2024-05-04T02:48:22.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:22.588+0000 7fe7d72e2640 1 --2- 172.21.15.1:0/1223479452 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fe7b4076300 0x7fe7b4078810 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:22.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:22.588+0000 7fe7d72e2640 1 --2- 172.21.15.1:0/1223479452 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe7d0153930 0x7fe7d0153d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:22.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:22.588+0000 7fe7d72e2640 1 --2- 172.21.15.1:0/1223479452 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe7d0157ca0 0x7fe7d00c39d0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:22.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:22.588+0000 7fe7d72e2640 1 --2- 172.21.15.1:0/1223479452 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7bc0041b0 0x7fe7d00c54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:22.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:22.588+0000 7fe7d72e2640 1 -- 172.21.15.1:0/1223479452 >> 172.21.15.1:0/1223479452 conn(0x7fe7d00cf6e0 msgr2=0x7fe7d015b720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:48:22.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:22.588+0000 7fe7d72e2640 1 -- 172.21.15.1:0/1223479452 shutdown_connections 2024-05-04T02:48:22.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:22.588+0000 7fe7d72e2640 1 -- 172.21.15.1:0/1223479452 wait complete. 2024-05-04T02:48:23.602 INFO:tasks.ceph:Scrubbing osd.0 2024-05-04T02:48:23.602 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-05-04T02:48:23.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.718+0000 7fcc5431b640 1 Processor -- start 2024-05-04T02:48:23.719 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.718+0000 7fcc5431b640 1 -- start start 2024-05-04T02:48:23.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.719+0000 7fcc5431b640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fcc4c0cdcf0 0x7fcc4c06d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:23.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.719+0000 7fcc5431b640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fcc4c15c4a0 0x7fcc4c15c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:23.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.719+0000 7fcc5431b640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc4c0cd3b0 con 0x7fcc4c15cdf0 2024-05-04T02:48:23.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.719+0000 7fcc5431b640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7fcc4c0b74b0 con 0x7fcc4c15c4a0 2024-05-04T02:48:23.720 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.719+0000 7fcc5431b640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fcc4c06d1a0 con 0x7fcc4c0cdcf0 2024-05-04T02:48:23.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.720+0000 7fcc518b6640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fcc4c15c4a0 0x7fcc4c15c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:23.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.720+0000 7fcc520b7640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fcc4c0cdcf0 0x7fcc4c06d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:23.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.720+0000 7fcc528b8640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fcc4c15cdf0 0x7fcc4c15fa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:37634/0 (socket says 172.21.15.1:37634) 2024-05-04T02:48:23.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.720+0000 7fcc528b8640 1 -- 172.21.15.1:0/39559456 learned_addr learned my addr 172.21.15.1:0/39559456 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-05-04T02:48:23.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.723+0000 7fcc520b7640 1 -- 172.21.15.1:0/39559456 >> v2:172.21.15.1:3300/0 conn(0x7fcc4c15c4a0 msgr2=0x7fcc4c15c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:48:23.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.723+0000 7fcc520b7640 1 --2- 172.21.15.1:0/39559456 >> v2:172.21.15.1:3300/0 conn(0x7fcc4c15c4a0 0x7fcc4c15c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:23.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.723+0000 7fcc520b7640 1 -- 172.21.15.1:0/39559456 >> v1:172.21.15.1:6789/0 conn(0x7fcc4c15cdf0 legacy=0x7fcc4c15fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:23.724 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.723+0000 7fcc520b7640 1 -- 172.21.15.1:0/39559456 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc4c06d480 con 0x7fcc4c0cdcf0 2024-05-04T02:48:23.726 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.725+0000 7fcc520b7640 1 --2- 172.21.15.1:0/39559456 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcc4c0cdcf0 0x7fcc4c06d9a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c08f250 tx=0x7fcc4802a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=351285b8d1c90c37 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:23.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.729+0000 7fcc510b5640 1 -- 172.21.15.1:0/39559456 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc48037070 con 0x7fcc4c0cdcf0 2024-05-04T02:48:23.730 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.729+0000 7fcc510b5640 1 -- 172.21.15.1:0/39559456 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc48032440 con 0x7fcc4c0cdcf0 2024-05-04T02:48:23.731 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.729+0000 7fcc510b5640 1 -- 172.21.15.1:0/39559456 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc48032810 con 0x7fcc4c0cdcf0 2024-05-04T02:48:23.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.730+0000 7fcc5431b640 1 -- 172.21.15.1:0/39559456 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcc4c0cdcf0 msgr2=0x7fcc4c06d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:23.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.730+0000 7fcc5431b640 1 --2- 172.21.15.1:0/39559456 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcc4c0cdcf0 0x7fcc4c06d9a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c08f250 tx=0x7fcc4802a230 comp rx=0 tx=0).stop 2024-05-04T02:48:23.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.730+0000 7fcc5431b640 1 -- 172.21.15.1:0/39559456 shutdown_connections 2024-05-04T02:48:23.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.730+0000 7fcc5431b640 1 --2- 172.21.15.1:0/39559456 >> v2:172.21.15.1:3300/0 conn(0x7fcc4c15c4a0 0x7fcc4c15c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:23.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.730+0000 7fcc5431b640 1 --2- 172.21.15.1:0/39559456 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcc4c0cdcf0 0x7fcc4c06d9a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:23.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.730+0000 7fcc5431b640 1 -- 172.21.15.1:0/39559456 >> 172.21.15.1:0/39559456 conn(0x7fcc4c0ce960 msgr2=0x7fcc4c08cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:48:23.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.730+0000 7fcc5431b640 1 -- 172.21.15.1:0/39559456 shutdown_connections 2024-05-04T02:48:23.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.730+0000 7fcc5431b640 1 -- 172.21.15.1:0/39559456 wait complete. 2024-05-04T02:48:23.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.732+0000 7fcc5431b640 1 Processor -- start 2024-05-04T02:48:23.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.732+0000 7fcc5431b640 1 -- start start 2024-05-04T02:48:23.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.733+0000 7fcc5431b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcc4c0cdcf0 0x7fcc4c153e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:23.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.733+0000 7fcc5431b640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcc4c15c4a0 0x7fcc4c1f2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:23.736 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.733+0000 7fcc5431b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcc4c15cdf0 0x7fcc4c15b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:23.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.733+0000 7fcc5431b640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fcc4c0b7790 con 0x7fcc4c15cdf0 2024-05-04T02:48:23.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.733+0000 7fcc5431b640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fcc4c15d200 con 0x7fcc4c0cdcf0 2024-05-04T02:48:23.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.733+0000 7fcc5431b640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fcc4c0cd7c0 con 0x7fcc4c15c4a0 2024-05-04T02:48:23.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.734+0000 7fcc528b8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcc4c15cdf0 0x7fcc4c15b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:23.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.734+0000 7fcc520b7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcc4c0cdcf0 0x7fcc4c153e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:23.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.734+0000 7fcc518b6640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcc4c15c4a0 0x7fcc4c1f2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:23.737 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.734+0000 7fcc528b8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcc4c15cdf0 0x7fcc4c15b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37742/0 (socket says 172.21.15.1:37742) 2024-05-04T02:48:23.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.734+0000 7fcc528b8640 1 -- 172.21.15.1:0/1747179473 learned_addr learned my addr 172.21.15.1:0/1747179473 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:48:23.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.738+0000 7fcc528b8640 1 -- 172.21.15.1:0/1747179473 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcc4c15c4a0 msgr2=0x7fcc4c1f2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:23.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.738+0000 7fcc528b8640 1 --2- 172.21.15.1:0/1747179473 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcc4c15c4a0 0x7fcc4c1f2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:23.739 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.738+0000 7fcc528b8640 1 -- 172.21.15.1:0/1747179473 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcc4c0cdcf0 msgr2=0x7fcc4c153e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:23.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.738+0000 7fcc528b8640 1 --2- 172.21.15.1:0/1747179473 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcc4c0cdcf0 0x7fcc4c153e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:23.740 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.738+0000 7fcc528b8640 1 -- 172.21.15.1:0/1747179473 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc4c1f2fd0 con 0x7fcc4c15cdf0 2024-05-04T02:48:23.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.740+0000 7fcc528b8640 1 --2- 172.21.15.1:0/1747179473 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcc4c15cdf0 0x7fcc4c15b470 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fcc4400cad0 tx=0x7fcc4400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:23.745 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.744+0000 7fcc42ffd640 1 -- 172.21.15.1:0/1747179473 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc44017070 con 0x7fcc4c15cdf0 2024-05-04T02:48:23.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.744+0000 7fcc42ffd640 1 -- 172.21.15.1:0/1747179473 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc4400ac30 con 0x7fcc4c15cdf0 2024-05-04T02:48:23.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.744+0000 7fcc42ffd640 1 -- 172.21.15.1:0/1747179473 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc44012400 con 0x7fcc4c15cdf0 2024-05-04T02:48:23.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.745+0000 7fcc5431b640 1 -- 172.21.15.1:0/1747179473 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc4c151ec0 con 0x7fcc4c15cdf0 2024-05-04T02:48:23.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.745+0000 7fcc5431b640 1 -- 172.21.15.1:0/1747179473 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc4c154ae0 con 0x7fcc4c15cdf0 2024-05-04T02:48:23.746 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.745+0000 7fcc5431b640 1 -- 172.21.15.1:0/1747179473 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcc4c152160 con 0x7fcc4c15cdf0 2024-05-04T02:48:23.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.770+0000 7fcc42ffd640 1 -- 172.21.15.1:0/1747179473 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fcc4401a070 con 0x7fcc4c15cdf0 2024-05-04T02:48:23.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.770+0000 7fcc42ffd640 1 --2- 172.21.15.1:0/1747179473 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fcc30076320 0x7fcc30078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:23.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.771+0000 7fcc520b7640 1 --2- 172.21.15.1:0/1747179473 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fcc30076320 0x7fcc30078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:23.772 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.771+0000 7fcc520b7640 1 --2- 172.21.15.1:0/1747179473 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fcc30076320 0x7fcc30078830 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fcc48034000 tx=0x7fcc4802e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:23.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.774+0000 7fcc42ffd640 1 -- 172.21.15.1:0/1747179473 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5854+0+0 (secure 0 0 0) 0x7fcc4405cf10 con 0x7fcc4c15cdf0 2024-05-04T02:48:23.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.774+0000 7fcc42ffd640 1 --2- 172.21.15.1:0/1747179473 >> [v2:172.21.15.1:6800/2338132980,v1:172.21.15.1:6801/2338132980] conn(0x7fcc3007e750 0x7fcc30080c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:23.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.774+0000 7fcc42ffd640 1 -- 172.21.15.1:0/1747179473 --> [v2:172.21.15.1:6800/2338132980,v1:172.21.15.1:6801/2338132980] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcc30081310 con 0x7fcc3007e750 2024-05-04T02:48:23.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.774+0000 7fcc42ffd640 1 -- 172.21.15.1:0/1747179473 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fcc4405d2d0 con 0x7fcc4c15cdf0 2024-05-04T02:48:23.775 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.774+0000 7fcc518b6640 1 --2- 172.21.15.1:0/1747179473 >> [v2:172.21.15.1:6800/2338132980,v1:172.21.15.1:6801/2338132980] conn(0x7fcc3007e750 0x7fcc30080c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:23.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.775+0000 7fcc518b6640 1 --2- 172.21.15.1:0/1747179473 >> [v2:172.21.15.1:6800/2338132980,v1:172.21.15.1:6801/2338132980] conn(0x7fcc3007e750 0x7fcc30080c40 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:23.776 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.775+0000 7fcc42ffd640 1 -- 172.21.15.1:0/1747179473 <== osd.0 v2:172.21.15.1:6800/2338132980 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcc30081310 con 0x7fcc3007e750 2024-05-04T02:48:23.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.789+0000 7fcc5431b640 1 -- 172.21.15.1:0/1747179473 --> [v2:172.21.15.1:6800/2338132980,v1:172.21.15.1:6801/2338132980] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fcc4c069c60 con 0x7fcc3007e750 2024-05-04T02:48:23.790 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.789+0000 7fcc42ffd640 1 -- 172.21.15.1:0/1747179473 <== osd.0 v2:172.21.15.1:6800/2338132980 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fcc4c069c60 con 0x7fcc3007e750 2024-05-04T02:48:23.790 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-05-04T02:48:23.790 INFO:teuthology.orchestra.run.smithi001.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-04T02:48:23.790 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-05-04T02:48:23.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.789+0000 7fcc5431b640 1 -- 172.21.15.1:0/1747179473 >> [v2:172.21.15.1:6800/2338132980,v1:172.21.15.1:6801/2338132980] conn(0x7fcc3007e750 msgr2=0x7fcc30080c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:23.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.789+0000 7fcc5431b640 1 --2- 172.21.15.1:0/1747179473 >> [v2:172.21.15.1:6800/2338132980,v1:172.21.15.1:6801/2338132980] conn(0x7fcc3007e750 0x7fcc30080c40 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:23.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.789+0000 7fcc5431b640 1 -- 172.21.15.1:0/1747179473 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fcc30076320 msgr2=0x7fcc30078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:23.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.789+0000 7fcc5431b640 1 --2- 172.21.15.1:0/1747179473 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fcc30076320 0x7fcc30078830 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fcc48034000 tx=0x7fcc4802e000 comp rx=0 tx=0).stop 2024-05-04T02:48:23.791 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.789+0000 7fcc5431b640 1 -- 172.21.15.1:0/1747179473 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcc4c15cdf0 msgr2=0x7fcc4c15b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:23.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.789+0000 7fcc5431b640 1 --2- 172.21.15.1:0/1747179473 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcc4c15cdf0 0x7fcc4c15b470 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fcc4400cad0 tx=0x7fcc4400cf90 comp rx=0 tx=0).stop 2024-05-04T02:48:23.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.789+0000 7fcc528b8640 1 -- 172.21.15.1:0/1747179473 reap_dead start 2024-05-04T02:48:23.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.789+0000 7fcc5431b640 1 -- 172.21.15.1:0/1747179473 shutdown_connections 2024-05-04T02:48:23.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.789+0000 7fcc5431b640 1 -- 172.21.15.1:0/1747179473 >> 172.21.15.1:0/1747179473 conn(0x7fcc4c0ce960 msgr2=0x7fcc4c0d0ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:48:23.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.789+0000 7fcc5431b640 1 -- 172.21.15.1:0/1747179473 shutdown_connections 2024-05-04T02:48:23.792 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.789+0000 7fcc5431b640 1 -- 172.21.15.1:0/1747179473 wait complete. 2024-05-04T02:48:23.801 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-05-04T02:48:23.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.913+0000 7faa37ef2640 1 Processor -- start 2024-05-04T02:48:23.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.913+0000 7faa37ef2640 1 -- start start 2024-05-04T02:48:23.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.914+0000 7faa37ef2640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7faa300c7da0 0x7faa3015cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:23.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.914+0000 7faa37ef2640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa300cc590 0x7faa300cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:23.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.914+0000 7faa37ef2640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa300cd6c0 con 0x7faa300cde50 2024-05-04T02:48:23.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.914+0000 7faa37ef2640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7faa300c7070 con 0x7faa300c7da0 2024-05-04T02:48:23.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.914+0000 7faa37ef2640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7faa300cd980 con 0x7faa300cc590 2024-05-04T02:48:23.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.915+0000 7faa35c8e640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7faa300cde50 0x7faa3006c6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:37642/0 (socket says 172.21.15.1:37642) 2024-05-04T02:48:23.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.915+0000 7faa35c8e640 1 -- 172.21.15.1:0/2848034611 learned_addr learned my addr 172.21.15.1:0/2848034611 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-05-04T02:48:23.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.915+0000 7faa3648f640 1 --2- 172.21.15.1:0/2848034611 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa300cc590 0x7faa300cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:23.916 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.915+0000 7faa3548d640 1 --2- 172.21.15.1:0/2848034611 >> v2:172.21.15.107:3300/0 conn(0x7faa300c7da0 0x7faa3015cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:23.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.917+0000 7faa34c8c640 1 -- 172.21.15.1:0/2848034611 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3787913683 0 0) 0x7faa300cd6c0 con 0x7faa300cde50 2024-05-04T02:48:23.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.918+0000 7faa34c8c640 1 -- 172.21.15.1:0/2848034611 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa1c003520 con 0x7faa300cde50 2024-05-04T02:48:23.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.918+0000 7faa3548d640 1 -- 172.21.15.1:0/2848034611 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa300cc590 msgr2=0x7faa300cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:48:23.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.918+0000 7faa3548d640 1 --2- 172.21.15.1:0/2848034611 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa300cc590 0x7faa300cc9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:23.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.918+0000 7faa3548d640 1 -- 172.21.15.1:0/2848034611 >> v1:172.21.15.1:6789/0 conn(0x7faa300cde50 legacy=0x7faa3006c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:23.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.918+0000 7faa3548d640 1 -- 172.21.15.1:0/2848034611 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa300c72c0 con 0x7faa300c7da0 2024-05-04T02:48:23.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.920+0000 7faa3548d640 1 --2- 172.21.15.1:0/2848034611 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa300c7da0 0x7faa3015cfb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7faa300c71f0 tx=0x7faa2002a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99e7a635070593bb server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:23.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.925+0000 7faa34c8c640 1 -- 172.21.15.1:0/2848034611 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa20037070 con 0x7faa300c7da0 2024-05-04T02:48:23.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.925+0000 7faa34c8c640 1 -- 172.21.15.1:0/2848034611 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa20032440 con 0x7faa300c7da0 2024-05-04T02:48:23.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.925+0000 7faa34c8c640 1 -- 172.21.15.1:0/2848034611 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa20032810 con 0x7faa300c7da0 2024-05-04T02:48:23.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.925+0000 7faa37ef2640 1 -- 172.21.15.1:0/2848034611 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa300c7da0 msgr2=0x7faa3015cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:23.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.925+0000 7faa37ef2640 1 --2- 172.21.15.1:0/2848034611 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa300c7da0 0x7faa3015cfb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7faa300c71f0 tx=0x7faa2002a210 comp rx=0 tx=0).stop 2024-05-04T02:48:23.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.925+0000 7faa37ef2640 1 -- 172.21.15.1:0/2848034611 shutdown_connections 2024-05-04T02:48:23.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.925+0000 7faa37ef2640 1 --2- 172.21.15.1:0/2848034611 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa300cc590 0x7faa300cc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:23.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.925+0000 7faa37ef2640 1 --2- 172.21.15.1:0/2848034611 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa300c7da0 0x7faa3015cfb0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:23.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.925+0000 7faa37ef2640 1 -- 172.21.15.1:0/2848034611 >> 172.21.15.1:0/2848034611 conn(0x7faa300d2590 msgr2=0x7faa300ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:48:23.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.926+0000 7faa37ef2640 1 -- 172.21.15.1:0/2848034611 shutdown_connections 2024-05-04T02:48:23.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.926+0000 7faa37ef2640 1 -- 172.21.15.1:0/2848034611 wait complete. 2024-05-04T02:48:23.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.927+0000 7faa37ef2640 1 Processor -- start 2024-05-04T02:48:23.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.927+0000 7faa37ef2640 1 -- start start 2024-05-04T02:48:23.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.929+0000 7faa37ef2640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa300c7da0 0x7faa301f2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:23.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.929+0000 7faa37ef2640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa300cc590 0x7faa30148230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:23.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.929+0000 7faa37ef2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faa300cb8f0 0x7faa30148770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:23.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.929+0000 7faa37ef2640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7faa30156b40 con 0x7faa300cb8f0 2024-05-04T02:48:23.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.929+0000 7faa37ef2640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7faa300c7880 con 0x7faa300c7da0 2024-05-04T02:48:23.930 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.929+0000 7faa37ef2640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7faa300cd310 con 0x7faa300cc590 2024-05-04T02:48:23.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.929+0000 7faa3648f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faa300cb8f0 0x7faa30148770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:23.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.929+0000 7faa3548d640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa300cc590 0x7faa30148230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:23.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.929+0000 7faa35c8e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa300c7da0 0x7faa301f2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:23.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.929+0000 7faa3648f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faa300cb8f0 0x7faa30148770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37754/0 (socket says 172.21.15.1:37754) 2024-05-04T02:48:23.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.929+0000 7faa3648f640 1 -- 172.21.15.1:0/2767648186 learned_addr learned my addr 172.21.15.1:0/2767648186 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:48:23.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.933+0000 7faa3648f640 1 -- 172.21.15.1:0/2767648186 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa300cc590 msgr2=0x7faa30148230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:23.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.933+0000 7faa3648f640 1 --2- 172.21.15.1:0/2767648186 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa300cc590 0x7faa30148230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:23.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.933+0000 7faa3648f640 1 -- 172.21.15.1:0/2767648186 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa300c7da0 msgr2=0x7faa301f2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:23.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.933+0000 7faa3648f640 1 --2- 172.21.15.1:0/2767648186 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa300c7da0 0x7faa301f2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:23.935 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.933+0000 7faa3648f640 1 -- 172.21.15.1:0/2767648186 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa301565a0 con 0x7faa300cb8f0 2024-05-04T02:48:23.936 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.936+0000 7faa3648f640 1 --2- 172.21.15.1:0/2767648186 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faa300cb8f0 0x7faa30148770 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7faa2800efc0 tx=0x7faa2800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:23.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.940+0000 7faa267fc640 1 -- 172.21.15.1:0/2767648186 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa28018020 con 0x7faa300cb8f0 2024-05-04T02:48:23.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.940+0000 7faa267fc640 1 -- 172.21.15.1:0/2767648186 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa28014480 con 0x7faa300cb8f0 2024-05-04T02:48:23.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.940+0000 7faa267fc640 1 -- 172.21.15.1:0/2767648186 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa28009e60 con 0x7faa300cb8f0 2024-05-04T02:48:23.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.940+0000 7faa37ef2640 1 -- 172.21.15.1:0/2767648186 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa301f2440 con 0x7faa300cb8f0 2024-05-04T02:48:23.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.940+0000 7faa37ef2640 1 -- 172.21.15.1:0/2767648186 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa3015af60 con 0x7faa300cb8f0 2024-05-04T02:48:23.941 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.941+0000 7faa37ef2640 1 -- 172.21.15.1:0/2767648186 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa3015b1c0 con 0x7faa300cb8f0 2024-05-04T02:48:23.965 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.965+0000 7faa267fc640 1 -- 172.21.15.1:0/2767648186 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7faa28005d10 con 0x7faa300cb8f0 2024-05-04T02:48:23.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.965+0000 7faa267fc640 1 --2- 172.21.15.1:0/2767648186 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7faa14076350 0x7faa14078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:23.966 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.966+0000 7faa35c8e640 1 --2- 172.21.15.1:0/2767648186 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7faa14076350 0x7faa14078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:23.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:23.966+0000 7faa35c8e640 1 --2- 172.21.15.1:0/2767648186 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7faa14076350 0x7faa14078860 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7faa2c005880 tx=0x7faa2c006aa0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:24.253 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.252+0000 7faa267fc640 1 -- 172.21.15.1:0/2767648186 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5854+0+0 (secure 0 0 0) 0x7faa2805df50 con 0x7faa300cb8f0 2024-05-04T02:48:24.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.253+0000 7faa267fc640 1 -- 172.21.15.1:0/2767648186 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7faa28022020 con 0x7faa300cb8f0 2024-05-04T02:48:24.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.446+0000 7faa37ef2640 1 -- 172.21.15.1:0/2767648186 --> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7faa30148cb0 con 0x7faa14076350 2024-05-04T02:48:24.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.447+0000 7faa267fc640 1 -- 172.21.15.1:0/2767648186 <== mgr.4108 v2:172.21.15.107:6800/3809222574 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7faa30148cb0 con 0x7faa14076350 2024-05-04T02:48:24.448 INFO:teuthology.orchestra.run.smithi001.stderr:instructed osd(s) 0 to deep-scrub 2024-05-04T02:48:24.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.449+0000 7faa37ef2640 1 -- 172.21.15.1:0/2767648186 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7faa14076350 msgr2=0x7faa14078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:24.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.449+0000 7faa37ef2640 1 --2- 172.21.15.1:0/2767648186 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7faa14076350 0x7faa14078860 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7faa2c005880 tx=0x7faa2c006aa0 comp rx=0 tx=0).stop 2024-05-04T02:48:24.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.449+0000 7faa37ef2640 1 -- 172.21.15.1:0/2767648186 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faa300cb8f0 msgr2=0x7faa30148770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:24.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.449+0000 7faa37ef2640 1 --2- 172.21.15.1:0/2767648186 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faa300cb8f0 0x7faa30148770 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7faa2800efc0 tx=0x7faa2800c490 comp rx=0 tx=0).stop 2024-05-04T02:48:24.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.449+0000 7faa37ef2640 1 -- 172.21.15.1:0/2767648186 shutdown_connections 2024-05-04T02:48:24.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.449+0000 7faa37ef2640 1 --2- 172.21.15.1:0/2767648186 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7faa14076350 0x7faa14078860 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:24.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.449+0000 7faa37ef2640 1 --2- 172.21.15.1:0/2767648186 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faa300cb8f0 0x7faa30148770 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:24.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.449+0000 7faa37ef2640 1 --2- 172.21.15.1:0/2767648186 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa300cc590 0x7faa30148230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:24.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.449+0000 7faa37ef2640 1 --2- 172.21.15.1:0/2767648186 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa300c7da0 0x7faa301f2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:24.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.449+0000 7faa37ef2640 1 -- 172.21.15.1:0/2767648186 >> 172.21.15.1:0/2767648186 conn(0x7faa300d2590 msgr2=0x7faa300cc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:48:24.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.449+0000 7faa37ef2640 1 -- 172.21.15.1:0/2767648186 shutdown_connections 2024-05-04T02:48:24.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.449+0000 7faa37ef2640 1 -- 172.21.15.1:0/2767648186 wait complete. 2024-05-04T02:48:24.462 INFO:tasks.ceph:Scrubbing osd.1 2024-05-04T02:48:24.462 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-05-04T02:48:24.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.579+0000 7f1a5dde3640 1 Processor -- start 2024-05-04T02:48:24.580 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.579+0000 7f1a5dde3640 1 -- start start 2024-05-04T02:48:24.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.580+0000 7f1a5dde3640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f1a580cd060 0x7f1a580cde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:24.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.580+0000 7f1a5dde3640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f1a580cc980 0x7f1a5815ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:24.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.580+0000 7f1a5dde3640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a5815a2e0 con 0x7f1a5815d8d0 2024-05-04T02:48:24.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.580+0000 7f1a5dde3640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f1a5815a910 con 0x7f1a580cd060 2024-05-04T02:48:24.581 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.580+0000 7f1a5dde3640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f1a5815b2e0 con 0x7f1a580cc980 2024-05-04T02:48:24.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.603+0000 7f1a56ffd640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f1a580cc980 0x7f1a5815ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:24.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.604+0000 7f1a57fff640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f1a5815d8d0 0x7f1a580708b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.1:37354/0 (socket says 172.21.15.1:37354) 2024-05-04T02:48:24.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.604+0000 7f1a57fff640 1 -- 172.21.15.1:0/165761005 learned_addr learned my addr 172.21.15.1:0/165761005 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-05-04T02:48:24.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.605+0000 7f1a577fe640 1 --2- 172.21.15.1:0/165761005 >> v2:172.21.15.1:3300/0 conn(0x7f1a580cd060 0x7f1a580cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:24.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.609+0000 7f1a56ffd640 1 -- 172.21.15.1:0/165761005 >> v2:172.21.15.1:3300/0 conn(0x7f1a580cd060 msgr2=0x7f1a580cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:48:24.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.609+0000 7f1a56ffd640 1 --2- 172.21.15.1:0/165761005 >> v2:172.21.15.1:3300/0 conn(0x7f1a580cd060 0x7f1a580cde80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:24.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.609+0000 7f1a56ffd640 1 -- 172.21.15.1:0/165761005 >> v1:172.21.15.107:6789/0 conn(0x7f1a5815d8d0 legacy=0x7f1a580708b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:24.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.609+0000 7f1a56ffd640 1 -- 172.21.15.1:0/165761005 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a5815e0a0 con 0x7f1a580cc980 2024-05-04T02:48:24.614 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.613+0000 7f1a56ffd640 1 --2- 172.21.15.1:0/165761005 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a580cc980 0x7f1a5815ada0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1a580b3d10 tx=0x7f1a4c02a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31142ab481af6b51 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:24.625 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.624+0000 7f1a567fc640 1 -- 172.21.15.1:0/165761005 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c007740 con 0x7f1a580cc980 2024-05-04T02:48:24.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.624+0000 7f1a567fc640 1 -- 172.21.15.1:0/165761005 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a4c0078e0 con 0x7f1a580cc980 2024-05-04T02:48:24.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.624+0000 7f1a567fc640 1 -- 172.21.15.1:0/165761005 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c007cb0 con 0x7f1a580cc980 2024-05-04T02:48:24.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.625+0000 7f1a5dde3640 1 -- 172.21.15.1:0/165761005 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a580cc980 msgr2=0x7f1a5815ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:24.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.625+0000 7f1a5dde3640 1 --2- 172.21.15.1:0/165761005 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a580cc980 0x7f1a5815ada0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1a580b3d10 tx=0x7f1a4c02a5f0 comp rx=0 tx=0).stop 2024-05-04T02:48:24.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.625+0000 7f1a5dde3640 1 -- 172.21.15.1:0/165761005 shutdown_connections 2024-05-04T02:48:24.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.625+0000 7f1a5dde3640 1 --2- 172.21.15.1:0/165761005 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a580cc980 0x7f1a5815ada0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:24.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.625+0000 7f1a5dde3640 1 --2- 172.21.15.1:0/165761005 >> v2:172.21.15.1:3300/0 conn(0x7f1a580cd060 0x7f1a580cde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:24.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.625+0000 7f1a5dde3640 1 -- 172.21.15.1:0/165761005 >> 172.21.15.1:0/165761005 conn(0x7f1a580cb8e0 msgr2=0x7f1a580ce5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:48:24.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.625+0000 7f1a5dde3640 1 -- 172.21.15.1:0/165761005 shutdown_connections 2024-05-04T02:48:24.627 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.625+0000 7f1a5dde3640 1 -- 172.21.15.1:0/165761005 wait complete. 2024-05-04T02:48:24.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.628+0000 7f1a5dde3640 1 Processor -- start 2024-05-04T02:48:24.629 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.628+0000 7f1a5dde3640 1 -- start start 2024-05-04T02:48:24.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.629+0000 7f1a5dde3640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1a580cc980 0x7f1a581f0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:24.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.629+0000 7f1a5dde3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1a580cd060 0x7f1a58151fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:24.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.629+0000 7f1a5dde3640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a5815d8d0 0x7f1a581524f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:24.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.629+0000 7f1a5dde3640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1a5815a5a0 con 0x7f1a580cd060 2024-05-04T02:48:24.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.629+0000 7f1a5dde3640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1a5815e660 con 0x7f1a5815d8d0 2024-05-04T02:48:24.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.629+0000 7f1a5dde3640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f1a5815dce0 con 0x7f1a580cc980 2024-05-04T02:48:24.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.630+0000 7f1a577fe640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1a580cc980 0x7f1a581f0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:24.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.630+0000 7f1a56ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1a580cd060 0x7f1a58151fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:24.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.630+0000 7f1a577fe640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1a580cc980 0x7f1a581f0ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.1:60648/0 (socket says 172.21.15.1:60648) 2024-05-04T02:48:24.631 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.630+0000 7f1a577fe640 1 -- 172.21.15.1:0/3238214969 learned_addr learned my addr 172.21.15.1:0/3238214969 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:48:24.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.633+0000 7f1a57fff640 1 --2- 172.21.15.1:0/3238214969 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a5815d8d0 0x7f1a581524f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:24.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.634+0000 7f1a56ffd640 1 -- 172.21.15.1:0/3238214969 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1a580cc980 msgr2=0x7f1a581f0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:24.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.634+0000 7f1a56ffd640 1 --2- 172.21.15.1:0/3238214969 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1a580cc980 0x7f1a581f0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:24.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.634+0000 7f1a56ffd640 1 -- 172.21.15.1:0/3238214969 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a5815d8d0 msgr2=0x7f1a581524f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:24.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.634+0000 7f1a56ffd640 1 --2- 172.21.15.1:0/3238214969 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a5815d8d0 0x7f1a581524f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:24.635 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.634+0000 7f1a56ffd640 1 -- 172.21.15.1:0/3238214969 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a5806df20 con 0x7f1a580cd060 2024-05-04T02:48:24.637 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.637+0000 7f1a56ffd640 1 --2- 172.21.15.1:0/3238214969 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1a580cd060 0x7f1a58151fb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c031000 tx=0x7f1a4c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:24.642 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.641+0000 7f1a3ffff640 1 -- 172.21.15.1:0/3238214969 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c03f070 con 0x7f1a580cd060 2024-05-04T02:48:24.642 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.641+0000 7f1a3ffff640 1 -- 172.21.15.1:0/3238214969 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a4c031c40 con 0x7f1a580cd060 2024-05-04T02:48:24.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.641+0000 7f1a3ffff640 1 -- 172.21.15.1:0/3238214969 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c044460 con 0x7f1a580cd060 2024-05-04T02:48:24.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.641+0000 7f1a5dde3640 1 -- 172.21.15.1:0/3238214969 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a58150d80 con 0x7f1a580cd060 2024-05-04T02:48:24.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.641+0000 7f1a5dde3640 1 -- 172.21.15.1:0/3238214969 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a581f06f0 con 0x7f1a580cd060 2024-05-04T02:48:24.643 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.642+0000 7f1a5dde3640 1 -- 172.21.15.1:0/3238214969 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1a58076740 con 0x7f1a580cd060 2024-05-04T02:48:24.666 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.665+0000 7f1a3ffff640 1 -- 172.21.15.1:0/3238214969 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1a4c044600 con 0x7f1a580cd060 2024-05-04T02:48:24.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.666+0000 7f1a3ffff640 1 --2- 172.21.15.1:0/3238214969 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f1a440762d0 0x7f1a440787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:24.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.666+0000 7f1a577fe640 1 --2- 172.21.15.1:0/3238214969 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f1a440762d0 0x7f1a440787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:24.667 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.667+0000 7f1a577fe640 1 --2- 172.21.15.1:0/3238214969 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f1a440762d0 0x7f1a440787e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1a48009b60 tx=0x7f1a48009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:24.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.672+0000 7f1a3ffff640 1 -- 172.21.15.1:0/3238214969 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5854+0+0 (secure 0 0 0) 0x7f1a4c007840 con 0x7f1a580cd060 2024-05-04T02:48:24.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.672+0000 7f1a3ffff640 1 --2- 172.21.15.1:0/3238214969 >> [v2:172.21.15.1:6816/459131368,v1:172.21.15.1:6817/459131368] conn(0x7f1a4407e700 0x7f1a44080bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:24.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.672+0000 7f1a3ffff640 1 -- 172.21.15.1:0/3238214969 --> [v2:172.21.15.1:6816/459131368,v1:172.21.15.1:6817/459131368] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1a440812c0 con 0x7f1a4407e700 2024-05-04T02:48:24.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.672+0000 7f1a3ffff640 1 -- 172.21.15.1:0/3238214969 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1a4c07f020 con 0x7f1a580cd060 2024-05-04T02:48:24.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.672+0000 7f1a57fff640 1 --2- 172.21.15.1:0/3238214969 >> [v2:172.21.15.1:6816/459131368,v1:172.21.15.1:6817/459131368] conn(0x7f1a4407e700 0x7f1a44080bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:24.673 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.672+0000 7f1a57fff640 1 --2- 172.21.15.1:0/3238214969 >> [v2:172.21.15.1:6816/459131368,v1:172.21.15.1:6817/459131368] conn(0x7f1a4407e700 0x7f1a44080bf0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:24.674 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.673+0000 7f1a3ffff640 1 -- 172.21.15.1:0/3238214969 <== osd.1 v2:172.21.15.1:6816/459131368 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1a440812c0 con 0x7f1a4407e700 2024-05-04T02:48:24.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.686+0000 7f1a5dde3640 1 -- 172.21.15.1:0/3238214969 --> [v2:172.21.15.1:6816/459131368,v1:172.21.15.1:6817/459131368] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f1a580713f0 con 0x7f1a4407e700 2024-05-04T02:48:24.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.686+0000 7f1a3ffff640 1 -- 172.21.15.1:0/3238214969 <== osd.1 v2:172.21.15.1:6816/459131368 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f1a580713f0 con 0x7f1a4407e700 2024-05-04T02:48:24.688 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-05-04T02:48:24.688 INFO:teuthology.orchestra.run.smithi001.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-04T02:48:24.688 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-05-04T02:48:24.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.687+0000 7f1a5dde3640 1 -- 172.21.15.1:0/3238214969 >> [v2:172.21.15.1:6816/459131368,v1:172.21.15.1:6817/459131368] conn(0x7f1a4407e700 msgr2=0x7f1a44080bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:24.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.687+0000 7f1a5dde3640 1 --2- 172.21.15.1:0/3238214969 >> [v2:172.21.15.1:6816/459131368,v1:172.21.15.1:6817/459131368] conn(0x7f1a4407e700 0x7f1a44080bf0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:24.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.687+0000 7f1a5dde3640 1 -- 172.21.15.1:0/3238214969 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f1a440762d0 msgr2=0x7f1a440787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:24.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.687+0000 7f1a5dde3640 1 --2- 172.21.15.1:0/3238214969 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f1a440762d0 0x7f1a440787e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1a48009b60 tx=0x7f1a48009190 comp rx=0 tx=0).stop 2024-05-04T02:48:24.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.687+0000 7f1a5dde3640 1 -- 172.21.15.1:0/3238214969 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1a580cd060 msgr2=0x7f1a58151fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:24.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.687+0000 7f1a5dde3640 1 --2- 172.21.15.1:0/3238214969 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1a580cd060 0x7f1a58151fb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c031000 tx=0x7f1a4c004a40 comp rx=0 tx=0).stop 2024-05-04T02:48:24.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.687+0000 7f1a57fff640 1 -- 172.21.15.1:0/3238214969 reap_dead start 2024-05-04T02:48:24.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.687+0000 7f1a5dde3640 1 -- 172.21.15.1:0/3238214969 shutdown_connections 2024-05-04T02:48:24.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.687+0000 7f1a5dde3640 1 -- 172.21.15.1:0/3238214969 >> 172.21.15.1:0/3238214969 conn(0x7f1a580cb8e0 msgr2=0x7f1a580ca490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:48:24.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.687+0000 7f1a5dde3640 1 -- 172.21.15.1:0/3238214969 shutdown_connections 2024-05-04T02:48:24.689 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.687+0000 7f1a5dde3640 1 -- 172.21.15.1:0/3238214969 wait complete. 2024-05-04T02:48:24.699 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-05-04T02:48:24.812 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.811+0000 7f40dad3f640 1 Processor -- start 2024-05-04T02:48:24.813 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.811+0000 7f40dad3f640 1 -- start start 2024-05-04T02:48:24.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.813+0000 7f40dad3f640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f40d415ae30 0x7f40d4165c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:24.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.813+0000 7f40dad3f640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40d415d6e0 con 0x7f40d40b5170 2024-05-04T02:48:24.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.813+0000 7f40dad3f640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40d40ca190 con 0x7f40d41546d0 2024-05-04T02:48:24.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.813+0000 7f40dad3f640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f40d40ca430 con 0x7f40d415ae30 2024-05-04T02:48:24.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.814+0000 7f40d3fff640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f40d41546d0 0x7f40d40cb4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.1:37368/0 (socket says 172.21.15.1:37368) 2024-05-04T02:48:24.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.814+0000 7f40d3fff640 1 -- 172.21.15.1:0/2262426834 learned_addr learned my addr 172.21.15.1:0/2262426834 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-05-04T02:48:24.815 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.814+0000 7f40d92dc640 1 --2- 172.21.15.1:0/2262426834 >> v2:172.21.15.1:3300/0 conn(0x7f40d415ae30 0x7f40d4165c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:24.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.816+0000 7f40d37fe640 1 -- 172.21.15.1:0/2262426834 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 359438156 0 0) 0x7f40d40ca190 con 0x7f40d41546d0 2024-05-04T02:48:24.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.816+0000 7f40d37fe640 1 -- 172.21.15.1:0/2262426834 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f40bc003520 con 0x7f40d41546d0 2024-05-04T02:48:24.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.819+0000 7f40d92dc640 1 -- 172.21.15.1:0/2262426834 >> v1:172.21.15.107:6789/0 conn(0x7f40d41546d0 legacy=0x7f40d40cb4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:24.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.819+0000 7f40d92dc640 1 -- 172.21.15.1:0/2262426834 >> v1:172.21.15.1:6789/0 conn(0x7f40d40b5170 legacy=0x7f40d40702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:24.820 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.819+0000 7f40d92dc640 1 -- 172.21.15.1:0/2262426834 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40d40ca710 con 0x7f40d415ae30 2024-05-04T02:48:24.822 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.821+0000 7f40d92dc640 1 --2- 172.21.15.1:0/2262426834 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f40d415ae30 0x7f40d4165c60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f40d40ca360 tx=0x7f40c402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7d09b5981cf11d2 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:24.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.827+0000 7f40d37fe640 1 -- 172.21.15.1:0/2262426834 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c4037070 con 0x7f40d415ae30 2024-05-04T02:48:24.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.827+0000 7f40d37fe640 1 -- 172.21.15.1:0/2262426834 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40c4032440 con 0x7f40d415ae30 2024-05-04T02:48:24.828 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.827+0000 7f40d37fe640 1 -- 172.21.15.1:0/2262426834 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c4032810 con 0x7f40d415ae30 2024-05-04T02:48:24.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.828+0000 7f40dad3f640 1 -- 172.21.15.1:0/2262426834 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f40d415ae30 msgr2=0x7f40d4165c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:24.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.828+0000 7f40dad3f640 1 --2- 172.21.15.1:0/2262426834 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f40d415ae30 0x7f40d4165c60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f40d40ca360 tx=0x7f40c402a210 comp rx=0 tx=0).stop 2024-05-04T02:48:24.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.828+0000 7f40dad3f640 1 -- 172.21.15.1:0/2262426834 shutdown_connections 2024-05-04T02:48:24.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.828+0000 7f40dad3f640 1 --2- 172.21.15.1:0/2262426834 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f40d415ae30 0x7f40d4165c60 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:24.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.828+0000 7f40dad3f640 1 -- 172.21.15.1:0/2262426834 >> 172.21.15.1:0/2262426834 conn(0x7f40d40cf6e0 msgr2=0x7f40d40cfaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:48:24.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.828+0000 7f40dad3f640 1 -- 172.21.15.1:0/2262426834 shutdown_connections 2024-05-04T02:48:24.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.828+0000 7f40dad3f640 1 -- 172.21.15.1:0/2262426834 wait complete. 2024-05-04T02:48:24.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.830+0000 7f40dad3f640 1 Processor -- start 2024-05-04T02:48:24.830 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.830+0000 7f40dad3f640 1 -- start start 2024-05-04T02:48:24.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.831+0000 7f40dad3f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f40d40b5170 0x7f40d41f0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:24.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.831+0000 7f40dad3f640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f40d41546d0 0x7f40d41e39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:24.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.831+0000 7f40dad3f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f40d415ae30 0x7f40d41f3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:24.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.831+0000 7f40dad3f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f40d40cafb0 con 0x7f40d415ae30 2024-05-04T02:48:24.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.831+0000 7f40dad3f640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f40d40cacd0 con 0x7f40d40b5170 2024-05-04T02:48:24.832 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.831+0000 7f40dad3f640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f40d4154ae0 con 0x7f40d41546d0 2024-05-04T02:48:24.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.832+0000 7f40d92dc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f40d415ae30 0x7f40d41f3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:24.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.832+0000 7f40d8adb640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f40d40b5170 0x7f40d41f0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:24.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.832+0000 7f40d3fff640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f40d41546d0 0x7f40d41e39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:24.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.832+0000 7f40d92dc640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f40d415ae30 0x7f40d41f3aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37796/0 (socket says 172.21.15.1:37796) 2024-05-04T02:48:24.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.832+0000 7f40d92dc640 1 -- 172.21.15.1:0/3297676777 learned_addr learned my addr 172.21.15.1:0/3297676777 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:48:24.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.836+0000 7f40d92dc640 1 -- 172.21.15.1:0/3297676777 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f40d41546d0 msgr2=0x7f40d41e39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:24.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.836+0000 7f40d92dc640 1 --2- 172.21.15.1:0/3297676777 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f40d41546d0 0x7f40d41e39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:24.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.836+0000 7f40d92dc640 1 -- 172.21.15.1:0/3297676777 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f40d40b5170 msgr2=0x7f40d41f0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:24.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.836+0000 7f40d92dc640 1 --2- 172.21.15.1:0/3297676777 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f40d40b5170 0x7f40d41f0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:24.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.836+0000 7f40d92dc640 1 -- 172.21.15.1:0/3297676777 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40d41f0c90 con 0x7f40d415ae30 2024-05-04T02:48:24.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.838+0000 7f40d92dc640 1 --2- 172.21.15.1:0/3297676777 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f40d415ae30 0x7f40d41f3aa0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f40c4009890 tx=0x7f40c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:24.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.842+0000 7f40d17fa640 1 -- 172.21.15.1:0/3297676777 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c4037040 con 0x7f40d415ae30 2024-05-04T02:48:24.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.842+0000 7f40d17fa640 1 -- 172.21.15.1:0/3297676777 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40c4042070 con 0x7f40d415ae30 2024-05-04T02:48:24.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.842+0000 7f40dad3f640 1 -- 172.21.15.1:0/3297676777 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40d40c39b0 con 0x7f40d415ae30 2024-05-04T02:48:24.843 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.842+0000 7f40d17fa640 1 -- 172.21.15.1:0/3297676777 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c4030880 con 0x7f40d415ae30 2024-05-04T02:48:24.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.842+0000 7f40dad3f640 1 -- 172.21.15.1:0/3297676777 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40d40c3c50 con 0x7f40d415ae30 2024-05-04T02:48:24.844 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.843+0000 7f40dad3f640 1 -- 172.21.15.1:0/3297676777 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40d4076740 con 0x7f40d415ae30 2024-05-04T02:48:24.867 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.867+0000 7f40d17fa640 1 -- 172.21.15.1:0/3297676777 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f40c4030a20 con 0x7f40d415ae30 2024-05-04T02:48:24.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.867+0000 7f40d17fa640 1 --2- 172.21.15.1:0/3297676777 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f40c00762d0 0x7f40c00787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:24.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.867+0000 7f40d8adb640 1 --2- 172.21.15.1:0/3297676777 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f40c00762d0 0x7f40c00787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:24.868 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.868+0000 7f40d8adb640 1 --2- 172.21.15.1:0/3297676777 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f40c00762d0 0x7f40c00787e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f40cc0012e0 tx=0x7f40cc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:24.871 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:24.870+0000 7f40d17fa640 1 -- 172.21.15.1:0/3297676777 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5854+0+0 (secure 0 0 0) 0x7f40c4030d10 con 0x7f40d415ae30 2024-05-04T02:48:25.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.186+0000 7f40d17fa640 1 -- 172.21.15.1:0/3297676777 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f40c4081cc0 con 0x7f40d415ae30 2024-05-04T02:48:25.379 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.378+0000 7f40dad3f640 1 -- 172.21.15.1:0/3297676777 --> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f40d40cbba0 con 0x7f40c00762d0 2024-05-04T02:48:25.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.379+0000 7f40d17fa640 1 -- 172.21.15.1:0/3297676777 <== mgr.4108 v2:172.21.15.107:6800/3809222574 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f40d40cbba0 con 0x7f40c00762d0 2024-05-04T02:48:25.380 INFO:teuthology.orchestra.run.smithi001.stderr:instructed osd(s) 1 to deep-scrub 2024-05-04T02:48:25.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.381+0000 7f40dad3f640 1 -- 172.21.15.1:0/3297676777 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f40c00762d0 msgr2=0x7f40c00787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:25.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.381+0000 7f40dad3f640 1 --2- 172.21.15.1:0/3297676777 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f40c00762d0 0x7f40c00787e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f40cc0012e0 tx=0x7f40cc009040 comp rx=0 tx=0).stop 2024-05-04T02:48:25.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.381+0000 7f40dad3f640 1 -- 172.21.15.1:0/3297676777 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f40d415ae30 msgr2=0x7f40d41f3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:25.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.381+0000 7f40dad3f640 1 --2- 172.21.15.1:0/3297676777 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f40d415ae30 0x7f40d41f3aa0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f40c4009890 tx=0x7f40c40046c0 comp rx=0 tx=0).stop 2024-05-04T02:48:25.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.381+0000 7f40dad3f640 1 -- 172.21.15.1:0/3297676777 shutdown_connections 2024-05-04T02:48:25.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.381+0000 7f40dad3f640 1 --2- 172.21.15.1:0/3297676777 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f40c00762d0 0x7f40c00787e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:25.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.381+0000 7f40dad3f640 1 --2- 172.21.15.1:0/3297676777 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f40d415ae30 0x7f40d41f3aa0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:25.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.381+0000 7f40dad3f640 1 --2- 172.21.15.1:0/3297676777 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f40d41546d0 0x7f40d41e39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:25.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.381+0000 7f40dad3f640 1 --2- 172.21.15.1:0/3297676777 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f40d40b5170 0x7f40d41f0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:25.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.381+0000 7f40dad3f640 1 -- 172.21.15.1:0/3297676777 >> 172.21.15.1:0/3297676777 conn(0x7f40d40cf6e0 msgr2=0x7f40d40702a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:48:25.383 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.381+0000 7f40dad3f640 1 -- 172.21.15.1:0/3297676777 shutdown_connections 2024-05-04T02:48:25.384 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.381+0000 7f40dad3f640 1 -- 172.21.15.1:0/3297676777 wait complete. 2024-05-04T02:48:25.394 INFO:tasks.ceph:Scrubbing osd.2 2024-05-04T02:48:25.395 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-05-04T02:48:25.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.514+0000 7fa41369a640 1 Processor -- start 2024-05-04T02:48:25.515 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.514+0000 7fa41369a640 1 -- start start 2024-05-04T02:48:25.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.515+0000 7fa41369a640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa40c0cdcf0 0x7fa40c06d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:25.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.515+0000 7fa41369a640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fa40c15c4a0 0x7fa40c15c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:25.516 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.515+0000 7fa41369a640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa40c0cd3b0 con 0x7fa40c15cdf0 2024-05-04T02:48:25.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.515+0000 7fa41369a640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7fa40c0b74b0 con 0x7fa40c15c4a0 2024-05-04T02:48:25.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.515+0000 7fa41369a640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa40c06d1a0 con 0x7fa40c0cdcf0 2024-05-04T02:48:25.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.516+0000 7fa411436640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa40c0cdcf0 0x7fa40c06d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:25.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.516+0000 7fa411c37640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fa40c15cdf0 0x7fa40c15fa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.1:37378/0 (socket says 172.21.15.1:37378) 2024-05-04T02:48:25.517 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.516+0000 7fa411c37640 1 -- 172.21.15.1:0/1482319753 learned_addr learned my addr 172.21.15.1:0/1482319753 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-05-04T02:48:25.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.519+0000 7fa403fff640 1 -- 172.21.15.1:0/1482319753 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2259477821 0 0) 0x7fa40c0cd3b0 con 0x7fa40c15cdf0 2024-05-04T02:48:25.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.519+0000 7fa403fff640 1 -- 172.21.15.1:0/1482319753 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa3f8003520 con 0x7fa40c15cdf0 2024-05-04T02:48:25.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.519+0000 7fa411436640 1 -- 172.21.15.1:0/1482319753 >> v2:172.21.15.1:3300/0 conn(0x7fa40c15c4a0 msgr2=0x7fa40c15c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:48:25.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.519+0000 7fa411436640 1 --2- 172.21.15.1:0/1482319753 >> v2:172.21.15.1:3300/0 conn(0x7fa40c15c4a0 0x7fa40c15c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:25.520 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.519+0000 7fa411436640 1 -- 172.21.15.1:0/1482319753 >> v1:172.21.15.107:6789/0 conn(0x7fa40c15cdf0 legacy=0x7fa40c15fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:25.521 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.519+0000 7fa411436640 1 -- 172.21.15.1:0/1482319753 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa40c06d480 con 0x7fa40c0cdcf0 2024-05-04T02:48:25.522 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.522+0000 7fa411436640 1 --2- 172.21.15.1:0/1482319753 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa40c0cdcf0 0x7fa40c06d9a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa4080097a0 tx=0x7fa40802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93e7fd2077993027 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:25.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.525+0000 7fa403fff640 1 -- 172.21.15.1:0/1482319753 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa408037070 con 0x7fa40c0cdcf0 2024-05-04T02:48:25.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.526+0000 7fa403fff640 1 -- 172.21.15.1:0/1482319753 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa408032440 con 0x7fa40c0cdcf0 2024-05-04T02:48:25.526 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.526+0000 7fa403fff640 1 -- 172.21.15.1:0/1482319753 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa408032810 con 0x7fa40c0cdcf0 2024-05-04T02:48:25.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.526+0000 7fa41369a640 1 -- 172.21.15.1:0/1482319753 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa40c0cdcf0 msgr2=0x7fa40c06d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:25.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.526+0000 7fa41369a640 1 --2- 172.21.15.1:0/1482319753 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa40c0cdcf0 0x7fa40c06d9a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa4080097a0 tx=0x7fa40802a210 comp rx=0 tx=0).stop 2024-05-04T02:48:25.527 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.526+0000 7fa41369a640 1 -- 172.21.15.1:0/1482319753 shutdown_connections 2024-05-04T02:48:25.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.526+0000 7fa41369a640 1 --2- 172.21.15.1:0/1482319753 >> v2:172.21.15.1:3300/0 conn(0x7fa40c15c4a0 0x7fa40c15c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:25.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.526+0000 7fa41369a640 1 --2- 172.21.15.1:0/1482319753 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa40c0cdcf0 0x7fa40c06d9a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:25.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.526+0000 7fa41369a640 1 -- 172.21.15.1:0/1482319753 >> 172.21.15.1:0/1482319753 conn(0x7fa40c0ce960 msgr2=0x7fa40c08cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:48:25.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.526+0000 7fa41369a640 1 -- 172.21.15.1:0/1482319753 shutdown_connections 2024-05-04T02:48:25.528 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.526+0000 7fa41369a640 1 -- 172.21.15.1:0/1482319753 wait complete. 2024-05-04T02:48:25.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.528+0000 7fa41369a640 1 Processor -- start 2024-05-04T02:48:25.529 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.528+0000 7fa41369a640 1 -- start start 2024-05-04T02:48:25.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.529+0000 7fa41369a640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa40c0cdcf0 0x7fa40c1f2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:25.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.529+0000 7fa41369a640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa40c15c4a0 0x7fa40c1e5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:25.530 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.529+0000 7fa41369a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa40c15cdf0 0x7fa40c1538e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:25.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.529+0000 7fa41369a640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fa40c0b7790 con 0x7fa40c15cdf0 2024-05-04T02:48:25.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.529+0000 7fa41369a640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fa40c15d200 con 0x7fa40c0cdcf0 2024-05-04T02:48:25.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.529+0000 7fa41369a640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fa40c0cd7c0 con 0x7fa40c15c4a0 2024-05-04T02:48:25.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.530+0000 7fa410c35640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa40c15c4a0 0x7fa40c1e5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:25.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.530+0000 7fa411436640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa40c0cdcf0 0x7fa40c1f2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:25.531 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.530+0000 7fa410c35640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa40c15c4a0 0x7fa40c1e5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.1:60686/0 (socket says 172.21.15.1:60686) 2024-05-04T02:48:25.532 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.530+0000 7fa410c35640 1 -- 172.21.15.1:0/536803333 learned_addr learned my addr 172.21.15.1:0/536803333 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:48:25.535 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.534+0000 7fa410c35640 1 -- 172.21.15.1:0/536803333 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa40c0cdcf0 msgr2=0x7fa40c1f2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:25.535 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.534+0000 7fa410c35640 1 --2- 172.21.15.1:0/536803333 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fa40c0cdcf0 0x7fa40c1f2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:25.535 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.534+0000 7fa410c35640 1 -- 172.21.15.1:0/536803333 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa40c15cdf0 msgr2=0x7fa40c1538e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:25.535 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.534+0000 7fa410c35640 1 --2- 172.21.15.1:0/536803333 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fa40c15cdf0 0x7fa40c1538e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:25.535 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.534+0000 7fa410c35640 1 -- 172.21.15.1:0/536803333 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa40c1f3100 con 0x7fa40c15c4a0 2024-05-04T02:48:25.538 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.537+0000 7fa410c35640 1 --2- 172.21.15.1:0/536803333 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa40c15c4a0 0x7fa40c1e5db0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc00b410 tx=0x7fa3fc00b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:25.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.541+0000 7fa401ffb640 1 -- 172.21.15.1:0/536803333 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3fc015020 con 0x7fa40c15c4a0 2024-05-04T02:48:25.541 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.541+0000 7fa41369a640 1 -- 172.21.15.1:0/536803333 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa40c154490 con 0x7fa40c15c4a0 2024-05-04T02:48:25.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.541+0000 7fa41369a640 1 -- 172.21.15.1:0/536803333 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa40c156fb0 con 0x7fa40c15c4a0 2024-05-04T02:48:25.542 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.542+0000 7fa41369a640 1 -- 172.21.15.1:0/536803333 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa40c069c60 con 0x7fa40c15c4a0 2024-05-04T02:48:25.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.568+0000 7fa401ffb640 1 -- 172.21.15.1:0/536803333 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa40c069c60 con 0x7fa40c15c4a0 2024-05-04T02:48:25.569 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.568+0000 7fa401ffb640 1 -- 172.21.15.1:0/536803333 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3fc011a30 con 0x7fa40c15c4a0 2024-05-04T02:48:25.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.574+0000 7fa401ffb640 1 -- 172.21.15.1:0/536803333 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa3fc018020 con 0x7fa40c15c4a0 2024-05-04T02:48:25.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.574+0000 7fa401ffb640 1 --2- 172.21.15.1:0/536803333 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fa3f00762d0 0x7fa3f00787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:25.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.575+0000 7fa411436640 1 --2- 172.21.15.1:0/536803333 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fa3f00762d0 0x7fa3f00787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:25.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.575+0000 7fa411436640 1 --2- 172.21.15.1:0/536803333 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fa3f00762d0 0x7fa3f00787e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa408034000 tx=0x7fa40802e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:25.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.575+0000 7fa401ffb640 1 -- 172.21.15.1:0/536803333 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 5854+0+0 (secure 0 0 0) 0x7fa3fc095e60 con 0x7fa40c15c4a0 2024-05-04T02:48:25.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.575+0000 7fa401ffb640 1 --2- 172.21.15.1:0/536803333 >> [v2:172.21.15.1:6808/3463851105,v1:172.21.15.1:6809/3463851105] conn(0x7fa3f007e700 0x7fa3f0080bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:25.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.575+0000 7fa401ffb640 1 -- 172.21.15.1:0/536803333 --> [v2:172.21.15.1:6808/3463851105,v1:172.21.15.1:6809/3463851105] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa3f00812c0 con 0x7fa3f007e700 2024-05-04T02:48:25.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.575+0000 7fa411c37640 1 --2- 172.21.15.1:0/536803333 >> [v2:172.21.15.1:6808/3463851105,v1:172.21.15.1:6809/3463851105] conn(0x7fa3f007e700 0x7fa3f0080bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:25.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.576+0000 7fa411c37640 1 --2- 172.21.15.1:0/536803333 >> [v2:172.21.15.1:6808/3463851105,v1:172.21.15.1:6809/3463851105] conn(0x7fa3f007e700 0x7fa3f0080bf0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:25.577 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.577+0000 7fa401ffb640 1 -- 172.21.15.1:0/536803333 <== osd.2 v2:172.21.15.1:6808/3463851105 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa3f00812c0 con 0x7fa3f007e700 2024-05-04T02:48:25.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.590+0000 7fa41369a640 1 -- 172.21.15.1:0/536803333 --> [v2:172.21.15.1:6808/3463851105,v1:172.21.15.1:6809/3463851105] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa40c0c5530 con 0x7fa3f007e700 2024-05-04T02:48:25.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.590+0000 7fa401ffb640 1 -- 172.21.15.1:0/536803333 <== osd.2 v2:172.21.15.1:6808/3463851105 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fa40c0c5530 con 0x7fa3f007e700 2024-05-04T02:48:25.592 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-05-04T02:48:25.592 INFO:teuthology.orchestra.run.smithi001.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-04T02:48:25.592 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-05-04T02:48:25.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.590+0000 7fa41369a640 1 -- 172.21.15.1:0/536803333 >> [v2:172.21.15.1:6808/3463851105,v1:172.21.15.1:6809/3463851105] conn(0x7fa3f007e700 msgr2=0x7fa3f0080bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:25.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.590+0000 7fa41369a640 1 --2- 172.21.15.1:0/536803333 >> [v2:172.21.15.1:6808/3463851105,v1:172.21.15.1:6809/3463851105] conn(0x7fa3f007e700 0x7fa3f0080bf0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:25.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.591+0000 7fa41369a640 1 -- 172.21.15.1:0/536803333 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fa3f00762d0 msgr2=0x7fa3f00787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:25.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.591+0000 7fa41369a640 1 --2- 172.21.15.1:0/536803333 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fa3f00762d0 0x7fa3f00787e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa408034000 tx=0x7fa40802e000 comp rx=0 tx=0).stop 2024-05-04T02:48:25.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.591+0000 7fa41369a640 1 -- 172.21.15.1:0/536803333 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa40c15c4a0 msgr2=0x7fa40c1e5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:25.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.591+0000 7fa41369a640 1 --2- 172.21.15.1:0/536803333 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fa40c15c4a0 0x7fa40c1e5db0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc00b410 tx=0x7fa3fc00b8d0 comp rx=0 tx=0).stop 2024-05-04T02:48:25.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.591+0000 7fa411c37640 1 -- 172.21.15.1:0/536803333 reap_dead start 2024-05-04T02:48:25.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.591+0000 7fa41369a640 1 -- 172.21.15.1:0/536803333 shutdown_connections 2024-05-04T02:48:25.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.591+0000 7fa41369a640 1 -- 172.21.15.1:0/536803333 >> 172.21.15.1:0/536803333 conn(0x7fa40c0ce960 msgr2=0x7fa40c08de60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:48:25.593 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.591+0000 7fa41369a640 1 -- 172.21.15.1:0/536803333 shutdown_connections 2024-05-04T02:48:25.594 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.591+0000 7fa41369a640 1 -- 172.21.15.1:0/536803333 wait complete. 2024-05-04T02:48:25.603 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-05-04T02:48:25.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.720+0000 7f86d8c69640 1 Processor -- start 2024-05-04T02:48:25.721 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.720+0000 7f86d8c69640 1 -- start start 2024-05-04T02:48:25.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.721+0000 7f86d8c69640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f86d40b5170 0x7f86d41546d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:25.722 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.721+0000 7f86d8c69640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f86d40cb4d0 0x7f86d40cb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:25.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.721+0000 7f86d8c69640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86d415d6e0 con 0x7f86d415ae30 2024-05-04T02:48:25.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.721+0000 7f86d8c69640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f86d40cbe20 con 0x7f86d40cb4d0 2024-05-04T02:48:25.723 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.721+0000 7f86d8c69640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f86d40ca190 con 0x7f86d40b5170 2024-05-04T02:48:25.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.733+0000 7f86d259c640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f86d40b5170 0x7f86d41546d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:25.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.734+0000 7f86d1d9b640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f86d415ae30 0x7f86d40702a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.1:37386/0 (socket says 172.21.15.1:37386) 2024-05-04T02:48:25.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.734+0000 7f86d1d9b640 1 -- 172.21.15.1:0/3229251442 learned_addr learned my addr 172.21.15.1:0/3229251442 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-05-04T02:48:25.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.737+0000 7f86d259c640 1 -- 172.21.15.1:0/3229251442 >> v2:172.21.15.1:3300/0 conn(0x7f86d40cb4d0 msgr2=0x7f86d40cb8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:48:25.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.737+0000 7f86d259c640 1 --2- 172.21.15.1:0/3229251442 >> v2:172.21.15.1:3300/0 conn(0x7f86d40cb4d0 0x7f86d40cb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:25.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.737+0000 7f86d259c640 1 -- 172.21.15.1:0/3229251442 >> v1:172.21.15.107:6789/0 conn(0x7f86d415ae30 legacy=0x7f86d40702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:25.738 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.737+0000 7f86d259c640 1 -- 172.21.15.1:0/3229251442 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86d40ca430 con 0x7f86d40b5170 2024-05-04T02:48:25.741 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.741+0000 7f86d259c640 1 --2- 172.21.15.1:0/3229251442 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86d40b5170 0x7f86d41546d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f86d408d320 tx=0x7f86c802a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b28c687f761237b1 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:25.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.747+0000 7f86d159a640 1 -- 172.21.15.1:0/3229251442 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c8037070 con 0x7f86d40b5170 2024-05-04T02:48:25.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.747+0000 7f86d159a640 1 -- 172.21.15.1:0/3229251442 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86c8032440 con 0x7f86d40b5170 2024-05-04T02:48:25.748 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.747+0000 7f86d159a640 1 -- 172.21.15.1:0/3229251442 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c8032810 con 0x7f86d40b5170 2024-05-04T02:48:25.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.748+0000 7f86d8c69640 1 -- 172.21.15.1:0/3229251442 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86d40b5170 msgr2=0x7f86d41546d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:25.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.748+0000 7f86d8c69640 1 --2- 172.21.15.1:0/3229251442 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86d40b5170 0x7f86d41546d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f86d408d320 tx=0x7f86c802a1a0 comp rx=0 tx=0).stop 2024-05-04T02:48:25.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.748+0000 7f86d8c69640 1 -- 172.21.15.1:0/3229251442 shutdown_connections 2024-05-04T02:48:25.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.748+0000 7f86d8c69640 1 --2- 172.21.15.1:0/3229251442 >> v2:172.21.15.1:3300/0 conn(0x7f86d40cb4d0 0x7f86d40cb8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:25.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.748+0000 7f86d8c69640 1 --2- 172.21.15.1:0/3229251442 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86d40b5170 0x7f86d41546d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:25.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.748+0000 7f86d8c69640 1 -- 172.21.15.1:0/3229251442 >> 172.21.15.1:0/3229251442 conn(0x7f86d40cf6e0 msgr2=0x7f86d40cfaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:48:25.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.748+0000 7f86d8c69640 1 -- 172.21.15.1:0/3229251442 shutdown_connections 2024-05-04T02:48:25.749 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.748+0000 7f86d8c69640 1 -- 172.21.15.1:0/3229251442 wait complete. 2024-05-04T02:48:25.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.750+0000 7f86d8c69640 1 Processor -- start 2024-05-04T02:48:25.751 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.750+0000 7f86d8c69640 1 -- start start 2024-05-04T02:48:25.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.751+0000 7f86d8c69640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f86d40b5170 0x7f86d4151790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:25.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.751+0000 7f86d8c69640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f86d40cb4d0 0x7f86d41e5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:25.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.751+0000 7f86d8c69640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86d415ae30 0x7f86d41e5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:25.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.751+0000 7f86d8c69640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f86d40cacd0 con 0x7f86d40cb4d0 2024-05-04T02:48:25.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.751+0000 7f86d8c69640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f86d40ca9f0 con 0x7f86d415ae30 2024-05-04T02:48:25.752 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.751+0000 7f86d8c69640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f86d40cafb0 con 0x7f86d40b5170 2024-05-04T02:48:25.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.752+0000 7f86d1d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f86d40cb4d0 0x7f86d41e5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:25.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.752+0000 7f86d2d9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86d415ae30 0x7f86d41e5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:25.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.752+0000 7f86d1d9b640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f86d40cb4d0 0x7f86d41e5690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37844/0 (socket says 172.21.15.1:37844) 2024-05-04T02:48:25.753 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.752+0000 7f86d1d9b640 1 -- 172.21.15.1:0/1509060691 learned_addr learned my addr 172.21.15.1:0/1509060691 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:48:25.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.756+0000 7f86d2d9d640 1 -- 172.21.15.1:0/1509060691 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f86d40b5170 msgr2=0x7f86d4151790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:25.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.756+0000 7f86d2d9d640 1 --2- 172.21.15.1:0/1509060691 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f86d40b5170 0x7f86d4151790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:25.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.756+0000 7f86d2d9d640 1 -- 172.21.15.1:0/1509060691 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f86d40cb4d0 msgr2=0x7f86d41e5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:25.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.756+0000 7f86d2d9d640 1 --2- 172.21.15.1:0/1509060691 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f86d40cb4d0 0x7f86d41e5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:25.757 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.756+0000 7f86d2d9d640 1 -- 172.21.15.1:0/1509060691 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86d4151cd0 con 0x7f86d415ae30 2024-05-04T02:48:25.759 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.758+0000 7f86d2d9d640 1 --2- 172.21.15.1:0/1509060691 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86d415ae30 0x7f86d41e5bd0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f86cc00bdf0 tx=0x7f86cc00bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:25.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.761+0000 7f86c2ffd640 1 -- 172.21.15.1:0/1509060691 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86cc019070 con 0x7f86d415ae30 2024-05-04T02:48:25.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.761+0000 7f86d8c69640 1 -- 172.21.15.1:0/1509060691 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86d414f660 con 0x7f86d415ae30 2024-05-04T02:48:25.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.761+0000 7f86d8c69640 1 -- 172.21.15.1:0/1509060691 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86d4157c90 con 0x7f86d415ae30 2024-05-04T02:48:25.762 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.762+0000 7f86d8c69640 1 -- 172.21.15.1:0/1509060691 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86d4151ea0 con 0x7f86d415ae30 2024-05-04T02:48:25.977 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:25.976+0000 7f86c2ffd640 1 -- 172.21.15.1:0/1509060691 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86cc01e440 con 0x7f86d415ae30 2024-05-04T02:48:26.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.041+0000 7f86c2ffd640 1 -- 172.21.15.1:0/1509060691 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86cc023060 con 0x7f86d415ae30 2024-05-04T02:48:26.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.047+0000 7f86c2ffd640 1 -- 172.21.15.1:0/1509060691 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f86cc01c070 con 0x7f86d415ae30 2024-05-04T02:48:26.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.047+0000 7f86c2ffd640 1 --2- 172.21.15.1:0/1509060691 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f86b4076300 0x7f86b4078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:26.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.047+0000 7f86c2ffd640 1 -- 172.21.15.1:0/1509060691 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5854+0+0 (secure 0 0 0) 0x7f86cc097910 con 0x7f86d415ae30 2024-05-04T02:48:26.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.047+0000 7f86d259c640 1 --2- 172.21.15.1:0/1509060691 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f86b4076300 0x7f86b4078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:26.048 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.048+0000 7f86d259c640 1 --2- 172.21.15.1:0/1509060691 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f86b4076300 0x7f86b4078810 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f86c8034000 tx=0x7f86c802c000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:26.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.058+0000 7f86c2ffd640 1 -- 172.21.15.1:0/1509060691 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f86cc060c20 con 0x7f86d415ae30 2024-05-04T02:48:26.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.253+0000 7f86d8c69640 1 -- 172.21.15.1:0/1509060691 --> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f86d414f940 con 0x7f86b4076300 2024-05-04T02:48:26.254 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.254+0000 7f86c2ffd640 1 -- 172.21.15.1:0/1509060691 <== mgr.4108 v2:172.21.15.107:6800/3809222574 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f86d414f940 con 0x7f86b4076300 2024-05-04T02:48:26.254 INFO:teuthology.orchestra.run.smithi001.stderr:instructed osd(s) 2 to deep-scrub 2024-05-04T02:48:26.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.256+0000 7f86d8c69640 1 -- 172.21.15.1:0/1509060691 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f86b4076300 msgr2=0x7f86b4078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:26.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.256+0000 7f86d8c69640 1 --2- 172.21.15.1:0/1509060691 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f86b4076300 0x7f86b4078810 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f86c8034000 tx=0x7f86c802c000 comp rx=0 tx=0).stop 2024-05-04T02:48:26.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.256+0000 7f86d8c69640 1 -- 172.21.15.1:0/1509060691 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86d415ae30 msgr2=0x7f86d41e5bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:26.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.256+0000 7f86d8c69640 1 --2- 172.21.15.1:0/1509060691 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86d415ae30 0x7f86d41e5bd0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f86cc00bdf0 tx=0x7f86cc00bee0 comp rx=0 tx=0).stop 2024-05-04T02:48:26.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.256+0000 7f86d8c69640 1 -- 172.21.15.1:0/1509060691 shutdown_connections 2024-05-04T02:48:26.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.256+0000 7f86d8c69640 1 --2- 172.21.15.1:0/1509060691 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f86b4076300 0x7f86b4078810 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:26.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.256+0000 7f86d8c69640 1 --2- 172.21.15.1:0/1509060691 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f86d415ae30 0x7f86d41e5bd0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:26.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.256+0000 7f86d8c69640 1 --2- 172.21.15.1:0/1509060691 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f86d40cb4d0 0x7f86d41e5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:26.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.256+0000 7f86d8c69640 1 --2- 172.21.15.1:0/1509060691 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f86d40b5170 0x7f86d4151790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:26.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.256+0000 7f86d8c69640 1 -- 172.21.15.1:0/1509060691 >> 172.21.15.1:0/1509060691 conn(0x7f86d40cf6e0 msgr2=0x7f86d4159c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:48:26.257 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.256+0000 7f86d8c69640 1 -- 172.21.15.1:0/1509060691 shutdown_connections 2024-05-04T02:48:26.258 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.256+0000 7f86d8c69640 1 -- 172.21.15.1:0/1509060691 wait complete. 2024-05-04T02:48:26.268 INFO:tasks.ceph:Scrubbing osd.3 2024-05-04T02:48:26.269 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-05-04T02:48:26.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.384+0000 7fd56f613640 1 Processor -- start 2024-05-04T02:48:26.385 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.384+0000 7fd56f613640 1 -- start start 2024-05-04T02:48:26.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.386+0000 7fd56f613640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fd56815cfc0 0x7fd568167df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:26.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.386+0000 7fd56f613640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5680cd3b0 con 0x7fd5680cdcf0 2024-05-04T02:48:26.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.386+0000 7fd56f613640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5680b74b0 con 0x7fd56815c4a0 2024-05-04T02:48:26.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.386+0000 7fd56f613640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fd56806d1a0 con 0x7fd56815cfc0 2024-05-04T02:48:26.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.386+0000 7fd56d3af640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fd5680cdcf0 0x7fd56806d9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:37670/0 (socket says 172.21.15.1:37670) 2024-05-04T02:48:26.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.386+0000 7fd56d3af640 1 -- 172.21.15.1:0/2060637129 learned_addr learned my addr 172.21.15.1:0/2060637129 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-05-04T02:48:26.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.386+0000 7fd56dbb0640 1 --2- 172.21.15.1:0/2060637129 >> v2:172.21.15.107:3300/0 conn(0x7fd56815cfc0 0x7fd568167df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:26.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.389+0000 7fd567fff640 1 -- 172.21.15.1:0/2060637129 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 443244712 0 0) 0x7fd5680cd3b0 con 0x7fd5680cdcf0 2024-05-04T02:48:26.390 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.389+0000 7fd567fff640 1 -- 172.21.15.1:0/2060637129 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd550003520 con 0x7fd5680cdcf0 2024-05-04T02:48:26.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.390+0000 7fd56dbb0640 1 -- 172.21.15.1:0/2060637129 >> v1:172.21.15.107:6789/0 conn(0x7fd56815c4a0 legacy=0x7fd56815c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:26.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.390+0000 7fd56dbb0640 1 -- 172.21.15.1:0/2060637129 >> v1:172.21.15.1:6789/0 conn(0x7fd5680cdcf0 legacy=0x7fd56806d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:26.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.390+0000 7fd56dbb0640 1 -- 172.21.15.1:0/2060637129 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd56806d480 con 0x7fd56815cfc0 2024-05-04T02:48:26.394 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.393+0000 7fd56dbb0640 1 --2- 172.21.15.1:0/2060637129 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd56815cfc0 0x7fd568167df0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd5580097a0 tx=0x7fd55802a2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35f8b432de1aea67 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:26.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.399+0000 7fd567fff640 1 -- 172.21.15.1:0/2060637129 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd558037070 con 0x7fd56815cfc0 2024-05-04T02:48:26.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.400+0000 7fd567fff640 1 -- 172.21.15.1:0/2060637129 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd558032640 con 0x7fd56815cfc0 2024-05-04T02:48:26.400 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.400+0000 7fd567fff640 1 -- 172.21.15.1:0/2060637129 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd558032a10 con 0x7fd56815cfc0 2024-05-04T02:48:26.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.400+0000 7fd56f613640 1 -- 172.21.15.1:0/2060637129 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd56815cfc0 msgr2=0x7fd568167df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:26.401 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.400+0000 7fd56f613640 1 --2- 172.21.15.1:0/2060637129 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd56815cfc0 0x7fd568167df0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd5580097a0 tx=0x7fd55802a2c0 comp rx=0 tx=0).stop 2024-05-04T02:48:26.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.400+0000 7fd56f613640 1 -- 172.21.15.1:0/2060637129 shutdown_connections 2024-05-04T02:48:26.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.400+0000 7fd56f613640 1 --2- 172.21.15.1:0/2060637129 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd56815cfc0 0x7fd568167df0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:26.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.400+0000 7fd56f613640 1 -- 172.21.15.1:0/2060637129 >> 172.21.15.1:0/2060637129 conn(0x7fd5680ce960 msgr2=0x7fd56808cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:48:26.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.400+0000 7fd56f613640 1 -- 172.21.15.1:0/2060637129 shutdown_connections 2024-05-04T02:48:26.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.401+0000 7fd56f613640 1 -- 172.21.15.1:0/2060637129 wait complete. 2024-05-04T02:48:26.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.402+0000 7fd56f613640 1 Processor -- start 2024-05-04T02:48:26.403 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.402+0000 7fd56f613640 1 -- start start 2024-05-04T02:48:26.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.403+0000 7fd56f613640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd5680cdcf0 0x7fd568153710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:26.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.404+0000 7fd56f613640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd56815c4a0 0x7fd568157080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:26.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.404+0000 7fd56f613640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd56815cfc0 0x7fd568157d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:26.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.404+0000 7fd56f613640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fd56815d950 con 0x7fd5680cdcf0 2024-05-04T02:48:26.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.404+0000 7fd56f613640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd5680cd7c0 con 0x7fd56815cfc0 2024-05-04T02:48:26.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.404+0000 7fd56f613640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fd5681e6080 con 0x7fd56815c4a0 2024-05-04T02:48:26.405 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.404+0000 7fd56d3af640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd5680cdcf0 0x7fd568153710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:26.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.404+0000 7fd56d3af640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd5680cdcf0 0x7fd568153710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37846/0 (socket says 172.21.15.1:37846) 2024-05-04T02:48:26.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.404+0000 7fd56d3af640 1 -- 172.21.15.1:0/443710372 learned_addr learned my addr 172.21.15.1:0/443710372 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:48:26.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.404+0000 7fd56cbae640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd56815c4a0 0x7fd568157080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:26.406 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.404+0000 7fd56dbb0640 1 --2- 172.21.15.1:0/443710372 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd56815cfc0 0x7fd568157d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:26.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.409+0000 7fd56dbb0640 1 -- 172.21.15.1:0/443710372 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd56815c4a0 msgr2=0x7fd568157080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:26.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.409+0000 7fd56dbb0640 1 --2- 172.21.15.1:0/443710372 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fd56815c4a0 0x7fd568157080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:26.409 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.409+0000 7fd56dbb0640 1 -- 172.21.15.1:0/443710372 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd5680cdcf0 msgr2=0x7fd568153710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:26.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.409+0000 7fd56dbb0640 1 --2- 172.21.15.1:0/443710372 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fd5680cdcf0 0x7fd568153710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:26.410 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.409+0000 7fd56dbb0640 1 -- 172.21.15.1:0/443710372 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd568153c50 con 0x7fd56815cfc0 2024-05-04T02:48:26.412 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.411+0000 7fd56dbb0640 1 --2- 172.21.15.1:0/443710372 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd56815cfc0 0x7fd568157d00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd5680cc230 tx=0x7fd5580046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:26.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.415+0000 7fd565ffb640 1 -- 172.21.15.1:0/443710372 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd558043070 con 0x7fd56815cfc0 2024-05-04T02:48:26.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.415+0000 7fd565ffb640 1 -- 172.21.15.1:0/443710372 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd558038040 con 0x7fd56815cfc0 2024-05-04T02:48:26.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.415+0000 7fd565ffb640 1 -- 172.21.15.1:0/443710372 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd558037050 con 0x7fd56815cfc0 2024-05-04T02:48:26.416 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.415+0000 7fd56f613640 1 -- 172.21.15.1:0/443710372 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5681f32d0 con 0x7fd56815cfc0 2024-05-04T02:48:26.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.416+0000 7fd56f613640 1 -- 172.21.15.1:0/443710372 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5681e5320 con 0x7fd56815cfc0 2024-05-04T02:48:26.417 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.416+0000 7fd56f613640 1 -- 172.21.15.1:0/443710372 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd568069c60 con 0x7fd56815cfc0 2024-05-04T02:48:26.446 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.446+0000 7fd565ffb640 1 -- 172.21.15.1:0/443710372 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd558046070 con 0x7fd56815cfc0 2024-05-04T02:48:26.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.446+0000 7fd565ffb640 1 --2- 172.21.15.1:0/443710372 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fd5540763a0 0x7fd5540788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:26.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.446+0000 7fd565ffb640 1 -- 172.21.15.1:0/443710372 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5854+0+0 (secure 0 0 0) 0x7fd5580b7a40 con 0x7fd56815cfc0 2024-05-04T02:48:26.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.446+0000 7fd565ffb640 1 --2- 172.21.15.1:0/443710372 >> [v2:172.21.15.1:6824/3859721636,v1:172.21.15.1:6825/3859721636] conn(0x7fd55407e850 0x7fd554080d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:26.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.446+0000 7fd565ffb640 1 -- 172.21.15.1:0/443710372 --> [v2:172.21.15.1:6824/3859721636,v1:172.21.15.1:6825/3859721636] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd558007e60 con 0x7fd55407e850 2024-05-04T02:48:26.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.446+0000 7fd565ffb640 1 -- 172.21.15.1:0/443710372 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd5580b7e30 con 0x7fd56815cfc0 2024-05-04T02:48:26.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.446+0000 7fd56d3af640 1 --2- 172.21.15.1:0/443710372 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fd5540763a0 0x7fd5540788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:26.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.447+0000 7fd56cbae640 1 --2- 172.21.15.1:0/443710372 >> [v2:172.21.15.1:6824/3859721636,v1:172.21.15.1:6825/3859721636] conn(0x7fd55407e850 0x7fd554080d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:26.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.447+0000 7fd56d3af640 1 --2- 172.21.15.1:0/443710372 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fd5540763a0 0x7fd5540788b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd560005c00 tx=0x7fd560009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:26.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.447+0000 7fd56cbae640 1 --2- 172.21.15.1:0/443710372 >> [v2:172.21.15.1:6824/3859721636,v1:172.21.15.1:6825/3859721636] conn(0x7fd55407e850 0x7fd554080d40 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:26.449 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.448+0000 7fd565ffb640 1 -- 172.21.15.1:0/443710372 <== osd.3 v2:172.21.15.1:6824/3859721636 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd558007e60 con 0x7fd55407e850 2024-05-04T02:48:26.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.461+0000 7fd56f613640 1 -- 172.21.15.1:0/443710372 --> [v2:172.21.15.1:6824/3859721636,v1:172.21.15.1:6825/3859721636] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd568159e60 con 0x7fd55407e850 2024-05-04T02:48:26.462 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.461+0000 7fd565ffb640 1 -- 172.21.15.1:0/443710372 <== osd.3 v2:172.21.15.1:6824/3859721636 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd568159e60 con 0x7fd55407e850 2024-05-04T02:48:26.462 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-05-04T02:48:26.463 INFO:teuthology.orchestra.run.smithi001.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-04T02:48:26.463 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-05-04T02:48:26.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.461+0000 7fd56f613640 1 -- 172.21.15.1:0/443710372 >> [v2:172.21.15.1:6824/3859721636,v1:172.21.15.1:6825/3859721636] conn(0x7fd55407e850 msgr2=0x7fd554080d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:26.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.461+0000 7fd56f613640 1 --2- 172.21.15.1:0/443710372 >> [v2:172.21.15.1:6824/3859721636,v1:172.21.15.1:6825/3859721636] conn(0x7fd55407e850 0x7fd554080d40 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:26.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.462+0000 7fd56f613640 1 -- 172.21.15.1:0/443710372 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fd5540763a0 msgr2=0x7fd5540788b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:26.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.462+0000 7fd56f613640 1 --2- 172.21.15.1:0/443710372 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fd5540763a0 0x7fd5540788b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd560005c00 tx=0x7fd560009040 comp rx=0 tx=0).stop 2024-05-04T02:48:26.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.462+0000 7fd56f613640 1 -- 172.21.15.1:0/443710372 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd56815cfc0 msgr2=0x7fd568157d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:26.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.462+0000 7fd56f613640 1 --2- 172.21.15.1:0/443710372 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd56815cfc0 0x7fd568157d00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd5680cc230 tx=0x7fd5580046c0 comp rx=0 tx=0).stop 2024-05-04T02:48:26.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.462+0000 7fd56dbb0640 1 -- 172.21.15.1:0/443710372 reap_dead start 2024-05-04T02:48:26.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.462+0000 7fd56f613640 1 -- 172.21.15.1:0/443710372 shutdown_connections 2024-05-04T02:48:26.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.462+0000 7fd56f613640 1 -- 172.21.15.1:0/443710372 >> 172.21.15.1:0/443710372 conn(0x7fd5680ce960 msgr2=0x7fd568155e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:48:26.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.462+0000 7fd56f613640 1 -- 172.21.15.1:0/443710372 shutdown_connections 2024-05-04T02:48:26.464 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.462+0000 7fd56f613640 1 -- 172.21.15.1:0/443710372 wait complete. 2024-05-04T02:48:26.473 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-05-04T02:48:26.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.585+0000 7f5ea40b6640 1 Processor -- start 2024-05-04T02:48:26.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.585+0000 7f5ea40b6640 1 -- start start 2024-05-04T02:48:26.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.586+0000 7f5ea40b6640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f5e9c0c7da0 0x7f5e9c15cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:26.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.587+0000 7f5ea40b6640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e9c0cd6c0 con 0x7f5e9c0cc590 2024-05-04T02:48:26.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.587+0000 7f5ea40b6640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e9c0cd980 con 0x7f5e9c0cde50 2024-05-04T02:48:26.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.587+0000 7f5ea40b6640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f5e9c0c7070 con 0x7f5e9c0c7da0 2024-05-04T02:48:26.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.587+0000 7f5ea2653640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f5e9c0cc590 0x7f5e9c166eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:37672/0 (socket says 172.21.15.1:37672) 2024-05-04T02:48:26.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.587+0000 7f5ea2653640 1 -- 172.21.15.1:0/1439515117 learned_addr learned my addr 172.21.15.1:0/1439515117 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-05-04T02:48:26.588 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.587+0000 7f5ea1651640 1 --2- 172.21.15.1:0/1439515117 >> v2:172.21.15.107:3300/0 conn(0x7f5e9c0c7da0 0x7f5e9c15cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:26.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.589+0000 7f5ea0e50640 1 -- 172.21.15.1:0/1439515117 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 483409372 0 0) 0x7f5e9c0cd6c0 con 0x7f5e9c0cc590 2024-05-04T02:48:26.590 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.589+0000 7f5ea0e50640 1 -- 172.21.15.1:0/1439515117 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e84003520 con 0x7f5e9c0cc590 2024-05-04T02:48:26.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.591+0000 7f5ea1651640 1 -- 172.21.15.1:0/1439515117 >> v1:172.21.15.107:6789/0 conn(0x7f5e9c0cde50 legacy=0x7f5e9c06c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:26.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.591+0000 7f5ea1651640 1 -- 172.21.15.1:0/1439515117 >> v1:172.21.15.1:6789/0 conn(0x7f5e9c0cc590 legacy=0x7f5e9c166eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:26.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.591+0000 7f5ea1651640 1 -- 172.21.15.1:0/1439515117 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e9c0c72c0 con 0x7f5e9c0c7da0 2024-05-04T02:48:26.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.596+0000 7f5ea1651640 1 --2- 172.21.15.1:0/1439515117 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5e9c0c7da0 0x7f5e9c15cfb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5e900097a0 tx=0x7f5e9002a2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b77ec37ae8af3bf7 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:26.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.600+0000 7f5ea0e50640 1 -- 172.21.15.1:0/1439515117 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e90037070 con 0x7f5e9c0c7da0 2024-05-04T02:48:26.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.600+0000 7f5ea0e50640 1 -- 172.21.15.1:0/1439515117 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e90032640 con 0x7f5e9c0c7da0 2024-05-04T02:48:26.601 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.600+0000 7f5ea0e50640 1 -- 172.21.15.1:0/1439515117 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e90032a10 con 0x7f5e9c0c7da0 2024-05-04T02:48:26.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.601+0000 7f5ea40b6640 1 -- 172.21.15.1:0/1439515117 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5e9c0c7da0 msgr2=0x7f5e9c15cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:26.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.601+0000 7f5ea40b6640 1 --2- 172.21.15.1:0/1439515117 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5e9c0c7da0 0x7f5e9c15cfb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5e900097a0 tx=0x7f5e9002a2c0 comp rx=0 tx=0).stop 2024-05-04T02:48:26.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.601+0000 7f5ea40b6640 1 -- 172.21.15.1:0/1439515117 shutdown_connections 2024-05-04T02:48:26.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.601+0000 7f5ea40b6640 1 --2- 172.21.15.1:0/1439515117 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5e9c0c7da0 0x7f5e9c15cfb0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:26.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.601+0000 7f5ea40b6640 1 -- 172.21.15.1:0/1439515117 >> 172.21.15.1:0/1439515117 conn(0x7f5e9c0d2590 msgr2=0x7f5e9c0ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:48:26.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.601+0000 7f5ea40b6640 1 -- 172.21.15.1:0/1439515117 shutdown_connections 2024-05-04T02:48:26.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.601+0000 7f5ea40b6640 1 -- 172.21.15.1:0/1439515117 wait complete. 2024-05-04T02:48:26.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.603+0000 7f5ea40b6640 1 Processor -- start 2024-05-04T02:48:26.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.603+0000 7f5ea40b6640 1 -- start start 2024-05-04T02:48:26.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.604+0000 7f5ea40b6640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5e9c0c7da0 0x7f5e9c15f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:26.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.604+0000 7f5ea40b6640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e9c0cc590 0x7f5e9c1f5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:26.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.604+0000 7f5ea40b6640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5e9c15df50 0x7f5e9c14a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:26.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.604+0000 7f5ea40b6640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f5e9c156b40 con 0x7f5e9c0cc590 2024-05-04T02:48:26.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.604+0000 7f5ea40b6640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f5e9c0c7880 con 0x7f5e9c15df50 2024-05-04T02:48:26.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.604+0000 7f5ea40b6640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f5e9c0cd310 con 0x7f5e9c0c7da0 2024-05-04T02:48:26.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.605+0000 7f5ea1651640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e9c0cc590 0x7f5e9c1f5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:26.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.605+0000 7f5ea2653640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5e9c15df50 0x7f5e9c14a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:26.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.605+0000 7f5ea1e52640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5e9c0c7da0 0x7f5e9c15f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:26.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.605+0000 7f5ea1651640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e9c0cc590 0x7f5e9c1f5e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37856/0 (socket says 172.21.15.1:37856) 2024-05-04T02:48:26.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.605+0000 7f5ea1651640 1 -- 172.21.15.1:0/444381902 learned_addr learned my addr 172.21.15.1:0/444381902 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:48:26.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.609+0000 7f5ea2653640 1 -- 172.21.15.1:0/444381902 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5e9c0c7da0 msgr2=0x7f5e9c15f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:26.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.609+0000 7f5ea2653640 1 --2- 172.21.15.1:0/444381902 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5e9c0c7da0 0x7f5e9c15f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:26.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.609+0000 7f5ea2653640 1 -- 172.21.15.1:0/444381902 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e9c0cc590 msgr2=0x7f5e9c1f5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:26.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.609+0000 7f5ea2653640 1 --2- 172.21.15.1:0/444381902 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e9c0cc590 0x7f5e9c1f5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:26.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.609+0000 7f5ea2653640 1 -- 172.21.15.1:0/444381902 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e9c1f6360 con 0x7f5e9c15df50 2024-05-04T02:48:26.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.612+0000 7f5ea2653640 1 --2- 172.21.15.1:0/444381902 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5e9c15df50 0x7f5e9c14a880 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c00caa0 tx=0x7f5e8c00cea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:26.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.616+0000 7f5e9a7fc640 1 -- 172.21.15.1:0/444381902 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e8c00ab40 con 0x7f5e9c15df50 2024-05-04T02:48:26.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.616+0000 7f5e9a7fc640 1 -- 172.21.15.1:0/444381902 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e8c00ace0 con 0x7f5e9c15df50 2024-05-04T02:48:26.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.616+0000 7f5ea40b6640 1 -- 172.21.15.1:0/444381902 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e9c158ae0 con 0x7f5e9c15df50 2024-05-04T02:48:26.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.616+0000 7f5e9a7fc640 1 -- 172.21.15.1:0/444381902 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e8c012620 con 0x7f5e9c15df50 2024-05-04T02:48:26.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.616+0000 7f5ea40b6640 1 -- 172.21.15.1:0/444381902 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e9c15da70 con 0x7f5e9c15df50 2024-05-04T02:48:26.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.617+0000 7f5ea40b6640 1 -- 172.21.15.1:0/444381902 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e9c0cec20 con 0x7f5e9c15df50 2024-05-04T02:48:26.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.640+0000 7f5e9a7fc640 1 -- 172.21.15.1:0/444381902 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5e8c0127c0 con 0x7f5e9c15df50 2024-05-04T02:48:26.641 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.641+0000 7f5e9a7fc640 1 --2- 172.21.15.1:0/444381902 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f5e88076320 0x7f5e88078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:26.642 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.641+0000 7f5ea1e52640 1 --2- 172.21.15.1:0/444381902 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f5e88076320 0x7f5e88078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:26.642 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.642+0000 7f5ea1e52640 1 --2- 172.21.15.1:0/444381902 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f5e88076320 0x7f5e88078830 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5e94000c00 tx=0x7f5e94009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:26.646 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.645+0000 7f5e9a7fc640 1 -- 172.21.15.1:0/444381902 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5854+0+0 (secure 0 0 0) 0x7f5e8c05db00 con 0x7f5e9c15df50 2024-05-04T02:48:26.920 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:26.919+0000 7f5e9a7fc640 1 -- 172.21.15.1:0/444381902 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5e9c0cec20 con 0x7f5e9c15df50 2024-05-04T02:48:27.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.142+0000 7f5ea40b6640 1 -- 172.21.15.1:0/444381902 --> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f5e9c069bc0 con 0x7f5e88076320 2024-05-04T02:48:27.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.142+0000 7f5e9a7fc640 1 -- 172.21.15.1:0/444381902 <== mgr.4108 v2:172.21.15.107:6800/3809222574 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f5e9c069bc0 con 0x7f5e88076320 2024-05-04T02:48:27.143 INFO:teuthology.orchestra.run.smithi001.stderr:instructed osd(s) 3 to deep-scrub 2024-05-04T02:48:27.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.144+0000 7f5ea40b6640 1 -- 172.21.15.1:0/444381902 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f5e88076320 msgr2=0x7f5e88078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:27.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.144+0000 7f5ea40b6640 1 --2- 172.21.15.1:0/444381902 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f5e88076320 0x7f5e88078830 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5e94000c00 tx=0x7f5e94009040 comp rx=0 tx=0).stop 2024-05-04T02:48:27.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.144+0000 7f5ea40b6640 1 -- 172.21.15.1:0/444381902 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5e9c15df50 msgr2=0x7f5e9c14a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:27.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.144+0000 7f5ea40b6640 1 --2- 172.21.15.1:0/444381902 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5e9c15df50 0x7f5e9c14a880 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c00caa0 tx=0x7f5e8c00cea0 comp rx=0 tx=0).stop 2024-05-04T02:48:27.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.144+0000 7f5ea40b6640 1 -- 172.21.15.1:0/444381902 shutdown_connections 2024-05-04T02:48:27.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.144+0000 7f5ea40b6640 1 --2- 172.21.15.1:0/444381902 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f5e88076320 0x7f5e88078830 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:27.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.144+0000 7f5ea40b6640 1 --2- 172.21.15.1:0/444381902 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f5e9c15df50 0x7f5e9c14a880 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:27.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.144+0000 7f5ea40b6640 1 --2- 172.21.15.1:0/444381902 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f5e9c0cc590 0x7f5e9c1f5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:27.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.144+0000 7f5ea40b6640 1 --2- 172.21.15.1:0/444381902 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f5e9c0c7da0 0x7f5e9c15f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:27.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.144+0000 7f5ea40b6640 1 -- 172.21.15.1:0/444381902 >> 172.21.15.1:0/444381902 conn(0x7f5e9c0d2590 msgr2=0x7f5e9c15ceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:48:27.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.144+0000 7f5ea40b6640 1 -- 172.21.15.1:0/444381902 shutdown_connections 2024-05-04T02:48:27.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.144+0000 7f5ea40b6640 1 -- 172.21.15.1:0/444381902 wait complete. 2024-05-04T02:48:27.157 INFO:tasks.ceph:Scrubbing osd.4 2024-05-04T02:48:27.157 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-05-04T02:48:27.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.273+0000 7f7d0f5f2640 1 Processor -- start 2024-05-04T02:48:27.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.273+0000 7f7d0f5f2640 1 -- start start 2024-05-04T02:48:27.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.275+0000 7f7d0f5f2640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f7d080ca7e0 0x7f7d080c3210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:27.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.275+0000 7f7d0f5f2640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d080cb910 con 0x7f7d0815fbc0 2024-05-04T02:48:27.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.275+0000 7f7d0f5f2640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d0808d6f0 con 0x7f7d080cb500 2024-05-04T02:48:27.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.275+0000 7f7d0f5f2640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f7d080c7a80 con 0x7f7d080ca7e0 2024-05-04T02:48:27.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.275+0000 7f7d0d38e640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f7d080cb500 0x7f7d080ca0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.1:37412/0 (socket says 172.21.15.1:37412) 2024-05-04T02:48:27.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.275+0000 7f7d0d38e640 1 -- 172.21.15.1:0/3609035545 learned_addr learned my addr 172.21.15.1:0/3609035545 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-05-04T02:48:27.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.276+0000 7f7d0cb8d640 1 --2- 172.21.15.1:0/3609035545 >> v2:172.21.15.1:3300/0 conn(0x7f7d080ca7e0 0x7f7d080c3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:27.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.278+0000 7f7d07fff640 1 -- 172.21.15.1:0/3609035545 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2635127036 0 0) 0x7f7d0808d6f0 con 0x7f7d080cb500 2024-05-04T02:48:27.279 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.278+0000 7f7d07fff640 1 -- 172.21.15.1:0/3609035545 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7cf0003520 con 0x7f7d080cb500 2024-05-04T02:48:27.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.279+0000 7f7d07fff640 1 -- 172.21.15.1:0/3609035545 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4027912781 0 0) 0x7f7d080cb910 con 0x7f7d0815fbc0 2024-05-04T02:48:27.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.279+0000 7f7d07fff640 1 -- 172.21.15.1:0/3609035545 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d0808d6f0 con 0x7f7d0815fbc0 2024-05-04T02:48:27.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.281+0000 7f7d0cb8d640 1 -- 172.21.15.1:0/3609035545 >> v1:172.21.15.107:6789/0 conn(0x7f7d080cb500 legacy=0x7f7d080ca0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:27.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.281+0000 7f7d0cb8d640 1 -- 172.21.15.1:0/3609035545 >> v1:172.21.15.1:6789/0 conn(0x7f7d0815fbc0 legacy=0x7f7d0815ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:27.282 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.281+0000 7f7d0cb8d640 1 -- 172.21.15.1:0/3609035545 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d080c4e60 con 0x7f7d080ca7e0 2024-05-04T02:48:27.285 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.284+0000 7f7d0cb8d640 1 --2- 172.21.15.1:0/3609035545 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d080ca7e0 0x7f7d080c3210 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc0097a0 tx=0x7f7cfc02a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b81024ecf792bd80 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:27.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.290+0000 7f7d07fff640 1 -- 172.21.15.1:0/3609035545 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc037070 con 0x7f7d080ca7e0 2024-05-04T02:48:27.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.290+0000 7f7d07fff640 1 -- 172.21.15.1:0/3609035545 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cfc032640 con 0x7f7d080ca7e0 2024-05-04T02:48:27.291 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.290+0000 7f7d07fff640 1 -- 172.21.15.1:0/3609035545 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc032a10 con 0x7f7d080ca7e0 2024-05-04T02:48:27.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.290+0000 7f7d0f5f2640 1 -- 172.21.15.1:0/3609035545 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d080ca7e0 msgr2=0x7f7d080c3210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:27.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.290+0000 7f7d0f5f2640 1 --2- 172.21.15.1:0/3609035545 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d080ca7e0 0x7f7d080c3210 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc0097a0 tx=0x7f7cfc02a2c0 comp rx=0 tx=0).stop 2024-05-04T02:48:27.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.290+0000 7f7d0f5f2640 1 -- 172.21.15.1:0/3609035545 shutdown_connections 2024-05-04T02:48:27.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.291+0000 7f7d0f5f2640 1 --2- 172.21.15.1:0/3609035545 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d080ca7e0 0x7f7d080c3210 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:27.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.291+0000 7f7d0f5f2640 1 -- 172.21.15.1:0/3609035545 >> 172.21.15.1:0/3609035545 conn(0x7f7d080cf6c0 msgr2=0x7f7d080cfad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:48:27.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.291+0000 7f7d0f5f2640 1 -- 172.21.15.1:0/3609035545 shutdown_connections 2024-05-04T02:48:27.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.291+0000 7f7d0f5f2640 1 -- 172.21.15.1:0/3609035545 wait complete. 2024-05-04T02:48:27.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.293+0000 7f7d0f5f2640 1 Processor -- start 2024-05-04T02:48:27.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.293+0000 7f7d0f5f2640 1 -- start start 2024-05-04T02:48:27.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.294+0000 7f7d0f5f2640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d080ca7e0 0x7f7d08157230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:27.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.294+0000 7f7d0f5f2640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d080cb500 0x7f7d0815bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:27.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.294+0000 7f7d0f5f2640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7d0815fbc0 0x7f7d081e8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:27.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.294+0000 7f7d0f5f2640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f7d080c5700 con 0x7f7d080ca7e0 2024-05-04T02:48:27.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.294+0000 7f7d0f5f2640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f7d080c5420 con 0x7f7d080cb500 2024-05-04T02:48:27.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.294+0000 7f7d0f5f2640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f7d080c59e0 con 0x7f7d0815fbc0 2024-05-04T02:48:27.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.294+0000 7f7d0d38e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d080ca7e0 0x7f7d08157230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:27.296 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.295+0000 7f7d0cb8d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d080cb500 0x7f7d0815bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:27.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.295+0000 7f7d0db8f640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7d0815fbc0 0x7f7d081e8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:27.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.295+0000 7f7d0d38e640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d080ca7e0 0x7f7d08157230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37884/0 (socket says 172.21.15.1:37884) 2024-05-04T02:48:27.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.295+0000 7f7d0d38e640 1 -- 172.21.15.1:0/649832579 learned_addr learned my addr 172.21.15.1:0/649832579 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:48:27.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.299+0000 7f7d0cb8d640 1 -- 172.21.15.1:0/649832579 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7d0815fbc0 msgr2=0x7f7d081e8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:27.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.299+0000 7f7d0cb8d640 1 --2- 172.21.15.1:0/649832579 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f7d0815fbc0 0x7f7d081e8d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:27.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.299+0000 7f7d0cb8d640 1 -- 172.21.15.1:0/649832579 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d080ca7e0 msgr2=0x7f7d08157230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:27.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.299+0000 7f7d0cb8d640 1 --2- 172.21.15.1:0/649832579 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f7d080ca7e0 0x7f7d08157230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:27.300 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.299+0000 7f7d0cb8d640 1 -- 172.21.15.1:0/649832579 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d0815c3e0 con 0x7f7d080cb500 2024-05-04T02:48:27.302 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.301+0000 7f7d0cb8d640 1 --2- 172.21.15.1:0/649832579 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d080cb500 0x7f7d0815bea0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc031000 tx=0x7f7cfc0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:27.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.305+0000 7f7d05ffb640 1 -- 172.21.15.1:0/649832579 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc040020 con 0x7f7d080cb500 2024-05-04T02:48:27.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.305+0000 7f7d05ffb640 1 -- 172.21.15.1:0/649832579 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cfc038040 con 0x7f7d080cb500 2024-05-04T02:48:27.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.305+0000 7f7d0f5f2640 1 -- 172.21.15.1:0/649832579 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d0815b700 con 0x7f7d080cb500 2024-05-04T02:48:27.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.305+0000 7f7d05ffb640 1 -- 172.21.15.1:0/649832579 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc037070 con 0x7f7d080cb500 2024-05-04T02:48:27.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.306+0000 7f7d0f5f2640 1 -- 172.21.15.1:0/649832579 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d08158440 con 0x7f7d080cb500 2024-05-04T02:48:27.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.306+0000 7f7d0f5f2640 1 -- 172.21.15.1:0/649832579 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7d08069c60 con 0x7f7d080cb500 2024-05-04T02:48:27.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.331+0000 7f7d05ffb640 1 -- 172.21.15.1:0/649832579 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7cfc043020 con 0x7f7d080cb500 2024-05-04T02:48:27.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.331+0000 7f7d05ffb640 1 --2- 172.21.15.1:0/649832579 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f7cf4076320 0x7f7cf4078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:27.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.331+0000 7f7d0d38e640 1 --2- 172.21.15.1:0/649832579 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f7cf4076320 0x7f7cf4078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:27.333 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.332+0000 7f7d0d38e640 1 --2- 172.21.15.1:0/649832579 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f7cf4076320 0x7f7cf4078830 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7d00005880 tx=0x7f7d00009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:27.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.335+0000 7f7d05ffb640 1 -- 172.21.15.1:0/649832579 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5854+0+0 (secure 0 0 0) 0x7f7cfc030d60 con 0x7f7d080cb500 2024-05-04T02:48:27.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.335+0000 7f7d05ffb640 1 --2- 172.21.15.1:0/649832579 >> [v2:172.21.15.107:6802/2335597098,v1:172.21.15.107:6803/2335597098] conn(0x7f7cf407e6f0 0x7f7cf4080be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:27.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.335+0000 7f7d05ffb640 1 -- 172.21.15.1:0/649832579 --> [v2:172.21.15.107:6802/2335597098,v1:172.21.15.107:6803/2335597098] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7cf40812b0 con 0x7f7cf407e6f0 2024-05-04T02:48:27.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.335+0000 7f7d05ffb640 1 -- 172.21.15.1:0/649832579 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7cfc07d660 con 0x7f7d080cb500 2024-05-04T02:48:27.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.335+0000 7f7d0db8f640 1 --2- 172.21.15.1:0/649832579 >> [v2:172.21.15.107:6802/2335597098,v1:172.21.15.107:6803/2335597098] conn(0x7f7cf407e6f0 0x7f7cf4080be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:27.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.336+0000 7f7d0db8f640 1 --2- 172.21.15.1:0/649832579 >> [v2:172.21.15.107:6802/2335597098,v1:172.21.15.107:6803/2335597098] conn(0x7f7cf407e6f0 0x7f7cf4080be0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:27.338 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.336+0000 7f7d05ffb640 1 -- 172.21.15.1:0/649832579 <== osd.4 v2:172.21.15.107:6802/2335597098 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7cf40812b0 con 0x7f7cf407e6f0 2024-05-04T02:48:27.357 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.356+0000 7f7d0f5f2640 1 -- 172.21.15.1:0/649832579 --> [v2:172.21.15.107:6802/2335597098,v1:172.21.15.107:6803/2335597098] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f7d0815b4b0 con 0x7f7cf407e6f0 2024-05-04T02:48:27.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.357+0000 7f7d05ffb640 1 -- 172.21.15.1:0/649832579 <== osd.4 v2:172.21.15.107:6802/2335597098 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f7d0815b4b0 con 0x7f7cf407e6f0 2024-05-04T02:48:27.358 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-05-04T02:48:27.358 INFO:teuthology.orchestra.run.smithi001.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-04T02:48:27.358 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-05-04T02:48:27.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.357+0000 7f7d0f5f2640 1 -- 172.21.15.1:0/649832579 >> [v2:172.21.15.107:6802/2335597098,v1:172.21.15.107:6803/2335597098] conn(0x7f7cf407e6f0 msgr2=0x7f7cf4080be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:27.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.357+0000 7f7d0f5f2640 1 --2- 172.21.15.1:0/649832579 >> [v2:172.21.15.107:6802/2335597098,v1:172.21.15.107:6803/2335597098] conn(0x7f7cf407e6f0 0x7f7cf4080be0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:27.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.357+0000 7f7d0f5f2640 1 -- 172.21.15.1:0/649832579 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f7cf4076320 msgr2=0x7f7cf4078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:27.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.357+0000 7f7d0f5f2640 1 --2- 172.21.15.1:0/649832579 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f7cf4076320 0x7f7cf4078830 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7d00005880 tx=0x7f7d00009040 comp rx=0 tx=0).stop 2024-05-04T02:48:27.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.358+0000 7f7d0f5f2640 1 -- 172.21.15.1:0/649832579 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d080cb500 msgr2=0x7f7d0815bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:27.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.358+0000 7f7d0f5f2640 1 --2- 172.21.15.1:0/649832579 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7d080cb500 0x7f7d0815bea0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc031000 tx=0x7f7cfc0046c0 comp rx=0 tx=0).stop 2024-05-04T02:48:27.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.358+0000 7f7d0db8f640 1 -- 172.21.15.1:0/649832579 reap_dead start 2024-05-04T02:48:27.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.358+0000 7f7d0f5f2640 1 -- 172.21.15.1:0/649832579 shutdown_connections 2024-05-04T02:48:27.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.358+0000 7f7d0f5f2640 1 -- 172.21.15.1:0/649832579 >> 172.21.15.1:0/649832579 conn(0x7f7d080cf6c0 msgr2=0x7f7d080ce590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:48:27.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.358+0000 7f7d0f5f2640 1 -- 172.21.15.1:0/649832579 shutdown_connections 2024-05-04T02:48:27.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.358+0000 7f7d0f5f2640 1 -- 172.21.15.1:0/649832579 wait complete. 2024-05-04T02:48:27.370 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-05-04T02:48:27.482 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.481+0000 7f019339f640 1 Processor -- start 2024-05-04T02:48:27.483 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.481+0000 7f019339f640 1 -- start start 2024-05-04T02:48:27.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.483+0000 7f019339f640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f018c1566b0 0x7f018c1600a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:27.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.483+0000 7f019339f640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f018c0cd070 con 0x7f018c0cdd50 2024-05-04T02:48:27.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.483+0000 7f019339f640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f018c0c6930 con 0x7f018c0b45b0 2024-05-04T02:48:27.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.483+0000 7f019339f640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f018c0c7090 con 0x7f018c1566b0 2024-05-04T02:48:27.484 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.483+0000 7f019239d640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f018c0cdd50 0x7f018c06d750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:37690/0 (socket says 172.21.15.1:37690) 2024-05-04T02:48:27.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.483+0000 7f019239d640 1 -- 172.21.15.1:0/1051825220 learned_addr learned my addr 172.21.15.1:0/1051825220 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-05-04T02:48:27.485 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.484+0000 7f0192b9e640 1 --2- 172.21.15.1:0/1051825220 >> v2:172.21.15.107:3300/0 conn(0x7f018c1566b0 0x7f018c1600a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:27.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.486+0000 7f019139b640 1 -- 172.21.15.1:0/1051825220 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1880858284 0 0) 0x7f018c0cd070 con 0x7f018c0cdd50 2024-05-04T02:48:27.487 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.486+0000 7f019139b640 1 -- 172.21.15.1:0/1051825220 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0174003520 con 0x7f018c0cdd50 2024-05-04T02:48:27.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.487+0000 7f0192b9e640 1 -- 172.21.15.1:0/1051825220 >> v1:172.21.15.107:6789/0 conn(0x7f018c0b45b0 legacy=0x7f018c15f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:27.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.487+0000 7f0192b9e640 1 -- 172.21.15.1:0/1051825220 >> v1:172.21.15.1:6789/0 conn(0x7f018c0cdd50 legacy=0x7f018c06d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:27.488 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.487+0000 7f0192b9e640 1 -- 172.21.15.1:0/1051825220 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f018c156ac0 con 0x7f018c1566b0 2024-05-04T02:48:27.491 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.491+0000 7f0192b9e640 1 --2- 172.21.15.1:0/1051825220 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f018c1566b0 0x7f018c1600a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f017c009d90 tx=0x7f017c02a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83fe8fb7eb22c47a server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:27.495 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.495+0000 7f019139b640 1 -- 172.21.15.1:0/1051825220 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f017c007740 con 0x7f018c1566b0 2024-05-04T02:48:27.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.495+0000 7f019139b640 1 -- 172.21.15.1:0/1051825220 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f017c0078e0 con 0x7f018c1566b0 2024-05-04T02:48:27.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.495+0000 7f019139b640 1 -- 172.21.15.1:0/1051825220 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f017c007cb0 con 0x7f018c1566b0 2024-05-04T02:48:27.496 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.495+0000 7f019339f640 1 -- 172.21.15.1:0/1051825220 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f018c1566b0 msgr2=0x7f018c1600a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:27.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.495+0000 7f019339f640 1 --2- 172.21.15.1:0/1051825220 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f018c1566b0 0x7f018c1600a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f017c009d90 tx=0x7f017c02a6f0 comp rx=0 tx=0).stop 2024-05-04T02:48:27.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.496+0000 7f019339f640 1 -- 172.21.15.1:0/1051825220 shutdown_connections 2024-05-04T02:48:27.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.496+0000 7f019339f640 1 --2- 172.21.15.1:0/1051825220 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f018c1566b0 0x7f018c1600a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:27.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.496+0000 7f019339f640 1 -- 172.21.15.1:0/1051825220 >> 172.21.15.1:0/1051825220 conn(0x7f018c0d1830 msgr2=0x7f018c0d1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:48:27.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.496+0000 7f019339f640 1 -- 172.21.15.1:0/1051825220 shutdown_connections 2024-05-04T02:48:27.497 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.496+0000 7f019339f640 1 -- 172.21.15.1:0/1051825220 wait complete. 2024-05-04T02:48:27.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.497+0000 7f019339f640 1 Processor -- start 2024-05-04T02:48:27.498 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.497+0000 7f019339f640 1 -- start start 2024-05-04T02:48:27.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.499+0000 7f019339f640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f018c0b45b0 0x7f018c1e3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:27.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.499+0000 7f019339f640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f018c0cdd50 0x7f018c0ca6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:27.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.499+0000 7f019339f640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f018c1566b0 0x7f018c1e5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:27.500 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.499+0000 7f019339f640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f018c06d2c0 con 0x7f018c0cdd50 2024-05-04T02:48:27.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.499+0000 7f019339f640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f018c0cd5c0 con 0x7f018c0b45b0 2024-05-04T02:48:27.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.499+0000 7f019339f640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f018c0c6bd0 con 0x7f018c1566b0 2024-05-04T02:48:27.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.499+0000 7f0191b9c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f018c0cdd50 0x7f018c0ca6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:27.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.499+0000 7f019239d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f018c0b45b0 0x7f018c1e3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:27.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.499+0000 7f0192b9e640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f018c1566b0 0x7f018c1e5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:27.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.500+0000 7f0191b9c640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f018c0cdd50 0x7f018c0ca6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37888/0 (socket says 172.21.15.1:37888) 2024-05-04T02:48:27.501 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.500+0000 7f0191b9c640 1 -- 172.21.15.1:0/3736086964 learned_addr learned my addr 172.21.15.1:0/3736086964 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:48:27.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.504+0000 7f019239d640 1 -- 172.21.15.1:0/3736086964 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f018c1566b0 msgr2=0x7f018c1e5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:27.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.504+0000 7f019239d640 1 --2- 172.21.15.1:0/3736086964 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f018c1566b0 0x7f018c1e5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:27.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.504+0000 7f019239d640 1 -- 172.21.15.1:0/3736086964 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f018c0cdd50 msgr2=0x7f018c0ca6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:27.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.504+0000 7f019239d640 1 --2- 172.21.15.1:0/3736086964 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f018c0cdd50 0x7f018c0ca6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:27.505 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.504+0000 7f019239d640 1 -- 172.21.15.1:0/3736086964 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f018c1f2f20 con 0x7f018c0b45b0 2024-05-04T02:48:27.507 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.507+0000 7f019239d640 1 --2- 172.21.15.1:0/3736086964 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f018c0b45b0 0x7f018c1e3c30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f018400c3c0 tx=0x7f018400c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:27.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.511+0000 7f018affd640 1 -- 172.21.15.1:0/3736086964 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0184017070 con 0x7f018c0b45b0 2024-05-04T02:48:27.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.511+0000 7f018affd640 1 -- 172.21.15.1:0/3736086964 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0184005ce0 con 0x7f018c0b45b0 2024-05-04T02:48:27.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.511+0000 7f019339f640 1 -- 172.21.15.1:0/3736086964 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f018c1e26d0 con 0x7f018c0b45b0 2024-05-04T02:48:27.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.511+0000 7f018affd640 1 -- 172.21.15.1:0/3736086964 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01840072f0 con 0x7f018c0b45b0 2024-05-04T02:48:27.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.511+0000 7f019339f640 1 -- 172.21.15.1:0/3736086964 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f018c1e2c90 con 0x7f018c0b45b0 2024-05-04T02:48:27.512 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.512+0000 7f019339f640 1 -- 172.21.15.1:0/3736086964 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f018c0d1ff0 con 0x7f018c0b45b0 2024-05-04T02:48:27.535 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.535+0000 7f018affd640 1 -- 172.21.15.1:0/3736086964 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f018401a070 con 0x7f018c0b45b0 2024-05-04T02:48:27.536 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.535+0000 7f018affd640 1 --2- 172.21.15.1:0/3736086964 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f0178076300 0x7f0178078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:27.536 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.536+0000 7f0191b9c640 1 --2- 172.21.15.1:0/3736086964 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f0178076300 0x7f0178078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:27.537 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.536+0000 7f0191b9c640 1 --2- 172.21.15.1:0/3736086964 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f0178076300 0x7f0178078810 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f018c0cbbe0 tx=0x7f0180009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:27.539 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.539+0000 7f018affd640 1 -- 172.21.15.1:0/3736086964 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5854+0+0 (secure 0 0 0) 0x7f018405c210 con 0x7f018c0b45b0 2024-05-04T02:48:27.809 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:27.808+0000 7f018affd640 1 -- 172.21.15.1:0/3736086964 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0184021020 con 0x7f018c0b45b0 2024-05-04T02:48:28.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.003+0000 7f019339f640 1 -- 172.21.15.1:0/3736086964 --> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f018c1f2cd0 con 0x7f0178076300 2024-05-04T02:48:28.006 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.004+0000 7f018affd640 1 -- 172.21.15.1:0/3736086964 <== mgr.4108 v2:172.21.15.107:6800/3809222574 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f018c1f2cd0 con 0x7f0178076300 2024-05-04T02:48:28.006 INFO:teuthology.orchestra.run.smithi001.stderr:instructed osd(s) 4 to deep-scrub 2024-05-04T02:48:28.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.007+0000 7f019339f640 1 -- 172.21.15.1:0/3736086964 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f0178076300 msgr2=0x7f0178078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:28.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.007+0000 7f019339f640 1 --2- 172.21.15.1:0/3736086964 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f0178076300 0x7f0178078810 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f018c0cbbe0 tx=0x7f0180009040 comp rx=0 tx=0).stop 2024-05-04T02:48:28.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.007+0000 7f019339f640 1 -- 172.21.15.1:0/3736086964 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f018c0b45b0 msgr2=0x7f018c1e3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:28.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.007+0000 7f019339f640 1 --2- 172.21.15.1:0/3736086964 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f018c0b45b0 0x7f018c1e3c30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f018400c3c0 tx=0x7f018400c880 comp rx=0 tx=0).stop 2024-05-04T02:48:28.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.007+0000 7f019339f640 1 -- 172.21.15.1:0/3736086964 shutdown_connections 2024-05-04T02:48:28.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.007+0000 7f019339f640 1 --2- 172.21.15.1:0/3736086964 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f0178076300 0x7f0178078810 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:28.008 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.007+0000 7f019339f640 1 --2- 172.21.15.1:0/3736086964 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f018c1566b0 0x7f018c1e5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:28.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.007+0000 7f019339f640 1 --2- 172.21.15.1:0/3736086964 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f018c0cdd50 0x7f018c0ca6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:28.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.007+0000 7f019339f640 1 --2- 172.21.15.1:0/3736086964 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f018c0b45b0 0x7f018c1e3c30 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:28.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.007+0000 7f019339f640 1 -- 172.21.15.1:0/3736086964 >> 172.21.15.1:0/3736086964 conn(0x7f018c0d1830 msgr2=0x7f018c1e89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:48:28.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.007+0000 7f019339f640 1 -- 172.21.15.1:0/3736086964 shutdown_connections 2024-05-04T02:48:28.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.007+0000 7f019339f640 1 -- 172.21.15.1:0/3736086964 wait complete. 2024-05-04T02:48:28.021 INFO:tasks.ceph:Scrubbing osd.5 2024-05-04T02:48:28.022 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-05-04T02:48:28.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.138+0000 7f21feba5640 1 Processor -- start 2024-05-04T02:48:28.139 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.138+0000 7f21feba5640 1 -- start start 2024-05-04T02:48:28.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.139+0000 7f21feba5640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f21f806f0a0 0x7f21f81542b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:28.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.139+0000 7f21feba5640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f21f815e1f0 0x7f21f8070870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:28.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.139+0000 7f21feba5640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21f815a240 con 0x7f21f815afa0 2024-05-04T02:48:28.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.139+0000 7f21feba5640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f21f806f5e0 con 0x7f21f815e1f0 2024-05-04T02:48:28.140 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.139+0000 7f21feba5640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f21f806f880 con 0x7f21f806f0a0 2024-05-04T02:48:28.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.173+0000 7f21fc941640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f21f815afa0 0x7f21f80cc9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:37694/0 (socket says 172.21.15.1:37694) 2024-05-04T02:48:28.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.173+0000 7f21fc941640 1 -- 172.21.15.1:0/338755647 learned_addr learned my addr 172.21.15.1:0/338755647 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-05-04T02:48:28.174 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.173+0000 7f21fd142640 1 --2- 172.21.15.1:0/338755647 >> v2:172.21.15.1:3300/0 conn(0x7f21f815e1f0 0x7f21f8070870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:28.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.178+0000 7f21fd142640 1 -- 172.21.15.1:0/338755647 >> v2:172.21.15.107:3300/0 conn(0x7f21f806f0a0 msgr2=0x7f21f81542b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:48:28.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.178+0000 7f21fd142640 1 --2- 172.21.15.1:0/338755647 >> v2:172.21.15.107:3300/0 conn(0x7f21f806f0a0 0x7f21f81542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:28.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.178+0000 7f21fd142640 1 -- 172.21.15.1:0/338755647 >> v1:172.21.15.1:6789/0 conn(0x7f21f815afa0 legacy=0x7f21f80cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:28.180 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.178+0000 7f21fd142640 1 -- 172.21.15.1:0/338755647 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21f815a4c0 con 0x7f21f815e1f0 2024-05-04T02:48:28.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.182+0000 7f21fd142640 1 --2- 172.21.15.1:0/338755647 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f21f815e1f0 0x7f21f8070870 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f21f80ceeb0 tx=0x7f21f002a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fdad75191735129 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:28.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.186+0000 7f21f77fe640 1 -- 172.21.15.1:0/338755647 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f0007740 con 0x7f21f815e1f0 2024-05-04T02:48:28.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.186+0000 7f21f77fe640 1 -- 172.21.15.1:0/338755647 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21f00078e0 con 0x7f21f815e1f0 2024-05-04T02:48:28.187 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.186+0000 7f21f77fe640 1 -- 172.21.15.1:0/338755647 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f0007cb0 con 0x7f21f815e1f0 2024-05-04T02:48:28.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.187+0000 7f21feba5640 1 -- 172.21.15.1:0/338755647 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f21f815e1f0 msgr2=0x7f21f8070870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:28.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.187+0000 7f21feba5640 1 --2- 172.21.15.1:0/338755647 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f21f815e1f0 0x7f21f8070870 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f21f80ceeb0 tx=0x7f21f002a5f0 comp rx=0 tx=0).stop 2024-05-04T02:48:28.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.187+0000 7f21feba5640 1 -- 172.21.15.1:0/338755647 shutdown_connections 2024-05-04T02:48:28.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.187+0000 7f21feba5640 1 --2- 172.21.15.1:0/338755647 >> v2:172.21.15.107:3300/0 conn(0x7f21f806f0a0 0x7f21f81542b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:28.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.187+0000 7f21feba5640 1 --2- 172.21.15.1:0/338755647 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f21f815e1f0 0x7f21f8070870 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:28.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.187+0000 7f21feba5640 1 -- 172.21.15.1:0/338755647 >> 172.21.15.1:0/338755647 conn(0x7f21f80cb8e0 msgr2=0x7f21f80ce5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:48:28.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.187+0000 7f21feba5640 1 -- 172.21.15.1:0/338755647 shutdown_connections 2024-05-04T02:48:28.188 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.187+0000 7f21feba5640 1 -- 172.21.15.1:0/338755647 wait complete. 2024-05-04T02:48:28.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.188+0000 7f21feba5640 1 Processor -- start 2024-05-04T02:48:28.189 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.189+0000 7f21feba5640 1 -- start start 2024-05-04T02:48:28.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.190+0000 7f21feba5640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f21f806f0a0 0x7f21f81f0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:28.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.190+0000 7f21feba5640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f21f815afa0 0x7f21f815c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:28.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.190+0000 7f21feba5640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f21f815e1f0 0x7f21f80b2da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:28.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.190+0000 7f21feba5640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f21f815e600 con 0x7f21f806f0a0 2024-05-04T02:48:28.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.190+0000 7f21feba5640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f21f815aa80 con 0x7f21f815e1f0 2024-05-04T02:48:28.191 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.190+0000 7f21feba5640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f21f80cc3b0 con 0x7f21f815afa0 2024-05-04T02:48:28.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.191+0000 7f21fc941640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f21f806f0a0 0x7f21f81f0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:28.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.191+0000 7f21fd142640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f21f815e1f0 0x7f21f80b2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:28.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.191+0000 7f21fc941640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f21f806f0a0 0x7f21f81f0890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37904/0 (socket says 172.21.15.1:37904) 2024-05-04T02:48:28.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.191+0000 7f21fc941640 1 -- 172.21.15.1:0/517046896 learned_addr learned my addr 172.21.15.1:0/517046896 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:48:28.192 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.192+0000 7f21f7fff640 1 --2- 172.21.15.1:0/517046896 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f21f815afa0 0x7f21f815c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:28.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.195+0000 7f21fd142640 1 -- 172.21.15.1:0/517046896 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f21f815afa0 msgr2=0x7f21f815c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:28.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.195+0000 7f21fd142640 1 --2- 172.21.15.1:0/517046896 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f21f815afa0 0x7f21f815c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:28.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.195+0000 7f21fd142640 1 -- 172.21.15.1:0/517046896 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f21f806f0a0 msgr2=0x7f21f81f0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:28.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.195+0000 7f21fd142640 1 --2- 172.21.15.1:0/517046896 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f21f806f0a0 0x7f21f81f0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:28.196 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.195+0000 7f21fd142640 1 -- 172.21.15.1:0/517046896 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21f815ce80 con 0x7f21f815e1f0 2024-05-04T02:48:28.198 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.198+0000 7f21fd142640 1 --2- 172.21.15.1:0/517046896 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f21f815e1f0 0x7f21f80b2da0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f21f80cf110 tx=0x7f21f0004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:28.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.202+0000 7f21f57fa640 1 -- 172.21.15.1:0/517046896 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f0040070 con 0x7f21f815e1f0 2024-05-04T02:48:28.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.202+0000 7f21f57fa640 1 -- 172.21.15.1:0/517046896 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21f0031bc0 con 0x7f21f815e1f0 2024-05-04T02:48:28.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.202+0000 7f21feba5640 1 -- 172.21.15.1:0/517046896 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21f815b810 con 0x7f21f815e1f0 2024-05-04T02:48:28.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.202+0000 7f21f57fa640 1 -- 172.21.15.1:0/517046896 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f0045460 con 0x7f21f815e1f0 2024-05-04T02:48:28.203 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.202+0000 7f21feba5640 1 -- 172.21.15.1:0/517046896 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21f815bdd0 con 0x7f21f815e1f0 2024-05-04T02:48:28.204 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.203+0000 7f21feba5640 1 -- 172.21.15.1:0/517046896 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f21f815c420 con 0x7f21f815e1f0 2024-05-04T02:48:28.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.226+0000 7f21f57fa640 1 -- 172.21.15.1:0/517046896 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f21f0039040 con 0x7f21f815e1f0 2024-05-04T02:48:28.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.226+0000 7f21f57fa640 1 --2- 172.21.15.1:0/517046896 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f21dc0762d0 0x7f21dc0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:28.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.227+0000 7f21fc941640 1 --2- 172.21.15.1:0/517046896 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f21dc0762d0 0x7f21dc0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:28.228 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.227+0000 7f21fc941640 1 --2- 172.21.15.1:0/517046896 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f21dc0762d0 0x7f21dc0787e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f21ec000f60 tx=0x7f21ec009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:28.232 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.232+0000 7f21f57fa640 1 -- 172.21.15.1:0/517046896 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5854+0+0 (secure 0 0 0) 0x7f21f0007840 con 0x7f21f815e1f0 2024-05-04T02:48:28.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.232+0000 7f21f57fa640 1 --2- 172.21.15.1:0/517046896 >> [v2:172.21.15.107:6818/1274544305,v1:172.21.15.107:6819/1274544305] conn(0x7f21dc07e700 0x7f21dc080bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:28.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.232+0000 7f21f57fa640 1 -- 172.21.15.1:0/517046896 --> [v2:172.21.15.107:6818/1274544305,v1:172.21.15.107:6819/1274544305] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f21dc0812c0 con 0x7f21dc07e700 2024-05-04T02:48:28.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.232+0000 7f21f57fa640 1 -- 172.21.15.1:0/517046896 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f21f007ecb0 con 0x7f21f815e1f0 2024-05-04T02:48:28.233 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.232+0000 7f21f7fff640 1 --2- 172.21.15.1:0/517046896 >> [v2:172.21.15.107:6818/1274544305,v1:172.21.15.107:6819/1274544305] conn(0x7f21dc07e700 0x7f21dc080bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:28.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.232+0000 7f21f7fff640 1 --2- 172.21.15.1:0/517046896 >> [v2:172.21.15.107:6818/1274544305,v1:172.21.15.107:6819/1274544305] conn(0x7f21dc07e700 0x7f21dc080bf0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:28.234 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.233+0000 7f21f57fa640 1 -- 172.21.15.1:0/517046896 <== osd.5 v2:172.21.15.107:6818/1274544305 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f21dc0812c0 con 0x7f21dc07e700 2024-05-04T02:48:28.247 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.246+0000 7f21feba5640 1 -- 172.21.15.1:0/517046896 --> [v2:172.21.15.107:6818/1274544305,v1:172.21.15.107:6819/1274544305] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f21f815b5c0 con 0x7f21dc07e700 2024-05-04T02:48:28.248 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.247+0000 7f21f57fa640 1 -- 172.21.15.1:0/517046896 <== osd.5 v2:172.21.15.107:6818/1274544305 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f21f815b5c0 con 0x7f21dc07e700 2024-05-04T02:48:28.248 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-05-04T02:48:28.248 INFO:teuthology.orchestra.run.smithi001.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-04T02:48:28.248 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-05-04T02:48:28.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.247+0000 7f21feba5640 1 -- 172.21.15.1:0/517046896 >> [v2:172.21.15.107:6818/1274544305,v1:172.21.15.107:6819/1274544305] conn(0x7f21dc07e700 msgr2=0x7f21dc080bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:28.249 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.248+0000 7f21feba5640 1 --2- 172.21.15.1:0/517046896 >> [v2:172.21.15.107:6818/1274544305,v1:172.21.15.107:6819/1274544305] conn(0x7f21dc07e700 0x7f21dc080bf0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:28.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.248+0000 7f21feba5640 1 -- 172.21.15.1:0/517046896 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f21dc0762d0 msgr2=0x7f21dc0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:28.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.248+0000 7f21feba5640 1 --2- 172.21.15.1:0/517046896 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f21dc0762d0 0x7f21dc0787e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f21ec000f60 tx=0x7f21ec009040 comp rx=0 tx=0).stop 2024-05-04T02:48:28.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.248+0000 7f21feba5640 1 -- 172.21.15.1:0/517046896 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f21f815e1f0 msgr2=0x7f21f80b2da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:28.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.248+0000 7f21feba5640 1 --2- 172.21.15.1:0/517046896 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f21f815e1f0 0x7f21f80b2da0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f21f80cf110 tx=0x7f21f0004a40 comp rx=0 tx=0).stop 2024-05-04T02:48:28.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.248+0000 7f21fd142640 1 -- 172.21.15.1:0/517046896 reap_dead start 2024-05-04T02:48:28.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.248+0000 7f21feba5640 1 -- 172.21.15.1:0/517046896 shutdown_connections 2024-05-04T02:48:28.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.248+0000 7f21feba5640 1 -- 172.21.15.1:0/517046896 >> 172.21.15.1:0/517046896 conn(0x7f21f80cb8e0 msgr2=0x7f21f8070830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:48:28.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.248+0000 7f21feba5640 1 -- 172.21.15.1:0/517046896 shutdown_connections 2024-05-04T02:48:28.250 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.248+0000 7f21feba5640 1 -- 172.21.15.1:0/517046896 wait complete. 2024-05-04T02:48:28.260 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-05-04T02:48:28.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.374+0000 7fcca59ee640 1 Processor -- start 2024-05-04T02:48:28.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.374+0000 7fcca59ee640 1 -- start start 2024-05-04T02:48:28.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.375+0000 7fcca59ee640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fcca00c3b50 0x7fcca00726b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:28.376 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.375+0000 7fcca59ee640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fcca0156790 0x7fcca015fb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:28.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.375+0000 7fcca59ee640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcca01607d0 con 0x7fcca0071090 2024-05-04T02:48:28.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.375+0000 7fcca59ee640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7fcca00c4db0 con 0x7fcca00c3b50 2024-05-04T02:48:28.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.375+0000 7fcca59ee640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fcca00c5090 con 0x7fcca0156790 2024-05-04T02:48:28.377 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.376+0000 7fcc9f7fe640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fcca0156790 0x7fcca015fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:28.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.376+0000 7fcc9effd640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fcca00c3b50 0x7fcca00726b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:28.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.376+0000 7fcc9f7fe640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fcca0156790 0x7fcca015fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.1:46864/0 (socket says 172.21.15.1:46864) 2024-05-04T02:48:28.378 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.377+0000 7fcc9f7fe640 1 -- 172.21.15.1:0/3200937527 learned_addr learned my addr 172.21.15.1:0/3200937527 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:48:28.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.379+0000 7fcc9f7fe640 1 -- 172.21.15.1:0/3200937527 >> v2:172.21.15.1:3300/0 conn(0x7fcca00c3b50 msgr2=0x7fcca00726b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:48:28.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.379+0000 7fcc9f7fe640 1 --2- 172.21.15.1:0/3200937527 >> v2:172.21.15.1:3300/0 conn(0x7fcca00c3b50 0x7fcca00726b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:28.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.379+0000 7fcc9f7fe640 1 -- 172.21.15.1:0/3200937527 >> v1:172.21.15.1:6789/0 conn(0x7fcca0071090 legacy=0x7fcca006c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:28.380 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.379+0000 7fcc9f7fe640 1 -- 172.21.15.1:0/3200937527 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcca006e440 con 0x7fcca0156790 2024-05-04T02:48:28.382 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.381+0000 7fcc9f7fe640 1 --2- 172.21.15.1:0/3200937527 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcca0156790 0x7fcca015fb30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fcca00c7980 tx=0x7fcc9802a730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de132ee7028f380e server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:28.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.385+0000 7fcc9dffb640 1 -- 172.21.15.1:0/3200937527 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc98036070 con 0x7fcca0156790 2024-05-04T02:48:28.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.385+0000 7fcc9dffb640 1 -- 172.21.15.1:0/3200937527 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc98031600 con 0x7fcca0156790 2024-05-04T02:48:28.386 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.385+0000 7fcc9dffb640 1 -- 172.21.15.1:0/3200937527 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc980319d0 con 0x7fcca0156790 2024-05-04T02:48:28.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.386+0000 7fcca59ee640 1 -- 172.21.15.1:0/3200937527 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcca0156790 msgr2=0x7fcca015fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:28.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.386+0000 7fcca59ee640 1 --2- 172.21.15.1:0/3200937527 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcca0156790 0x7fcca015fb30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fcca00c7980 tx=0x7fcc9802a730 comp rx=0 tx=0).stop 2024-05-04T02:48:28.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.386+0000 7fcca59ee640 1 -- 172.21.15.1:0/3200937527 shutdown_connections 2024-05-04T02:48:28.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.386+0000 7fcca59ee640 1 --2- 172.21.15.1:0/3200937527 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcca0156790 0x7fcca015fb30 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:28.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.386+0000 7fcca59ee640 1 --2- 172.21.15.1:0/3200937527 >> v2:172.21.15.1:3300/0 conn(0x7fcca00c3b50 0x7fcca00726b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:28.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.386+0000 7fcca59ee640 1 -- 172.21.15.1:0/3200937527 >> 172.21.15.1:0/3200937527 conn(0x7fcca0071b90 msgr2=0x7fcca0071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:48:28.387 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.386+0000 7fcca59ee640 1 -- 172.21.15.1:0/3200937527 shutdown_connections 2024-05-04T02:48:28.388 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.386+0000 7fcca59ee640 1 -- 172.21.15.1:0/3200937527 wait complete. 2024-05-04T02:48:28.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.388+0000 7fcca59ee640 1 Processor -- start 2024-05-04T02:48:28.389 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.388+0000 7fcca59ee640 1 -- start start 2024-05-04T02:48:28.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.389+0000 7fcca59ee640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcca0071090 0x7fcca015f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:28.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.390+0000 7fcca59ee640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcca00c3b50 0x7fcca0150bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:28.391 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.390+0000 7fcca59ee640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcca0156790 0x7fcca00c6a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:28.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.390+0000 7fcca59ee640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fcca0156d20 con 0x7fcca0156790 2024-05-04T02:48:28.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.390+0000 7fcca59ee640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fcca0156ba0 con 0x7fcca00c3b50 2024-05-04T02:48:28.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.390+0000 7fcca59ee640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fcca0160070 con 0x7fcca0071090 2024-05-04T02:48:28.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.390+0000 7fcc9f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcca0156790 0x7fcca00c6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:28.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.390+0000 7fcc9e7fc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcca00c3b50 0x7fcca0150bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:28.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.390+0000 7fcc9effd640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcca0071090 0x7fcca015f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:28.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.390+0000 7fcc9f7fe640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcca0156790 0x7fcca00c6a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37926/0 (socket says 172.21.15.1:37926) 2024-05-04T02:48:28.392 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.390+0000 7fcc9f7fe640 1 -- 172.21.15.1:0/2990556914 learned_addr learned my addr 172.21.15.1:0/2990556914 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:48:28.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.394+0000 7fcc9f7fe640 1 -- 172.21.15.1:0/2990556914 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcca0071090 msgr2=0x7fcca015f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:28.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.394+0000 7fcc9f7fe640 1 --2- 172.21.15.1:0/2990556914 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcca0071090 0x7fcca015f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:28.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.394+0000 7fcc9f7fe640 1 -- 172.21.15.1:0/2990556914 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcca00c3b50 msgr2=0x7fcca0150bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:28.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.394+0000 7fcc9f7fe640 1 --2- 172.21.15.1:0/2990556914 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcca00c3b50 0x7fcca0150bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:28.395 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.394+0000 7fcc9f7fe640 1 -- 172.21.15.1:0/2990556914 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcca01f3390 con 0x7fcca0156790 2024-05-04T02:48:28.397 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.397+0000 7fcc9f7fe640 1 --2- 172.21.15.1:0/2990556914 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcca0156790 0x7fcca00c6a80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcc9802ad20 tx=0x7fcc98004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:28.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.401+0000 7fcc87fff640 1 -- 172.21.15.1:0/2990556914 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc98041030 con 0x7fcca0156790 2024-05-04T02:48:28.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.401+0000 7fcc87fff640 1 -- 172.21.15.1:0/2990556914 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc98031400 con 0x7fcca0156790 2024-05-04T02:48:28.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.401+0000 7fcca59ee640 1 -- 172.21.15.1:0/2990556914 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcca01f30b0 con 0x7fcca0156790 2024-05-04T02:48:28.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.401+0000 7fcc87fff640 1 -- 172.21.15.1:0/2990556914 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc98036040 con 0x7fcca0156790 2024-05-04T02:48:28.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.401+0000 7fcca59ee640 1 -- 172.21.15.1:0/2990556914 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcca00c6040 con 0x7fcca0156790 2024-05-04T02:48:28.402 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.402+0000 7fcca59ee640 1 -- 172.21.15.1:0/2990556914 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcca0076740 con 0x7fcca0156790 2024-05-04T02:48:28.700 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.699+0000 7fcc87fff640 1 -- 172.21.15.1:0/2990556914 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fcc98044070 con 0x7fcca0156790 2024-05-04T02:48:28.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.700+0000 7fcc87fff640 1 --2- 172.21.15.1:0/2990556914 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fcc8c076350 0x7fcc8c078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:28.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.700+0000 7fcc9effd640 1 --2- 172.21.15.1:0/2990556914 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fcc8c076350 0x7fcc8c078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:28.701 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.701+0000 7fcc9effd640 1 --2- 172.21.15.1:0/2990556914 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fcc8c076350 0x7fcc8c078860 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fcc90009aa0 tx=0x7fcc90009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:28.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.732+0000 7fcc87fff640 1 -- 172.21.15.1:0/2990556914 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5854+0+0 (secure 0 0 0) 0x7fcc980315b0 con 0x7fcca0156790 2024-05-04T02:48:28.733 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.732+0000 7fcc87fff640 1 -- 172.21.15.1:0/2990556914 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fcc9804b070 con 0x7fcca0156790 2024-05-04T02:48:28.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.923+0000 7fcca59ee640 1 -- 172.21.15.1:0/2990556914 --> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7fcca00c7e40 con 0x7fcc8c076350 2024-05-04T02:48:28.925 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.924+0000 7fcc87fff640 1 -- 172.21.15.1:0/2990556914 <== mgr.4108 v2:172.21.15.107:6800/3809222574 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fcca00c7e40 con 0x7fcc8c076350 2024-05-04T02:48:28.925 INFO:teuthology.orchestra.run.smithi001.stderr:instructed osd(s) 5 to deep-scrub 2024-05-04T02:48:28.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.926+0000 7fcca59ee640 1 -- 172.21.15.1:0/2990556914 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fcc8c076350 msgr2=0x7fcc8c078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:28.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.926+0000 7fcca59ee640 1 --2- 172.21.15.1:0/2990556914 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fcc8c076350 0x7fcc8c078860 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fcc90009aa0 tx=0x7fcc90009190 comp rx=0 tx=0).stop 2024-05-04T02:48:28.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.926+0000 7fcca59ee640 1 -- 172.21.15.1:0/2990556914 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcca0156790 msgr2=0x7fcca00c6a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:28.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.926+0000 7fcca59ee640 1 --2- 172.21.15.1:0/2990556914 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcca0156790 0x7fcca00c6a80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcc9802ad20 tx=0x7fcc98004a40 comp rx=0 tx=0).stop 2024-05-04T02:48:28.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.926+0000 7fcca59ee640 1 -- 172.21.15.1:0/2990556914 shutdown_connections 2024-05-04T02:48:28.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.926+0000 7fcca59ee640 1 --2- 172.21.15.1:0/2990556914 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fcc8c076350 0x7fcc8c078860 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:28.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.926+0000 7fcca59ee640 1 --2- 172.21.15.1:0/2990556914 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fcca0156790 0x7fcca00c6a80 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:28.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.926+0000 7fcca59ee640 1 --2- 172.21.15.1:0/2990556914 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fcca00c3b50 0x7fcca0150bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:28.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.926+0000 7fcca59ee640 1 --2- 172.21.15.1:0/2990556914 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fcca0071090 0x7fcca015f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:28.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.926+0000 7fcca59ee640 1 -- 172.21.15.1:0/2990556914 >> 172.21.15.1:0/2990556914 conn(0x7fcca0071b90 msgr2=0x7fcca00cbd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:48:28.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.926+0000 7fcca59ee640 1 -- 172.21.15.1:0/2990556914 shutdown_connections 2024-05-04T02:48:28.928 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:28.926+0000 7fcca59ee640 1 -- 172.21.15.1:0/2990556914 wait complete. 2024-05-04T02:48:28.939 INFO:tasks.ceph:Scrubbing osd.6 2024-05-04T02:48:28.939 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-05-04T02:48:29.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.055+0000 7fbd2e98d640 1 Processor -- start 2024-05-04T02:48:29.057 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.055+0000 7fbd2e98d640 1 -- start start 2024-05-04T02:48:29.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.057+0000 7fbd2e98d640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fbd2815c4a0 0x7fbd2815c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:29.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.057+0000 7fbd2e98d640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbd2815cdf0 0x7fbd28166de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:29.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.057+0000 7fbd2e98d640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd280cd3b0 con 0x7fbd280cdcf0 2024-05-04T02:48:29.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.057+0000 7fbd2e98d640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7fbd280b74b0 con 0x7fbd2815c4a0 2024-05-04T02:48:29.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.057+0000 7fbd2e98d640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fbd2806d1a0 con 0x7fbd2815cdf0 2024-05-04T02:48:29.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.058+0000 7fbd2cf2a640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbd2815cdf0 0x7fbd28166de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:29.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.058+0000 7fbd27fff640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7fbd280cdcf0 0x7fbd2806d9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.1:37430/0 (socket says 172.21.15.1:37430) 2024-05-04T02:48:29.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.058+0000 7fbd27fff640 1 -- 172.21.15.1:0/1805419591 learned_addr learned my addr 172.21.15.1:0/1805419591 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-05-04T02:48:29.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.058+0000 7fbd277fe640 1 --2- 172.21.15.1:0/1805419591 >> v2:172.21.15.1:3300/0 conn(0x7fbd2815c4a0 0x7fbd2815c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:29.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.060+0000 7fbd26ffd640 1 -- 172.21.15.1:0/1805419591 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 659539094 0 0) 0x7fbd280cd3b0 con 0x7fbd280cdcf0 2024-05-04T02:48:29.061 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.061+0000 7fbd26ffd640 1 -- 172.21.15.1:0/1805419591 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd14003520 con 0x7fbd280cdcf0 2024-05-04T02:48:29.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.061+0000 7fbd277fe640 1 -- 172.21.15.1:0/1805419591 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbd2815cdf0 msgr2=0x7fbd28166de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:48:29.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.061+0000 7fbd277fe640 1 --2- 172.21.15.1:0/1805419591 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbd2815cdf0 0x7fbd28166de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:29.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.061+0000 7fbd277fe640 1 -- 172.21.15.1:0/1805419591 >> v1:172.21.15.107:6789/0 conn(0x7fbd280cdcf0 legacy=0x7fbd2806d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:29.062 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.061+0000 7fbd277fe640 1 -- 172.21.15.1:0/1805419591 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd2806d480 con 0x7fbd2815c4a0 2024-05-04T02:48:29.064 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.063+0000 7fbd277fe640 1 --2- 172.21.15.1:0/1805419591 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbd2815c4a0 0x7fbd2815c8b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbd180097a0 tx=0x7fbd1802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87525edf445ddfcf server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:29.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.067+0000 7fbd26ffd640 1 -- 172.21.15.1:0/1805419591 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd18037070 con 0x7fbd2815c4a0 2024-05-04T02:48:29.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.067+0000 7fbd26ffd640 1 -- 172.21.15.1:0/1805419591 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd18032440 con 0x7fbd2815c4a0 2024-05-04T02:48:29.068 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.067+0000 7fbd26ffd640 1 -- 172.21.15.1:0/1805419591 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd18032810 con 0x7fbd2815c4a0 2024-05-04T02:48:29.069 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.068+0000 7fbd2e98d640 1 -- 172.21.15.1:0/1805419591 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbd2815c4a0 msgr2=0x7fbd2815c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:29.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.068+0000 7fbd2e98d640 1 --2- 172.21.15.1:0/1805419591 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbd2815c4a0 0x7fbd2815c8b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbd180097a0 tx=0x7fbd1802a210 comp rx=0 tx=0).stop 2024-05-04T02:48:29.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.068+0000 7fbd2e98d640 1 -- 172.21.15.1:0/1805419591 shutdown_connections 2024-05-04T02:48:29.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.068+0000 7fbd2e98d640 1 --2- 172.21.15.1:0/1805419591 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbd2815cdf0 0x7fbd28166de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:29.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.068+0000 7fbd2e98d640 1 --2- 172.21.15.1:0/1805419591 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbd2815c4a0 0x7fbd2815c8b0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:29.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.068+0000 7fbd2e98d640 1 -- 172.21.15.1:0/1805419591 >> 172.21.15.1:0/1805419591 conn(0x7fbd280ce960 msgr2=0x7fbd2808cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:48:29.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.068+0000 7fbd2e98d640 1 -- 172.21.15.1:0/1805419591 shutdown_connections 2024-05-04T02:48:29.070 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.068+0000 7fbd2e98d640 1 -- 172.21.15.1:0/1805419591 wait complete. 2024-05-04T02:48:29.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.070+0000 7fbd2e98d640 1 Processor -- start 2024-05-04T02:48:29.071 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.070+0000 7fbd2e98d640 1 -- start start 2024-05-04T02:48:29.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.071+0000 7fbd2e98d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbd280cdcf0 0x7fbd281f2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:29.072 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.071+0000 7fbd2e98d640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbd2815c4a0 0x7fbd28151670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:29.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.071+0000 7fbd2e98d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd2815cdf0 0x7fbd28159520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:29.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.072+0000 7fbd2e98d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fbd280cd7c0 con 0x7fbd280cdcf0 2024-05-04T02:48:29.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.072+0000 7fbd2e98d640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fbd280b7790 con 0x7fbd2815cdf0 2024-05-04T02:48:29.073 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.072+0000 7fbd2e98d640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fbd2815d950 con 0x7fbd2815c4a0 2024-05-04T02:48:29.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.072+0000 7fbd27fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbd280cdcf0 0x7fbd281f2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:29.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.072+0000 7fbd27fff640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbd280cdcf0 0x7fbd281f2a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37938/0 (socket says 172.21.15.1:37938) 2024-05-04T02:48:29.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.072+0000 7fbd27fff640 1 -- 172.21.15.1:0/3195378671 learned_addr learned my addr 172.21.15.1:0/3195378671 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:48:29.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.072+0000 7fbd277fe640 1 --2- 172.21.15.1:0/3195378671 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbd2815c4a0 0x7fbd28151670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:29.074 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.073+0000 7fbd2cf2a640 1 --2- 172.21.15.1:0/3195378671 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd2815cdf0 0x7fbd28159520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:29.075 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:48:29.077 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:48:29.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.077+0000 7fbd27fff640 1 -- 172.21.15.1:0/3195378671 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbd2815c4a0 msgr2=0x7fbd28151670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:29.078 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.077+0000 7fbd27fff640 1 --2- 172.21.15.1:0/3195378671 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fbd2815c4a0 0x7fbd28151670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:29.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.077+0000 7fbd27fff640 1 -- 172.21.15.1:0/3195378671 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd2815cdf0 msgr2=0x7fbd28159520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:29.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.077+0000 7fbd27fff640 1 --2- 172.21.15.1:0/3195378671 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbd2815cdf0 0x7fbd28159520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:29.079 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.077+0000 7fbd27fff640 1 -- 172.21.15.1:0/3195378671 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd281f5f80 con 0x7fbd280cdcf0 2024-05-04T02:48:29.080 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.079+0000 7fbd27fff640 1 --2- 172.21.15.1:0/3195378671 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbd280cdcf0 0x7fbd281f2a70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fbd1000c430 tx=0x7fbd1000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:29.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.083+0000 7fbd24ff9640 1 -- 172.21.15.1:0/3195378671 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd10017070 con 0x7fbd280cdcf0 2024-05-04T02:48:29.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.084+0000 7fbd24ff9640 1 -- 172.21.15.1:0/3195378671 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd10005ce0 con 0x7fbd280cdcf0 2024-05-04T02:48:29.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.084+0000 7fbd2e98d640 1 -- 172.21.15.1:0/3195378671 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd281f6260 con 0x7fbd280cdcf0 2024-05-04T02:48:29.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.084+0000 7fbd24ff9640 1 -- 172.21.15.1:0/3195378671 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd100072d0 con 0x7fbd280cdcf0 2024-05-04T02:48:29.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.084+0000 7fbd2e98d640 1 -- 172.21.15.1:0/3195378671 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd281f6820 con 0x7fbd280cdcf0 2024-05-04T02:48:29.085 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.085+0000 7fbd2e98d640 1 -- 172.21.15.1:0/3195378671 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbd281f2fb0 con 0x7fbd280cdcf0 2024-05-04T02:48:29.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.113+0000 7fbd24ff9640 1 -- 172.21.15.1:0/3195378671 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbd1001a070 con 0x7fbd280cdcf0 2024-05-04T02:48:29.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.113+0000 7fbd24ff9640 1 --2- 172.21.15.1:0/3195378671 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fbd080762d0 0x7fbd080787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:29.114 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.114+0000 7fbd277fe640 1 --2- 172.21.15.1:0/3195378671 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fbd080762d0 0x7fbd080787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:29.115 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.114+0000 7fbd277fe640 1 --2- 172.21.15.1:0/3195378671 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fbd080762d0 0x7fbd080787e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbd18034000 tx=0x7fbd1802e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:29.119 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.118+0000 7fbd24ff9640 1 -- 172.21.15.1:0/3195378671 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5854+0+0 (secure 0 0 0) 0x7fbd10095560 con 0x7fbd280cdcf0 2024-05-04T02:48:29.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.119+0000 7fbd24ff9640 1 --2- 172.21.15.1:0/3195378671 >> [v2:172.21.15.107:6809/941385299,v1:172.21.15.107:6811/941385299] conn(0x7fbd0807e700 0x7fbd08080bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:29.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.119+0000 7fbd24ff9640 1 -- 172.21.15.1:0/3195378671 --> [v2:172.21.15.107:6809/941385299,v1:172.21.15.107:6811/941385299] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbd10011e50 con 0x7fbd0807e700 2024-05-04T02:48:29.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.119+0000 7fbd2cf2a640 1 --2- 172.21.15.1:0/3195378671 >> [v2:172.21.15.107:6809/941385299,v1:172.21.15.107:6811/941385299] conn(0x7fbd0807e700 0x7fbd08080bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:29.120 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.119+0000 7fbd2cf2a640 1 --2- 172.21.15.1:0/3195378671 >> [v2:172.21.15.107:6809/941385299,v1:172.21.15.107:6811/941385299] conn(0x7fbd0807e700 0x7fbd08080bf0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:29.121 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.120+0000 7fbd24ff9640 1 -- 172.21.15.1:0/3195378671 <== osd.6 v2:172.21.15.107:6809/941385299 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbd10011e50 con 0x7fbd0807e700 2024-05-04T02:48:29.123 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.123+0000 7fbd24ff9640 1 -- 172.21.15.1:0/3195378671 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fbd1005ca50 con 0x7fbd280cdcf0 2024-05-04T02:48:29.135 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.135+0000 7fbd2e98d640 1 -- 172.21.15.1:0/3195378671 --> [v2:172.21.15.107:6809/941385299,v1:172.21.15.107:6811/941385299] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fbd28069c60 con 0x7fbd0807e700 2024-05-04T02:48:29.136 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.135+0000 7fbd24ff9640 1 -- 172.21.15.1:0/3195378671 <== osd.6 v2:172.21.15.107:6809/941385299 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fbd28069c60 con 0x7fbd0807e700 2024-05-04T02:48:29.136 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-05-04T02:48:29.136 INFO:teuthology.orchestra.run.smithi001.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-04T02:48:29.136 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-05-04T02:48:29.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.135+0000 7fbd2e98d640 1 -- 172.21.15.1:0/3195378671 >> [v2:172.21.15.107:6809/941385299,v1:172.21.15.107:6811/941385299] conn(0x7fbd0807e700 msgr2=0x7fbd08080bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:29.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.135+0000 7fbd2e98d640 1 --2- 172.21.15.1:0/3195378671 >> [v2:172.21.15.107:6809/941385299,v1:172.21.15.107:6811/941385299] conn(0x7fbd0807e700 0x7fbd08080bf0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:29.137 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.135+0000 7fbd2e98d640 1 -- 172.21.15.1:0/3195378671 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fbd080762d0 msgr2=0x7fbd080787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:29.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.135+0000 7fbd2e98d640 1 --2- 172.21.15.1:0/3195378671 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fbd080762d0 0x7fbd080787e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbd18034000 tx=0x7fbd1802e000 comp rx=0 tx=0).stop 2024-05-04T02:48:29.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.135+0000 7fbd2e98d640 1 -- 172.21.15.1:0/3195378671 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbd280cdcf0 msgr2=0x7fbd281f2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:29.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.135+0000 7fbd2e98d640 1 --2- 172.21.15.1:0/3195378671 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fbd280cdcf0 0x7fbd281f2a70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fbd1000c430 tx=0x7fbd1000c8f0 comp rx=0 tx=0).stop 2024-05-04T02:48:29.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.136+0000 7fbd2cf2a640 1 -- 172.21.15.1:0/3195378671 reap_dead start 2024-05-04T02:48:29.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.136+0000 7fbd2e98d640 1 -- 172.21.15.1:0/3195378671 shutdown_connections 2024-05-04T02:48:29.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.136+0000 7fbd2e98d640 1 -- 172.21.15.1:0/3195378671 >> 172.21.15.1:0/3195378671 conn(0x7fbd280ce960 msgr2=0x7fbd28153df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:48:29.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.136+0000 7fbd2e98d640 1 -- 172.21.15.1:0/3195378671 shutdown_connections 2024-05-04T02:48:29.138 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.136+0000 7fbd2e98d640 1 -- 172.21.15.1:0/3195378671 wait complete. 2024-05-04T02:48:29.148 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-05-04T02:48:29.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.303+0000 7f8893dea640 1 Processor -- start 2024-05-04T02:48:29.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.303+0000 7f8893dea640 1 -- start start 2024-05-04T02:48:29.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.305+0000 7f8893dea640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f888c156670 0x7f888c06c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:29.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.305+0000 7f8893dea640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f888c06cdf0 0x7f888c06d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:29.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.305+0000 7f8893dea640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f888c0c51b0 con 0x7f888c06e570 2024-05-04T02:48:29.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.305+0000 7f8893dea640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f888c0c4610 con 0x7f888c156670 2024-05-04T02:48:29.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.305+0000 7f8893dea640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f888c0c3300 con 0x7f888c06cdf0 2024-05-04T02:48:29.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.305+0000 7f8892387640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f888c06cdf0 0x7f888c06d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:29.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.306+0000 7f8891385640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f888c156670 0x7f888c06c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:29.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.306+0000 7f8891b86640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f888c06e570 0x7f888c0c4aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:37720/0 (socket says 172.21.15.1:37720) 2024-05-04T02:48:29.307 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.306+0000 7f8891b86640 1 -- 172.21.15.1:0/2710645850 learned_addr learned my addr 172.21.15.1:0/2710645850 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-05-04T02:48:29.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.308+0000 7f8892387640 1 -- 172.21.15.1:0/2710645850 >> v2:172.21.15.1:3300/0 conn(0x7f888c156670 msgr2=0x7f888c06c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:48:29.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.308+0000 7f8892387640 1 --2- 172.21.15.1:0/2710645850 >> v2:172.21.15.1:3300/0 conn(0x7f888c156670 0x7f888c06c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:29.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.308+0000 7f8892387640 1 -- 172.21.15.1:0/2710645850 >> v1:172.21.15.1:6789/0 conn(0x7f888c06e570 legacy=0x7f888c0c4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:29.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.308+0000 7f8892387640 1 -- 172.21.15.1:0/2710645850 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f888c156a80 con 0x7f888c06cdf0 2024-05-04T02:48:29.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.311+0000 7f8892387640 1 --2- 172.21.15.1:0/2710645850 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f888c06cdf0 0x7f888c06d200 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f888c06c830 tx=0x7f888802a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb01f30badf2848c server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:29.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.314+0000 7f8890b84640 1 -- 172.21.15.1:0/2710645850 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8888007740 con 0x7f888c06cdf0 2024-05-04T02:48:29.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.314+0000 7f8890b84640 1 -- 172.21.15.1:0/2710645850 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88880078e0 con 0x7f888c06cdf0 2024-05-04T02:48:29.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.314+0000 7f8890b84640 1 -- 172.21.15.1:0/2710645850 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8888007cb0 con 0x7f888c06cdf0 2024-05-04T02:48:29.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.315+0000 7f8893dea640 1 -- 172.21.15.1:0/2710645850 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f888c06cdf0 msgr2=0x7f888c06d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:29.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.315+0000 7f8893dea640 1 --2- 172.21.15.1:0/2710645850 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f888c06cdf0 0x7f888c06d200 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f888c06c830 tx=0x7f888802a710 comp rx=0 tx=0).stop 2024-05-04T02:48:29.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.315+0000 7f8893dea640 1 -- 172.21.15.1:0/2710645850 shutdown_connections 2024-05-04T02:48:29.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.315+0000 7f8893dea640 1 --2- 172.21.15.1:0/2710645850 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f888c06cdf0 0x7f888c06d200 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:29.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.315+0000 7f8893dea640 1 --2- 172.21.15.1:0/2710645850 >> v2:172.21.15.1:3300/0 conn(0x7f888c156670 0x7f888c06c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:29.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.315+0000 7f8893dea640 1 -- 172.21.15.1:0/2710645850 >> 172.21.15.1:0/2710645850 conn(0x7f888c0caa80 msgr2=0x7f888c0cae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:48:29.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.315+0000 7f8893dea640 1 -- 172.21.15.1:0/2710645850 shutdown_connections 2024-05-04T02:48:29.317 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.315+0000 7f8893dea640 1 -- 172.21.15.1:0/2710645850 wait complete. 2024-05-04T02:48:29.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.317+0000 7f8893dea640 1 Processor -- start 2024-05-04T02:48:29.318 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.317+0000 7f8893dea640 1 -- start start 2024-05-04T02:48:29.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.318+0000 7f8893dea640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f888c06cdf0 0x7f888c0c7770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:29.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.318+0000 7f8893dea640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f888c06e570 0x7f888c0c5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:29.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.318+0000 7f8893dea640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f888c156670 0x7f888c1f6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:29.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.318+0000 7f8893dea640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f888c15d450 con 0x7f888c06cdf0 2024-05-04T02:48:29.319 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.318+0000 7f8893dea640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f888c15d170 con 0x7f888c156670 2024-05-04T02:48:29.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.318+0000 7f8893dea640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f888c0c3fc0 con 0x7f888c06e570 2024-05-04T02:48:29.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.319+0000 7f8892387640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f888c156670 0x7f888c1f6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:29.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.319+0000 7f8891385640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f888c06e570 0x7f888c0c5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:29.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.319+0000 7f8891b86640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f888c06cdf0 0x7f888c0c7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:29.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.319+0000 7f8891385640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f888c06e570 0x7f888c0c5c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.1:60780/0 (socket says 172.21.15.1:60780) 2024-05-04T02:48:29.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.319+0000 7f8891385640 1 -- 172.21.15.1:0/3240465907 learned_addr learned my addr 172.21.15.1:0/3240465907 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:48:29.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.323+0000 7f8892387640 1 -- 172.21.15.1:0/3240465907 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f888c06e570 msgr2=0x7f888c0c5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:29.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.323+0000 7f8892387640 1 --2- 172.21.15.1:0/3240465907 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f888c06e570 0x7f888c0c5c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:29.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.323+0000 7f8892387640 1 -- 172.21.15.1:0/3240465907 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f888c06cdf0 msgr2=0x7f888c0c7770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:29.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.323+0000 7f8892387640 1 --2- 172.21.15.1:0/3240465907 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f888c06cdf0 0x7f888c0c7770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:29.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.323+0000 7f8892387640 1 -- 172.21.15.1:0/3240465907 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f888c0c81e0 con 0x7f888c156670 2024-05-04T02:48:29.327 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.326+0000 7f8892387640 1 --2- 172.21.15.1:0/3240465907 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f888c156670 0x7f888c1f6560 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8888031000 tx=0x7f8888004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:29.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.330+0000 7f88827fc640 1 -- 172.21.15.1:0/3240465907 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f888803f070 con 0x7f888c156670 2024-05-04T02:48:29.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.330+0000 7f88827fc640 1 -- 172.21.15.1:0/3240465907 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8888031b40 con 0x7f888c156670 2024-05-04T02:48:29.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.330+0000 7f8893dea640 1 -- 172.21.15.1:0/3240465907 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f888c158250 con 0x7f888c156670 2024-05-04T02:48:29.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.330+0000 7f88827fc640 1 -- 172.21.15.1:0/3240465907 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8888044460 con 0x7f888c156670 2024-05-04T02:48:29.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.330+0000 7f8893dea640 1 -- 172.21.15.1:0/3240465907 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f888c1f2d80 con 0x7f888c156670 2024-05-04T02:48:29.332 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.331+0000 7f8893dea640 1 -- 172.21.15.1:0/3240465907 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f888c069bc0 con 0x7f888c156670 2024-05-04T02:48:29.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.607+0000 7f88827fc640 1 -- 172.21.15.1:0/3240465907 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f888803b410 con 0x7f888c156670 2024-05-04T02:48:29.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.608+0000 7f88827fc640 1 --2- 172.21.15.1:0/3240465907 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f88700762d0 0x7f88700787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:29.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.608+0000 7f8891b86640 1 --2- 172.21.15.1:0/3240465907 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f88700762d0 0x7f88700787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:29.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.609+0000 7f8891b86640 1 --2- 172.21.15.1:0/3240465907 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f88700762d0 0x7f88700787e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8884000f60 tx=0x7f8884009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:29.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.611+0000 7f88827fc640 1 -- 172.21.15.1:0/3240465907 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5854+0+0 (secure 0 0 0) 0x7f8888007840 con 0x7f888c156670 2024-05-04T02:48:29.623 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.622+0000 7f88827fc640 1 -- 172.21.15.1:0/3240465907 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8888082130 con 0x7f888c156670 2024-05-04T02:48:29.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.813+0000 7f8893dea640 1 -- 172.21.15.1:0/3240465907 --> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f888c1f3860 con 0x7f88700762d0 2024-05-04T02:48:29.814 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.814+0000 7f88827fc640 1 -- 172.21.15.1:0/3240465907 <== mgr.4108 v2:172.21.15.107:6800/3809222574 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f888c1f3860 con 0x7f88700762d0 2024-05-04T02:48:29.815 INFO:teuthology.orchestra.run.smithi001.stderr:instructed osd(s) 6 to deep-scrub 2024-05-04T02:48:29.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.816+0000 7f8893dea640 1 -- 172.21.15.1:0/3240465907 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f88700762d0 msgr2=0x7f88700787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:29.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.816+0000 7f8893dea640 1 --2- 172.21.15.1:0/3240465907 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f88700762d0 0x7f88700787e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8884000f60 tx=0x7f8884009040 comp rx=0 tx=0).stop 2024-05-04T02:48:29.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.816+0000 7f8893dea640 1 -- 172.21.15.1:0/3240465907 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f888c156670 msgr2=0x7f888c1f6560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:29.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.816+0000 7f8893dea640 1 --2- 172.21.15.1:0/3240465907 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f888c156670 0x7f888c1f6560 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8888031000 tx=0x7f8888004a40 comp rx=0 tx=0).stop 2024-05-04T02:48:29.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.816+0000 7f8893dea640 1 -- 172.21.15.1:0/3240465907 shutdown_connections 2024-05-04T02:48:29.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.816+0000 7f8893dea640 1 --2- 172.21.15.1:0/3240465907 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f88700762d0 0x7f88700787e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:29.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.816+0000 7f8893dea640 1 --2- 172.21.15.1:0/3240465907 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f888c156670 0x7f888c1f6560 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:29.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.816+0000 7f8893dea640 1 --2- 172.21.15.1:0/3240465907 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f888c06e570 0x7f888c0c5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:29.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.816+0000 7f8893dea640 1 --2- 172.21.15.1:0/3240465907 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f888c06cdf0 0x7f888c0c7770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:29.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.816+0000 7f8893dea640 1 -- 172.21.15.1:0/3240465907 >> 172.21.15.1:0/3240465907 conn(0x7f888c0caa80 msgr2=0x7f888c155240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:48:29.817 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.816+0000 7f8893dea640 1 -- 172.21.15.1:0/3240465907 shutdown_connections 2024-05-04T02:48:29.818 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.816+0000 7f8893dea640 1 -- 172.21.15.1:0/3240465907 wait complete. 2024-05-04T02:48:29.828 INFO:tasks.ceph:Scrubbing osd.7 2024-05-04T02:48:29.828 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-05-04T02:48:29.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.943+0000 7f1a77c61640 1 Processor -- start 2024-05-04T02:48:29.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.943+0000 7f1a77c61640 1 -- start start 2024-05-04T02:48:29.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.944+0000 7f1a77c61640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f1a700cb500 0x7f1a700c3210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:29.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.944+0000 7f1a77c61640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1a700ca0d0 0x7f1a700ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:29.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.944+0000 7f1a77c61640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a700caa20 con 0x7f1a7015fbc0 2024-05-04T02:48:29.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.944+0000 7f1a77c61640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f1a700c7a80 con 0x7f1a700cb500 2024-05-04T02:48:29.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.944+0000 7f1a77c61640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f1a700cb910 con 0x7f1a700ca0d0 2024-05-04T02:48:29.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.945+0000 7f1a751fc640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1a700ca0d0 0x7f1a700ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:29.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.945+0000 7f1a759fd640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f1a700cb500 0x7f1a700c3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:29.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.945+0000 7f1a751fc640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1a700ca0d0 0x7f1a700ca4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.1:60782/0 (socket says 172.21.15.1:60782) 2024-05-04T02:48:29.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.945+0000 7f1a751fc640 1 -- 172.21.15.1:0/2710432429 learned_addr learned my addr 172.21.15.1:0/2710432429 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:48:29.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.948+0000 7f1a751fc640 1 -- 172.21.15.1:0/2710432429 >> v2:172.21.15.107:3300/0 conn(0x7f1a700cb500 msgr2=0x7f1a700c3210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:48:29.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.948+0000 7f1a751fc640 1 --2- 172.21.15.1:0/2710432429 >> v2:172.21.15.107:3300/0 conn(0x7f1a700cb500 0x7f1a700c3210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:29.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.948+0000 7f1a751fc640 1 -- 172.21.15.1:0/2710432429 >> v1:172.21.15.107:6789/0 conn(0x7f1a7015fbc0 legacy=0x7f1a7015ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:29.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.948+0000 7f1a751fc640 1 -- 172.21.15.1:0/2710432429 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a7008d6f0 con 0x7f1a700ca0d0 2024-05-04T02:48:29.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.950+0000 7f1a751fc640 1 --2- 172.21.15.1:0/2710432429 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1a700ca0d0 0x7f1a700ca4e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1a60009870 tx=0x7f1a6002a300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed8bf4094858eb66 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:29.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.953+0000 7f1a749fb640 1 -- 172.21.15.1:0/2710432429 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a60037070 con 0x7f1a700ca0d0 2024-05-04T02:48:29.955 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.954+0000 7f1a749fb640 1 -- 172.21.15.1:0/2710432429 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a6002ae50 con 0x7f1a700ca0d0 2024-05-04T02:48:29.955 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.954+0000 7f1a749fb640 1 -- 172.21.15.1:0/2710432429 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a60032860 con 0x7f1a700ca0d0 2024-05-04T02:48:29.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.955+0000 7f1a77c61640 1 -- 172.21.15.1:0/2710432429 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1a700ca0d0 msgr2=0x7f1a700ca4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:29.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.955+0000 7f1a77c61640 1 --2- 172.21.15.1:0/2710432429 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1a700ca0d0 0x7f1a700ca4e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1a60009870 tx=0x7f1a6002a300 comp rx=0 tx=0).stop 2024-05-04T02:48:29.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.955+0000 7f1a77c61640 1 -- 172.21.15.1:0/2710432429 shutdown_connections 2024-05-04T02:48:29.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.955+0000 7f1a77c61640 1 --2- 172.21.15.1:0/2710432429 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1a700ca0d0 0x7f1a700ca4e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:29.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.955+0000 7f1a77c61640 1 --2- 172.21.15.1:0/2710432429 >> v2:172.21.15.107:3300/0 conn(0x7f1a700cb500 0x7f1a700c3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:29.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.955+0000 7f1a77c61640 1 -- 172.21.15.1:0/2710432429 >> 172.21.15.1:0/2710432429 conn(0x7f1a700cf6c0 msgr2=0x7f1a700cfad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:48:29.956 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.955+0000 7f1a77c61640 1 -- 172.21.15.1:0/2710432429 shutdown_connections 2024-05-04T02:48:29.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.955+0000 7f1a77c61640 1 -- 172.21.15.1:0/2710432429 wait complete. 2024-05-04T02:48:29.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.957+0000 7f1a77c61640 1 Processor -- start 2024-05-04T02:48:29.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.957+0000 7f1a77c61640 1 -- start start 2024-05-04T02:48:29.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.958+0000 7f1a77c61640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1a700ca0d0 0x7f1a701f5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:29.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.958+0000 7f1a77c61640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a700cb500 0x7f1a70155210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:29.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.958+0000 7f1a77c61640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1a7015fbc0 0x7f1a7015ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:29.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.958+0000 7f1a77c61640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f1a700c5420 con 0x7f1a700ca0d0 2024-05-04T02:48:29.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.958+0000 7f1a77c61640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1a700c5140 con 0x7f1a700cb500 2024-05-04T02:48:29.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.958+0000 7f1a77c61640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f1a700c5700 con 0x7f1a7015fbc0 2024-05-04T02:48:29.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.959+0000 7f1a761fe640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1a7015fbc0 0x7f1a7015ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:29.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.959+0000 7f1a759fd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1a700ca0d0 0x7f1a701f5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:29.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.959+0000 7f1a751fc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a700cb500 0x7f1a70155210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:29.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.959+0000 7f1a761fe640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1a7015fbc0 0x7f1a7015ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.1:60790/0 (socket says 172.21.15.1:60790) 2024-05-04T02:48:29.960 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.959+0000 7f1a761fe640 1 -- 172.21.15.1:0/3201367644 learned_addr learned my addr 172.21.15.1:0/3201367644 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:48:29.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.963+0000 7f1a761fe640 1 -- 172.21.15.1:0/3201367644 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a700cb500 msgr2=0x7f1a70155210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:29.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.963+0000 7f1a761fe640 1 --2- 172.21.15.1:0/3201367644 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1a700cb500 0x7f1a70155210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:29.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.963+0000 7f1a761fe640 1 -- 172.21.15.1:0/3201367644 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1a700ca0d0 msgr2=0x7f1a701f5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:29.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.963+0000 7f1a761fe640 1 --2- 172.21.15.1:0/3201367644 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f1a700ca0d0 0x7f1a701f5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:29.964 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.963+0000 7f1a761fe640 1 -- 172.21.15.1:0/3201367644 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a70157a50 con 0x7f1a7015fbc0 2024-05-04T02:48:29.967 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.966+0000 7f1a761fe640 1 --2- 172.21.15.1:0/3201367644 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1a7015fbc0 0x7f1a7015ee20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1a6800c700 tx=0x7f1a6800cbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:29.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.970+0000 7f1a667fc640 1 -- 172.21.15.1:0/3201367644 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a68003b70 con 0x7f1a7015fbc0 2024-05-04T02:48:29.971 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.970+0000 7f1a667fc640 1 -- 172.21.15.1:0/3201367644 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a68003d10 con 0x7f1a7015fbc0 2024-05-04T02:48:29.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.970+0000 7f1a667fc640 1 -- 172.21.15.1:0/3201367644 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a6800aa70 con 0x7f1a7015fbc0 2024-05-04T02:48:29.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.970+0000 7f1a77c61640 1 -- 172.21.15.1:0/3201367644 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a701f6080 con 0x7f1a7015fbc0 2024-05-04T02:48:29.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.971+0000 7f1a77c61640 1 -- 172.21.15.1:0/3201367644 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a701f2890 con 0x7f1a7015fbc0 2024-05-04T02:48:29.972 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.971+0000 7f1a77c61640 1 -- 172.21.15.1:0/3201367644 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1a70069c60 con 0x7f1a7015fbc0 2024-05-04T02:48:29.995 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.994+0000 7f1a667fc640 1 -- 172.21.15.1:0/3201367644 <== mon.2 v2:172.21.15.107:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1a6800ac10 con 0x7f1a7015fbc0 2024-05-04T02:48:29.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.995+0000 7f1a667fc640 1 --2- 172.21.15.1:0/3201367644 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f1a54076320 0x7f1a54078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:29.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.995+0000 7f1a759fd640 1 --2- 172.21.15.1:0/3201367644 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f1a54076320 0x7f1a54078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:29.996 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.996+0000 7f1a759fd640 1 --2- 172.21.15.1:0/3201367644 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f1a54076320 0x7f1a54078830 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1a70074a50 tx=0x7f1a6c009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:30.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.999+0000 7f1a667fc640 1 -- 172.21.15.1:0/3201367644 <== mon.2 v2:172.21.15.107:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 5854+0+0 (secure 0 0 0) 0x7f1a6805d2f0 con 0x7f1a7015fbc0 2024-05-04T02:48:30.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.999+0000 7f1a667fc640 1 --2- 172.21.15.1:0/3201367644 >> [v2:172.21.15.107:6826/1723298539,v1:172.21.15.107:6827/1723298539] conn(0x7f1a5407e750 0x7f1a54080c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:30.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.999+0000 7f1a667fc640 1 -- 172.21.15.1:0/3201367644 --> [v2:172.21.15.107:6826/1723298539,v1:172.21.15.107:6827/1723298539] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1a68013e70 con 0x7f1a5407e750 2024-05-04T02:48:30.000 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:29.999+0000 7f1a751fc640 1 --2- 172.21.15.1:0/3201367644 >> [v2:172.21.15.107:6826/1723298539,v1:172.21.15.107:6827/1723298539] conn(0x7f1a5407e750 0x7f1a54080c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:30.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.000+0000 7f1a751fc640 1 --2- 172.21.15.1:0/3201367644 >> [v2:172.21.15.107:6826/1723298539,v1:172.21.15.107:6827/1723298539] conn(0x7f1a5407e750 0x7f1a54080c40 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:30.001 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.001+0000 7f1a667fc640 1 -- 172.21.15.1:0/3201367644 <== mon.2 v2:172.21.15.107:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1a6805d6b0 con 0x7f1a7015fbc0 2024-05-04T02:48:30.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.001+0000 7f1a667fc640 1 -- 172.21.15.1:0/3201367644 <== osd.7 v2:172.21.15.107:6826/1723298539 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1a68013e70 con 0x7f1a5407e750 2024-05-04T02:48:30.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.015+0000 7f1a77c61640 1 -- 172.21.15.1:0/3201367644 --> [v2:172.21.15.107:6826/1723298539,v1:172.21.15.107:6827/1723298539] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f1a700c6290 con 0x7f1a5407e750 2024-05-04T02:48:30.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.015+0000 7f1a667fc640 1 -- 172.21.15.1:0/3201367644 <== osd.7 v2:172.21.15.107:6826/1723298539 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f1a700c6290 con 0x7f1a5407e750 2024-05-04T02:48:30.016 INFO:teuthology.orchestra.run.smithi001.stdout:{ 2024-05-04T02:48:30.016 INFO:teuthology.orchestra.run.smithi001.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-04T02:48:30.017 INFO:teuthology.orchestra.run.smithi001.stdout:} 2024-05-04T02:48:30.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.016+0000 7f1a77c61640 1 -- 172.21.15.1:0/3201367644 >> [v2:172.21.15.107:6826/1723298539,v1:172.21.15.107:6827/1723298539] conn(0x7f1a5407e750 msgr2=0x7f1a54080c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:30.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.016+0000 7f1a77c61640 1 --2- 172.21.15.1:0/3201367644 >> [v2:172.21.15.107:6826/1723298539,v1:172.21.15.107:6827/1723298539] conn(0x7f1a5407e750 0x7f1a54080c40 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:30.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.016+0000 7f1a77c61640 1 -- 172.21.15.1:0/3201367644 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f1a54076320 msgr2=0x7f1a54078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:30.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.016+0000 7f1a77c61640 1 --2- 172.21.15.1:0/3201367644 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f1a54076320 0x7f1a54078830 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1a70074a50 tx=0x7f1a6c009190 comp rx=0 tx=0).stop 2024-05-04T02:48:30.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.016+0000 7f1a77c61640 1 -- 172.21.15.1:0/3201367644 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1a7015fbc0 msgr2=0x7f1a7015ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:30.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.016+0000 7f1a77c61640 1 --2- 172.21.15.1:0/3201367644 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f1a7015fbc0 0x7f1a7015ee20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1a6800c700 tx=0x7f1a6800cbc0 comp rx=0 tx=0).stop 2024-05-04T02:48:30.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.016+0000 7f1a761fe640 1 -- 172.21.15.1:0/3201367644 reap_dead start 2024-05-04T02:48:30.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.016+0000 7f1a77c61640 1 -- 172.21.15.1:0/3201367644 shutdown_connections 2024-05-04T02:48:30.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.016+0000 7f1a77c61640 1 -- 172.21.15.1:0/3201367644 >> 172.21.15.1:0/3201367644 conn(0x7f1a700cf6c0 msgr2=0x7f1a70158af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:48:30.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.016+0000 7f1a77c61640 1 -- 172.21.15.1:0/3201367644 shutdown_connections 2024-05-04T02:48:30.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.016+0000 7f1a77c61640 1 -- 172.21.15.1:0/3201367644 wait complete. 2024-05-04T02:48:30.028 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-05-04T02:48:30.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.140+0000 7f4627f9d640 1 Processor -- start 2024-05-04T02:48:30.141 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.140+0000 7f4627f9d640 1 -- start start 2024-05-04T02:48:30.142 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.142+0000 7f4627f9d640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f46201546d0 0x7f462015ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:30.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.142+0000 7f4627f9d640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f462015d6e0 con 0x7f46200b5170 2024-05-04T02:48:30.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.142+0000 7f4627f9d640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46200ca190 con 0x7f46200cb4d0 2024-05-04T02:48:30.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.142+0000 7f4627f9d640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f462015b370 con 0x7f46201546d0 2024-05-04T02:48:30.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.142+0000 7f4625d39640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f46200b5170 0x7f46200702a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:37734/0 (socket says 172.21.15.1:37734) 2024-05-04T02:48:30.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.142+0000 7f4625d39640 1 -- 172.21.15.1:0/3121671810 learned_addr learned my addr 172.21.15.1:0/3121671810 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-05-04T02:48:30.143 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.142+0000 7f4625538640 1 --2- 172.21.15.1:0/3121671810 >> v2:172.21.15.107:3300/0 conn(0x7f46201546d0 0x7f462015ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:30.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.145+0000 7f4624d37640 1 -- 172.21.15.1:0/3121671810 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 182003837 0 0) 0x7f462015d6e0 con 0x7f46200b5170 2024-05-04T02:48:30.146 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.145+0000 7f4624d37640 1 -- 172.21.15.1:0/3121671810 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4608003520 con 0x7f46200b5170 2024-05-04T02:48:30.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.146+0000 7f4625538640 1 -- 172.21.15.1:0/3121671810 >> v1:172.21.15.107:6789/0 conn(0x7f46200cb4d0 legacy=0x7f4620164c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:48:30.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.146+0000 7f4625538640 1 -- 172.21.15.1:0/3121671810 >> v1:172.21.15.1:6789/0 conn(0x7f46200b5170 legacy=0x7f46200702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:30.147 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.146+0000 7f4625538640 1 -- 172.21.15.1:0/3121671810 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46200ca430 con 0x7f46201546d0 2024-05-04T02:48:30.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.149+0000 7f4625538640 1 --2- 172.21.15.1:0/3121671810 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f46201546d0 0x7f462015ae30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f46140097a0 tx=0x7f461402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b3ce9050ada4ea1 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:30.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.153+0000 7f4624d37640 1 -- 172.21.15.1:0/3121671810 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4614037070 con 0x7f46201546d0 2024-05-04T02:48:30.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.153+0000 7f4624d37640 1 -- 172.21.15.1:0/3121671810 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4614032440 con 0x7f46201546d0 2024-05-04T02:48:30.154 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.153+0000 7f4624d37640 1 -- 172.21.15.1:0/3121671810 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4614032810 con 0x7f46201546d0 2024-05-04T02:48:30.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.155+0000 7f4627f9d640 1 -- 172.21.15.1:0/3121671810 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f46201546d0 msgr2=0x7f462015ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:30.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.155+0000 7f4627f9d640 1 --2- 172.21.15.1:0/3121671810 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f46201546d0 0x7f462015ae30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f46140097a0 tx=0x7f461402a180 comp rx=0 tx=0).stop 2024-05-04T02:48:30.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.155+0000 7f4627f9d640 1 -- 172.21.15.1:0/3121671810 shutdown_connections 2024-05-04T02:48:30.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.155+0000 7f4627f9d640 1 --2- 172.21.15.1:0/3121671810 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f46201546d0 0x7f462015ae30 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:30.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.155+0000 7f4627f9d640 1 -- 172.21.15.1:0/3121671810 >> 172.21.15.1:0/3121671810 conn(0x7f46200cf6e0 msgr2=0x7f46200cfaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:48:30.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.155+0000 7f4627f9d640 1 -- 172.21.15.1:0/3121671810 shutdown_connections 2024-05-04T02:48:30.156 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.155+0000 7f4627f9d640 1 -- 172.21.15.1:0/3121671810 wait complete. 2024-05-04T02:48:30.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.157+0000 7f4627f9d640 1 Processor -- start 2024-05-04T02:48:30.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.157+0000 7f4627f9d640 1 -- start start 2024-05-04T02:48:30.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.158+0000 7f4627f9d640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f46200b5170 0x7f46201f43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:30.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.158+0000 7f4627f9d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f46200cb4d0 0x7f462014dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:30.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.158+0000 7f4627f9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f46201546d0 0x7f46201e3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:30.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.158+0000 7f4627f9d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f46200cacd0 con 0x7f46201546d0 2024-05-04T02:48:30.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.158+0000 7f4627f9d640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f46200ca9f0 con 0x7f46200cb4d0 2024-05-04T02:48:30.159 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.158+0000 7f4627f9d640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f46200cafb0 con 0x7f46200b5170 2024-05-04T02:48:30.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.159+0000 7f462653a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f46201546d0 0x7f46201e3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:30.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.159+0000 7f462653a640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f46201546d0 0x7f46201e3340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37950/0 (socket says 172.21.15.1:37950) 2024-05-04T02:48:30.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.159+0000 7f462653a640 1 -- 172.21.15.1:0/1058634913 learned_addr learned my addr 172.21.15.1:0/1058634913 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:48:30.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.159+0000 7f4625538640 1 --2- 172.21.15.1:0/1058634913 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f46200cb4d0 0x7f462014dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:30.160 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.160+0000 7f4625d39640 1 --2- 172.21.15.1:0/1058634913 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f46200b5170 0x7f46201f43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:30.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.163+0000 7f462653a640 1 -- 172.21.15.1:0/1058634913 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f46200b5170 msgr2=0x7f46201f43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:30.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.163+0000 7f462653a640 1 --2- 172.21.15.1:0/1058634913 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f46200b5170 0x7f46201f43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:30.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.163+0000 7f462653a640 1 -- 172.21.15.1:0/1058634913 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f46200cb4d0 msgr2=0x7f462014dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:30.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.163+0000 7f462653a640 1 --2- 172.21.15.1:0/1058634913 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f46200cb4d0 0x7f462014dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:30.164 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.163+0000 7f462653a640 1 -- 172.21.15.1:0/1058634913 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46201f48e0 con 0x7f46201546d0 2024-05-04T02:48:30.167 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.167+0000 7f462653a640 1 --2- 172.21.15.1:0/1058634913 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f46201546d0 0x7f46201e3340 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f461000ba10 tx=0x7f461000bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:30.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.170+0000 7f461e7fc640 1 -- 172.21.15.1:0/1058634913 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4610019070 con 0x7f46201546d0 2024-05-04T02:48:30.171 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.170+0000 7f461e7fc640 1 -- 172.21.15.1:0/1058634913 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f461000cb40 con 0x7f46201546d0 2024-05-04T02:48:30.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.170+0000 7f4627f9d640 1 -- 172.21.15.1:0/1058634913 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46201534c0 con 0x7f46201546d0 2024-05-04T02:48:30.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.171+0000 7f461e7fc640 1 -- 172.21.15.1:0/1058634913 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4610014440 con 0x7f46201546d0 2024-05-04T02:48:30.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.171+0000 7f4627f9d640 1 -- 172.21.15.1:0/1058634913 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46201f3e80 con 0x7f46201546d0 2024-05-04T02:48:30.172 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.171+0000 7f4627f9d640 1 -- 172.21.15.1:0/1058634913 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4620076740 con 0x7f46201546d0 2024-05-04T02:48:30.553 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.552+0000 7f461e7fc640 1 -- 172.21.15.1:0/1058634913 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f461001c070 con 0x7f46201546d0 2024-05-04T02:48:30.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.553+0000 7f461e7fc640 1 --2- 172.21.15.1:0/1058634913 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f460c076320 0x7f460c078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:30.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.553+0000 7f4625d39640 1 --2- 172.21.15.1:0/1058634913 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f460c076320 0x7f460c078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:30.554 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.554+0000 7f4625d39640 1 --2- 172.21.15.1:0/1058634913 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f460c076320 0x7f460c078830 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4618005880 tx=0x7f4618006aa0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:30.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.569+0000 7f461e7fc640 1 -- 172.21.15.1:0/1058634913 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5854+0+0 (secure 0 0 0) 0x7f4610015d20 con 0x7f46201546d0 2024-05-04T02:48:30.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.569+0000 7f461e7fc640 1 -- 172.21.15.1:0/1058634913 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4610060600 con 0x7f46201546d0 2024-05-04T02:48:30.767 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.766+0000 7f4627f9d640 1 -- 172.21.15.1:0/1058634913 --> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f46200c6e70 con 0x7f460c076320 2024-05-04T02:48:30.768 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.767+0000 7f461e7fc640 1 -- 172.21.15.1:0/1058634913 <== mgr.4108 v2:172.21.15.107:6800/3809222574 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f46200c6e70 con 0x7f460c076320 2024-05-04T02:48:30.768 INFO:teuthology.orchestra.run.smithi001.stderr:instructed osd(s) 7 to deep-scrub 2024-05-04T02:48:30.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.769+0000 7f4627f9d640 1 -- 172.21.15.1:0/1058634913 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f460c076320 msgr2=0x7f460c078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:30.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.769+0000 7f4627f9d640 1 --2- 172.21.15.1:0/1058634913 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f460c076320 0x7f460c078830 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4618005880 tx=0x7f4618006aa0 comp rx=0 tx=0).stop 2024-05-04T02:48:30.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.769+0000 7f4627f9d640 1 -- 172.21.15.1:0/1058634913 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f46201546d0 msgr2=0x7f46201e3340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:30.770 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.769+0000 7f4627f9d640 1 --2- 172.21.15.1:0/1058634913 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f46201546d0 0x7f46201e3340 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f461000ba10 tx=0x7f461000bed0 comp rx=0 tx=0).stop 2024-05-04T02:48:30.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.769+0000 7f4627f9d640 1 -- 172.21.15.1:0/1058634913 shutdown_connections 2024-05-04T02:48:30.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.769+0000 7f4627f9d640 1 --2- 172.21.15.1:0/1058634913 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f460c076320 0x7f460c078830 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:30.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.769+0000 7f4627f9d640 1 --2- 172.21.15.1:0/1058634913 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f46201546d0 0x7f46201e3340 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:30.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.769+0000 7f4627f9d640 1 --2- 172.21.15.1:0/1058634913 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f46200cb4d0 0x7f462014dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:30.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.769+0000 7f4627f9d640 1 --2- 172.21.15.1:0/1058634913 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f46200b5170 0x7f46201f43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:30.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.769+0000 7f4627f9d640 1 -- 172.21.15.1:0/1058634913 >> 172.21.15.1:0/1058634913 conn(0x7f46200cf6e0 msgr2=0x7f46200702a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:48:30.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.769+0000 7f4627f9d640 1 -- 172.21.15.1:0/1058634913 shutdown_connections 2024-05-04T02:48:30.771 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.769+0000 7f4627f9d640 1 -- 172.21.15.1:0/1058634913 wait complete. 2024-05-04T02:48:30.782 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-04T02:48:30.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.893+0000 7f8ff2b7d640 1 Processor -- start 2024-05-04T02:48:30.894 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.893+0000 7f8ff2b7d640 1 -- start start 2024-05-04T02:48:30.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.894+0000 7f8ff2b7d640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f8fec15d0f0 0x7f8fec06f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:30.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.894+0000 7f8ff2b7d640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fec0c3830 con 0x7f8fec1422c0 2024-05-04T02:48:30.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.894+0000 7f8ff2b7d640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fec0c3b10 con 0x7f8fec0cab70 2024-05-04T02:48:30.895 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.894+0000 7f8ff2b7d640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f8fec0c3df0 con 0x7f8fec15d0f0 2024-05-04T02:48:30.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.895+0000 7f8ff0919640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f8fec0cab70 0x7f8fec0ce590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.1:37458/0 (socket says 172.21.15.1:37458) 2024-05-04T02:48:30.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.895+0000 7f8ff0919640 1 -- 172.21.15.1:0/88409595 learned_addr learned my addr 172.21.15.1:0/88409595 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-05-04T02:48:30.896 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.895+0000 7f8ff111a640 1 --2- 172.21.15.1:0/88409595 >> v2:172.21.15.1:3300/0 conn(0x7f8fec15d0f0 0x7f8fec06f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:30.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.897+0000 7f8feb7fe640 1 -- 172.21.15.1:0/88409595 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2604218594 0 0) 0x7f8fec0c3b10 con 0x7f8fec0cab70 2024-05-04T02:48:30.898 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.897+0000 7f8feb7fe640 1 -- 172.21.15.1:0/88409595 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8fd8003520 con 0x7f8fec0cab70 2024-05-04T02:48:30.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.899+0000 7f8ff111a640 1 -- 172.21.15.1:0/88409595 >> v1:172.21.15.107:6789/0 conn(0x7f8fec0cab70 legacy=0x7f8fec0ce590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:30.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.899+0000 7f8ff111a640 1 -- 172.21.15.1:0/88409595 >> v1:172.21.15.1:6789/0 conn(0x7f8fec1422c0 legacy=0x7f8fec15c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:30.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.899+0000 7f8ff111a640 1 -- 172.21.15.1:0/88409595 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fec0c40d0 con 0x7f8fec15d0f0 2024-05-04T02:48:30.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.904+0000 7f8ff111a640 1 --2- 172.21.15.1:0/88409595 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8fec15d0f0 0x7f8fec06f030 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc0097a0 tx=0x7f8fdc02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6e612cd1a231f0e server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:30.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.909+0000 7f8feb7fe640 1 -- 172.21.15.1:0/88409595 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc037070 con 0x7f8fec15d0f0 2024-05-04T02:48:30.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.909+0000 7f8feb7fe640 1 -- 172.21.15.1:0/88409595 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fdc032440 con 0x7f8fec15d0f0 2024-05-04T02:48:30.910 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.909+0000 7f8feb7fe640 1 -- 172.21.15.1:0/88409595 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc032810 con 0x7f8fec15d0f0 2024-05-04T02:48:30.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.910+0000 7f8ff2b7d640 1 -- 172.21.15.1:0/88409595 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8fec15d0f0 msgr2=0x7f8fec06f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:30.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.910+0000 7f8ff2b7d640 1 --2- 172.21.15.1:0/88409595 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8fec15d0f0 0x7f8fec06f030 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc0097a0 tx=0x7f8fdc02a1a0 comp rx=0 tx=0).stop 2024-05-04T02:48:30.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.910+0000 7f8ff2b7d640 1 -- 172.21.15.1:0/88409595 shutdown_connections 2024-05-04T02:48:30.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.910+0000 7f8ff2b7d640 1 --2- 172.21.15.1:0/88409595 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8fec15d0f0 0x7f8fec06f030 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:30.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.910+0000 7f8ff2b7d640 1 -- 172.21.15.1:0/88409595 >> 172.21.15.1:0/88409595 conn(0x7f8fec0725c0 msgr2=0x7f8fec0729d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:48:30.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.910+0000 7f8ff2b7d640 1 -- 172.21.15.1:0/88409595 shutdown_connections 2024-05-04T02:48:30.911 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.910+0000 7f8ff2b7d640 1 -- 172.21.15.1:0/88409595 wait complete. 2024-05-04T02:48:30.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.912+0000 7f8ff2b7d640 1 Processor -- start 2024-05-04T02:48:30.913 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.912+0000 7f8ff2b7d640 1 -- start start 2024-05-04T02:48:30.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.913+0000 7f8ff2b7d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8fec0cab70 0x7f8fec1602b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:30.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.913+0000 7f8ff2b7d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8fec1422c0 0x7f8fec1f2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:30.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.913+0000 7f8ff2b7d640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8fec15d0f0 0x7f8fec15b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:30.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.913+0000 7f8ff2b7d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f8fec0cee20 con 0x7f8fec0cab70 2024-05-04T02:48:30.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.913+0000 7f8ff2b7d640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f8fec0ceca0 con 0x7f8fec1422c0 2024-05-04T02:48:30.914 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.913+0000 7f8ff2b7d640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f8fec06f570 con 0x7f8fec15d0f0 2024-05-04T02:48:30.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.914+0000 7f8ff0919640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8fec0cab70 0x7f8fec1602b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:30.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.914+0000 7f8febfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8fec1422c0 0x7f8fec1f2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:30.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.914+0000 7f8ff111a640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8fec15d0f0 0x7f8fec15b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:30.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.914+0000 7f8ff0919640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8fec0cab70 0x7f8fec1602b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37970/0 (socket says 172.21.15.1:37970) 2024-05-04T02:48:30.915 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.914+0000 7f8ff0919640 1 -- 172.21.15.1:0/1582868947 learned_addr learned my addr 172.21.15.1:0/1582868947 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:48:30.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.918+0000 7f8ff0919640 1 -- 172.21.15.1:0/1582868947 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8fec15d0f0 msgr2=0x7f8fec15b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:30.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.918+0000 7f8ff0919640 1 --2- 172.21.15.1:0/1582868947 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8fec15d0f0 0x7f8fec15b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:30.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.918+0000 7f8ff0919640 1 -- 172.21.15.1:0/1582868947 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8fec1422c0 msgr2=0x7f8fec1f2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:30.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.918+0000 7f8ff0919640 1 --2- 172.21.15.1:0/1582868947 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8fec1422c0 0x7f8fec1f2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:30.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.918+0000 7f8ff0919640 1 -- 172.21.15.1:0/1582868947 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fec1f2160 con 0x7f8fec0cab70 2024-05-04T02:48:30.919 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.918+0000 7f8febfff640 1 --2- 172.21.15.1:0/1582868947 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8fec1422c0 0x7f8fec1f2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-04T02:48:30.921 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.921+0000 7f8ff0919640 1 --2- 172.21.15.1:0/1582868947 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8fec0cab70 0x7f8fec1602b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8fe400cb00 tx=0x7f8fe400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:30.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.925+0000 7f8fe97fa640 1 -- 172.21.15.1:0/1582868947 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe4017070 con 0x7f8fec0cab70 2024-05-04T02:48:30.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.925+0000 7f8fe97fa640 1 -- 172.21.15.1:0/1582868947 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fe400acc0 con 0x7f8fec0cab70 2024-05-04T02:48:30.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.925+0000 7f8fe97fa640 1 -- 172.21.15.1:0/1582868947 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe4012640 con 0x7f8fec0cab70 2024-05-04T02:48:30.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.925+0000 7f8ff2b7d640 1 -- 172.21.15.1:0/1582868947 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fec0c7d50 con 0x7f8fec0cab70 2024-05-04T02:48:30.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.925+0000 7f8ff2b7d640 1 -- 172.21.15.1:0/1582868947 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fec1f23d0 con 0x7f8fec0cab70 2024-05-04T02:48:30.927 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.926+0000 7f8ff2b7d640 1 -- 172.21.15.1:0/1582868947 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fec076740 con 0x7f8fec0cab70 2024-05-04T02:48:30.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.949+0000 7f8fe97fa640 1 -- 172.21.15.1:0/1582868947 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8fe401a070 con 0x7f8fec0cab70 2024-05-04T02:48:30.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.949+0000 7f8fe97fa640 1 --2- 172.21.15.1:0/1582868947 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f8fcc076320 0x7f8fcc078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:30.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.950+0000 7f8febfff640 1 --2- 172.21.15.1:0/1582868947 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f8fcc076320 0x7f8fcc078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:30.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:30.950+0000 7f8febfff640 1 --2- 172.21.15.1:0/1582868947 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f8fcc076320 0x7f8fcc078830 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8fd4000c00 tx=0x7f8fd4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:31.245 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:31.244+0000 7f8fe97fa640 1 -- 172.21.15.1:0/1582868947 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5854+0+0 (secure 0 0 0) 0x7f8fe405ccb0 con 0x7f8fec0cab70 2024-05-04T02:48:31.246 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:31.245+0000 7f8fe97fa640 1 -- 172.21.15.1:0/1582868947 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8fe4021020 con 0x7f8fec0cab70 2024-05-04T02:48:31.437 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:31.436+0000 7f8ff2b7d640 1 -- 172.21.15.1:0/1582868947 --> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8fec0ce630 con 0x7f8fcc076320 2024-05-04T02:48:31.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:31.443+0000 7f8fe97fa640 1 -- 172.21.15.1:0/1582868947 <== mgr.4108 v2:172.21.15.107:6800/3809222574 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251543 (secure 0 0 0) 0x7f8fec0ce630 con 0x7f8fcc076320 2024-05-04T02:48:31.448 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:48:31.449 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-05-04T02:48:31.450 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:31.446+0000 7f8ff2b7d640 1 -- 172.21.15.1:0/1582868947 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f8fcc076320 msgr2=0x7f8fcc078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:31.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:31.446+0000 7f8ff2b7d640 1 --2- 172.21.15.1:0/1582868947 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f8fcc076320 0x7f8fcc078830 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8fd4000c00 tx=0x7f8fd4009040 comp rx=0 tx=0).stop 2024-05-04T02:48:31.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:31.446+0000 7f8ff2b7d640 1 -- 172.21.15.1:0/1582868947 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8fec0cab70 msgr2=0x7f8fec1602b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:31.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:31.446+0000 7f8ff2b7d640 1 --2- 172.21.15.1:0/1582868947 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8fec0cab70 0x7f8fec1602b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8fe400cb00 tx=0x7f8fe400a060 comp rx=0 tx=0).stop 2024-05-04T02:48:31.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:31.446+0000 7f8ff2b7d640 1 -- 172.21.15.1:0/1582868947 shutdown_connections 2024-05-04T02:48:31.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:31.446+0000 7f8ff2b7d640 1 --2- 172.21.15.1:0/1582868947 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f8fcc076320 0x7f8fcc078830 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:31.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:31.446+0000 7f8ff2b7d640 1 --2- 172.21.15.1:0/1582868947 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f8fec15d0f0 0x7f8fec15b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:31.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:31.446+0000 7f8ff2b7d640 1 --2- 172.21.15.1:0/1582868947 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8fec1422c0 0x7f8fec1f2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:31.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:31.446+0000 7f8ff2b7d640 1 --2- 172.21.15.1:0/1582868947 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f8fec0cab70 0x7f8fec1602b0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:31.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:31.446+0000 7f8ff2b7d640 1 -- 172.21.15.1:0/1582868947 >> 172.21.15.1:0/1582868947 conn(0x7f8fec0725c0 msgr2=0x7f8fec0cdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:48:31.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:31.446+0000 7f8ff2b7d640 1 -- 172.21.15.1:0/1582868947 shutdown_connections 2024-05-04T02:48:31.451 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:31.446+0000 7f8ff2b7d640 1 -- 172.21.15.1:0/1582868947 wait complete. 2024-05-04T02:48:31.459 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":874,"stamp":"2024-05-04T02:48:29.516589+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":38132101,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":907,"num_read_kb":952,"num_write":14342,"num_write_kb":337392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13323,"ondisk_log_size":13323,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":361760,"kb_used_data":49888,"kb_used_omap":12,"kb_used_meta":311795,"kb_avail":754612960,"statfs":{"total":773094113280,"available":772723671040,"internally_reserved":0,"allocated":51085312,"data_stored":77038642,"data_compressed":7561304,"data_compressed_allocated":11436032,"data_compressed_original":38748160,"omap_allocated":12752,"internal_metadata":319278640},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1138,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003132"},"pg_stats":[{"pgid":"3.3f","version":"25'66","reported_seq":90,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.486840+0000","last_change":"2024-05-04T02:20:53.380646+0000","last_active":"2024-05-04T02:48:13.486840+0000","last_peered":"2024-05-04T02:48:13.486840+0000","last_clean":"2024-05-04T02:48:13.486840+0000","last_became_active":"2024-05-04T02:20:53.380291+0000","last_became_peered":"2024-05-04T02:20:53.380291+0000","last_unstale":"2024-05-04T02:48:13.486840+0000","last_undegraded":"2024-05-04T02:48:13.486840+0000","last_fullsized":"2024-05-04T02:48:13.486840+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":3382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3e","version":"25'82","reported_seq":117,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.493890+0000","last_change":"2024-05-04T02:20:15.299265+0000","last_active":"2024-05-04T02:48:13.493890+0000","last_peered":"2024-05-04T02:48:13.493890+0000","last_clean":"2024-05-04T02:48:13.493890+0000","last_became_active":"2024-05-04T02:20:15.298956+0000","last_became_peered":"2024-05-04T02:20:15.298956+0000","last_unstale":"2024-05-04T02:48:13.493890+0000","last_undegraded":"2024-05-04T02:48:13.493890+0000","last_fullsized":"2024-05-04T02:48:13.493890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":2093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"25'86","reported_seq":121,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.712179+0000","last_change":"2024-05-04T02:20:15.297447+0000","last_active":"2024-05-04T02:48:13.712179+0000","last_peered":"2024-05-04T02:48:13.712179+0000","last_clean":"2024-05-04T02:48:13.712179+0000","last_became_active":"2024-05-04T02:20:15.297150+0000","last_became_peered":"2024-05-04T02:20:15.297150+0000","last_unstale":"2024-05-04T02:48:13.712179+0000","last_undegraded":"2024-05-04T02:48:13.712179+0000","last_fullsized":"2024-05-04T02:48:13.712179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":4094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"25'50","reported_seq":85,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.527675+0000","last_change":"2024-05-04T02:20:15.301427+0000","last_active":"2024-05-04T02:48:13.527675+0000","last_peered":"2024-05-04T02:48:13.527675+0000","last_clean":"2024-05-04T02:48:13.527675+0000","last_became_active":"2024-05-04T02:20:15.301113+0000","last_became_peered":"2024-05-04T02:20:15.301113+0000","last_unstale":"2024-05-04T02:48:13.527675+0000","last_undegraded":"2024-05-04T02:48:13.527675+0000","last_fullsized":"2024-05-04T02:48:13.527675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:06:48.185771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":1582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"25'54","reported_seq":86,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.604371+0000","last_change":"2024-05-04T02:20:15.297817+0000","last_active":"2024-05-04T02:48:13.604371+0000","last_peered":"2024-05-04T02:48:13.604371+0000","last_clean":"2024-05-04T02:48:13.604371+0000","last_became_active":"2024-05-04T02:20:15.297511+0000","last_became_peered":"2024-05-04T02:20:15.297511+0000","last_unstale":"2024-05-04T02:48:13.604371+0000","last_undegraded":"2024-05-04T02:48:13.604371+0000","last_fullsized":"2024-05-04T02:48:13.604371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:33:31.416768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":3466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"25'86","reported_seq":118,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.524090+0000","last_change":"2024-05-04T02:20:15.306853+0000","last_active":"2024-05-04T02:48:13.524090+0000","last_peered":"2024-05-04T02:48:13.524090+0000","last_clean":"2024-05-04T02:48:13.524090+0000","last_became_active":"2024-05-04T02:20:15.306537+0000","last_became_peered":"2024-05-04T02:20:15.306537+0000","last_unstale":"2024-05-04T02:48:13.524090+0000","last_undegraded":"2024-05-04T02:48:13.524090+0000","last_fullsized":"2024-05-04T02:48:13.524090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:35:15.732585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":4281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"25'87","reported_seq":119,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.615849+0000","last_change":"2024-05-04T02:20:15.299499+0000","last_active":"2024-05-04T02:48:13.615849+0000","last_peered":"2024-05-04T02:48:13.615849+0000","last_clean":"2024-05-04T02:48:13.615849+0000","last_became_active":"2024-05-04T02:20:15.299177+0000","last_became_peered":"2024-05-04T02:20:15.299177+0000","last_unstale":"2024-05-04T02:48:13.615849+0000","last_undegraded":"2024-05-04T02:48:13.615849+0000","last_fullsized":"2024-05-04T02:48:13.615849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:13:25.600467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75,"num_write_kb":3160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"25'62","reported_seq":95,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.572807+0000","last_change":"2024-05-04T02:20:15.306964+0000","last_active":"2024-05-04T02:48:13.572807+0000","last_peered":"2024-05-04T02:48:13.572807+0000","last_clean":"2024-05-04T02:48:13.572807+0000","last_became_active":"2024-05-04T02:20:15.306663+0000","last_became_peered":"2024-05-04T02:20:15.306663+0000","last_unstale":"2024-05-04T02:48:13.572807+0000","last_undegraded":"2024-05-04T02:48:13.572807+0000","last_fullsized":"2024-05-04T02:48:13.572807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":4413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"25'72","reported_seq":104,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.608102+0000","last_change":"2024-05-04T02:20:15.303354+0000","last_active":"2024-05-04T02:48:13.608102+0000","last_peered":"2024-05-04T02:48:13.608102+0000","last_clean":"2024-05-04T02:48:13.608102+0000","last_became_active":"2024-05-04T02:20:15.303055+0000","last_became_peered":"2024-05-04T02:20:15.303055+0000","last_unstale":"2024-05-04T02:48:13.608102+0000","last_undegraded":"2024-05-04T02:48:13.608102+0000","last_fullsized":"2024-05-04T02:48:13.608102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:22:30.839899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":5860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"25'70","reported_seq":102,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.625591+0000","last_change":"2024-05-04T02:20:15.307433+0000","last_active":"2024-05-04T02:48:13.625591+0000","last_peered":"2024-05-04T02:48:13.625591+0000","last_clean":"2024-05-04T02:48:13.625591+0000","last_became_active":"2024-05-04T02:20:15.307124+0000","last_became_peered":"2024-05-04T02:20:15.307124+0000","last_unstale":"2024-05-04T02:48:13.625591+0000","last_undegraded":"2024-05-04T02:48:13.625591+0000","last_fullsized":"2024-05-04T02:48:13.625591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:22:04.903746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":2059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"25'65","reported_seq":97,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.618354+0000","last_change":"2024-05-04T02:20:15.306714+0000","last_active":"2024-05-04T02:48:13.618354+0000","last_peered":"2024-05-04T02:48:13.618354+0000","last_clean":"2024-05-04T02:48:13.618354+0000","last_became_active":"2024-05-04T02:20:15.306409+0000","last_became_peered":"2024-05-04T02:20:15.306409+0000","last_unstale":"2024-05-04T02:48:13.618354+0000","last_undegraded":"2024-05-04T02:48:13.618354+0000","last_fullsized":"2024-05-04T02:48:13.618354+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:51:58.828664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"25'50","reported_seq":82,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.521353+0000","last_change":"2024-05-04T02:20:15.296940+0000","last_active":"2024-05-04T02:48:13.521353+0000","last_peered":"2024-05-04T02:48:13.521353+0000","last_clean":"2024-05-04T02:48:13.521353+0000","last_became_active":"2024-05-04T02:20:15.296640+0000","last_became_peered":"2024-05-04T02:20:15.296640+0000","last_unstale":"2024-05-04T02:48:13.521353+0000","last_undegraded":"2024-05-04T02:48:13.521353+0000","last_fullsized":"2024-05-04T02:48:13.521353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:25:44.598454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":2327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"25'84","reported_seq":117,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.573568+0000","last_change":"2024-05-04T02:20:15.294287+0000","last_active":"2024-05-04T02:48:13.573568+0000","last_peered":"2024-05-04T02:48:13.573568+0000","last_clean":"2024-05-04T02:48:13.573568+0000","last_became_active":"2024-05-04T02:20:15.293909+0000","last_became_peered":"2024-05-04T02:20:15.293909+0000","last_unstale":"2024-05-04T02:48:13.573568+0000","last_undegraded":"2024-05-04T02:48:13.573568+0000","last_fullsized":"2024-05-04T02:48:13.573568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":6748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"25'70","reported_seq":112,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:27.133338+0000","last_change":"2024-05-04T02:48:27.133362+0000","last_active":"2024-05-04T02:48:27.133338+0000","last_peered":"2024-05-04T02:48:27.133338+0000","last_clean":"2024-05-04T02:48:27.133338+0000","last_became_active":"2024-05-04T02:20:15.293550+0000","last_became_peered":"2024-05-04T02:20:15.293550+0000","last_unstale":"2024-05-04T02:48:27.133338+0000","last_undegraded":"2024-05-04T02:48:27.133338+0000","last_fullsized":"2024-05-04T02:48:27.133338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'70","last_scrub_stamp":"2024-05-04T02:48:27.133257+0000","last_deep_scrub":"25'70","last_deep_scrub_stamp":"2024-05-04T02:48:27.133257+0000","last_clean_scrub_stamp":"2024-05-04T02:48:27.133257+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:28:58.351012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":6468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"25'94","reported_seq":128,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:16.206798+0000","last_change":"2024-05-04T02:20:15.306005+0000","last_active":"2024-05-04T02:48:16.206798+0000","last_peered":"2024-05-04T02:48:16.206798+0000","last_clean":"2024-05-04T02:48:16.206798+0000","last_became_active":"2024-05-04T02:20:15.305549+0000","last_became_peered":"2024-05-04T02:20:15.305549+0000","last_unstale":"2024-05-04T02:48:16.206798+0000","last_undegraded":"2024-05-04T02:48:16.206798+0000","last_fullsized":"2024-05-04T02:48:16.206798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":3628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"25'80","reported_seq":113,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.527476+0000","last_change":"2024-05-04T02:20:15.305322+0000","last_active":"2024-05-04T02:48:13.527476+0000","last_peered":"2024-05-04T02:48:13.527476+0000","last_clean":"2024-05-04T02:48:13.527476+0000","last_became_active":"2024-05-04T02:20:15.301515+0000","last_became_peered":"2024-05-04T02:20:15.301515+0000","last_unstale":"2024-05-04T02:48:13.527476+0000","last_undegraded":"2024-05-04T02:48:13.527476+0000","last_fullsized":"2024-05-04T02:48:13.527476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:10:21.048301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":4426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"25'78","reported_seq":111,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.529144+0000","last_change":"2024-05-04T02:20:15.301042+0000","last_active":"2024-05-04T02:48:13.529144+0000","last_peered":"2024-05-04T02:48:13.529144+0000","last_clean":"2024-05-04T02:48:13.529144+0000","last_became_active":"2024-05-04T02:20:15.300707+0000","last_became_peered":"2024-05-04T02:20:15.300707+0000","last_unstale":"2024-05-04T02:48:13.529144+0000","last_undegraded":"2024-05-04T02:48:13.529144+0000","last_fullsized":"2024-05-04T02:48:13.529144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:36:19.111702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":4257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"25'87","reported_seq":121,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:17.138134+0000","last_change":"2024-05-04T02:20:15.292059+0000","last_active":"2024-05-04T02:48:17.138134+0000","last_peered":"2024-05-04T02:48:17.138134+0000","last_clean":"2024-05-04T02:48:17.138134+0000","last_became_active":"2024-05-04T02:20:15.291766+0000","last_became_peered":"2024-05-04T02:20:15.291766+0000","last_unstale":"2024-05-04T02:48:17.138134+0000","last_undegraded":"2024-05-04T02:48:17.138134+0000","last_fullsized":"2024-05-04T02:48:17.138134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":5570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"25'65","reported_seq":98,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.604751+0000","last_change":"2024-05-04T02:20:15.297861+0000","last_active":"2024-05-04T02:48:13.604751+0000","last_peered":"2024-05-04T02:48:13.604751+0000","last_clean":"2024-05-04T02:48:13.604751+0000","last_became_active":"2024-05-04T02:20:15.297568+0000","last_became_peered":"2024-05-04T02:20:15.297568+0000","last_unstale":"2024-05-04T02:48:13.604751+0000","last_undegraded":"2024-05-04T02:48:13.604751+0000","last_fullsized":"2024-05-04T02:48:13.604751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:52:52.278453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":4387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"25'89","reported_seq":122,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.619958+0000","last_change":"2024-05-04T02:20:15.303036+0000","last_active":"2024-05-04T02:48:13.619958+0000","last_peered":"2024-05-04T02:48:13.619958+0000","last_clean":"2024-05-04T02:48:13.619958+0000","last_became_active":"2024-05-04T02:20:15.302743+0000","last_became_peered":"2024-05-04T02:20:15.302743+0000","last_unstale":"2024-05-04T02:48:13.619958+0000","last_undegraded":"2024-05-04T02:48:13.619958+0000","last_fullsized":"2024-05-04T02:48:13.619958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:58:55.400048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75,"num_write_kb":8052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"25'110","reported_seq":144,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.710661+0000","last_change":"2024-05-04T02:20:15.300987+0000","last_active":"2024-05-04T02:48:13.710661+0000","last_peered":"2024-05-04T02:48:13.710661+0000","last_clean":"2024-05-04T02:48:13.710661+0000","last_became_active":"2024-05-04T02:20:15.300709+0000","last_became_peered":"2024-05-04T02:20:15.300709+0000","last_unstale":"2024-05-04T02:48:13.710661+0000","last_undegraded":"2024-05-04T02:48:13.710661+0000","last_fullsized":"2024-05-04T02:48:13.710661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":9218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"25'64","reported_seq":97,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.528965+0000","last_change":"2024-05-04T02:20:15.301545+0000","last_active":"2024-05-04T02:48:13.528965+0000","last_peered":"2024-05-04T02:48:13.528965+0000","last_clean":"2024-05-04T02:48:13.528965+0000","last_became_active":"2024-05-04T02:20:15.300848+0000","last_became_peered":"2024-05-04T02:20:15.300848+0000","last_unstale":"2024-05-04T02:48:13.528965+0000","last_undegraded":"2024-05-04T02:48:13.528965+0000","last_fullsized":"2024-05-04T02:48:13.528965+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:26:17.650165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":2229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"25'75","reported_seq":109,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.570032+0000","last_change":"2024-05-04T02:20:15.302188+0000","last_active":"2024-05-04T02:48:13.570032+0000","last_peered":"2024-05-04T02:48:13.570032+0000","last_clean":"2024-05-04T02:48:13.570032+0000","last_became_active":"2024-05-04T02:20:15.301879+0000","last_became_peered":"2024-05-04T02:20:15.301879+0000","last_unstale":"2024-05-04T02:48:13.570032+0000","last_undegraded":"2024-05-04T02:48:13.570032+0000","last_fullsized":"2024-05-04T02:48:13.570032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":4046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"25'55","reported_seq":78,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.488472+0000","last_change":"2024-05-04T02:20:53.115860+0000","last_active":"2024-05-04T02:48:13.488472+0000","last_peered":"2024-05-04T02:48:13.488472+0000","last_clean":"2024-05-04T02:48:13.488472+0000","last_became_active":"2024-05-04T02:20:53.115499+0000","last_became_peered":"2024-05-04T02:20:53.115499+0000","last_unstale":"2024-05-04T02:48:13.488472+0000","last_undegraded":"2024-05-04T02:48:13.488472+0000","last_fullsized":"2024-05-04T02:48:13.488472+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":4120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"25'84","reported_seq":119,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:27.143894+0000","last_change":"2024-05-04T02:20:15.301659+0000","last_active":"2024-05-04T02:48:27.143894+0000","last_peered":"2024-05-04T02:48:27.143894+0000","last_clean":"2024-05-04T02:48:27.143894+0000","last_became_active":"2024-05-04T02:20:15.301363+0000","last_became_peered":"2024-05-04T02:20:15.301363+0000","last_unstale":"2024-05-04T02:48:27.143894+0000","last_undegraded":"2024-05-04T02:48:27.143894+0000","last_fullsized":"2024-05-04T02:48:27.143894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":4697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"25'75","reported_seq":109,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.625858+0000","last_change":"2024-05-04T02:20:15.295843+0000","last_active":"2024-05-04T02:48:13.625858+0000","last_peered":"2024-05-04T02:48:13.625858+0000","last_clean":"2024-05-04T02:48:13.625858+0000","last_became_active":"2024-05-04T02:20:15.295577+0000","last_became_peered":"2024-05-04T02:20:15.295577+0000","last_unstale":"2024-05-04T02:48:13.625858+0000","last_undegraded":"2024-05-04T02:48:13.625858+0000","last_fullsized":"2024-05-04T02:48:13.625858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:23:25.157473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":3524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"25'87","reported_seq":122,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:25.380398+0000","last_change":"2024-05-04T02:20:15.299661+0000","last_active":"2024-05-04T02:48:25.380398+0000","last_peered":"2024-05-04T02:48:25.380398+0000","last_clean":"2024-05-04T02:48:25.380398+0000","last_became_active":"2024-05-04T02:20:15.299230+0000","last_became_peered":"2024-05-04T02:20:15.299230+0000","last_unstale":"2024-05-04T02:48:25.380398+0000","last_undegraded":"2024-05-04T02:48:25.380398+0000","last_fullsized":"2024-05-04T02:48:25.380398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":4545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"25'51","reported_seq":86,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:27.143775+0000","last_change":"2024-05-04T02:20:15.302719+0000","last_active":"2024-05-04T02:48:27.143775+0000","last_peered":"2024-05-04T02:48:27.143775+0000","last_clean":"2024-05-04T02:48:27.143775+0000","last_became_active":"2024-05-04T02:20:15.302456+0000","last_became_peered":"2024-05-04T02:20:15.302456+0000","last_unstale":"2024-05-04T02:48:27.143775+0000","last_undegraded":"2024-05-04T02:48:27.143775+0000","last_fullsized":"2024-05-04T02:48:27.143775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":7049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"25'65","reported_seq":100,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.677511+0000","last_change":"2024-05-04T02:20:15.296567+0000","last_active":"2024-05-04T02:48:13.677511+0000","last_peered":"2024-05-04T02:48:13.677511+0000","last_clean":"2024-05-04T02:48:13.677511+0000","last_became_active":"2024-05-04T02:20:15.296235+0000","last_became_peered":"2024-05-04T02:20:15.296235+0000","last_unstale":"2024-05-04T02:48:13.677511+0000","last_undegraded":"2024-05-04T02:48:13.677511+0000","last_fullsized":"2024-05-04T02:48:13.677511+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":6740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"25'135","reported_seq":159,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.490375+0000","last_change":"2024-05-04T02:20:53.116445+0000","last_active":"2024-05-04T02:48:13.490375+0000","last_peered":"2024-05-04T02:48:13.490375+0000","last_clean":"2024-05-04T02:48:13.490375+0000","last_became_active":"2024-05-04T02:20:53.116069+0000","last_became_peered":"2024-05-04T02:20:53.116069+0000","last_unstale":"2024-05-04T02:48:13.490375+0000","last_undegraded":"2024-05-04T02:48:13.490375+0000","last_fullsized":"2024-05-04T02:48:13.490375+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":7251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"25'77","reported_seq":112,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.491205+0000","last_change":"2024-05-04T02:20:15.301739+0000","last_active":"2024-05-04T02:48:13.491205+0000","last_peered":"2024-05-04T02:48:13.491205+0000","last_clean":"2024-05-04T02:48:13.491205+0000","last_became_active":"2024-05-04T02:20:15.301424+0000","last_became_peered":"2024-05-04T02:20:15.301424+0000","last_unstale":"2024-05-04T02:48:13.491205+0000","last_undegraded":"2024-05-04T02:48:13.491205+0000","last_fullsized":"2024-05-04T02:48:13.491205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":8003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"25'86","reported_seq":120,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.616633+0000","last_change":"2024-05-04T02:20:15.293189+0000","last_active":"2024-05-04T02:48:13.616633+0000","last_peered":"2024-05-04T02:48:13.616633+0000","last_clean":"2024-05-04T02:48:13.616633+0000","last_became_active":"2024-05-04T02:20:15.292840+0000","last_became_peered":"2024-05-04T02:20:15.292840+0000","last_unstale":"2024-05-04T02:48:13.616633+0000","last_undegraded":"2024-05-04T02:48:13.616633+0000","last_fullsized":"2024-05-04T02:48:13.616633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:01:57.617230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":6858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"25'66","reported_seq":98,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.520113+0000","last_change":"2024-05-04T02:20:15.297718+0000","last_active":"2024-05-04T02:48:13.520113+0000","last_peered":"2024-05-04T02:48:13.520113+0000","last_clean":"2024-05-04T02:48:13.520113+0000","last_became_active":"2024-05-04T02:20:15.297415+0000","last_became_peered":"2024-05-04T02:20:15.297415+0000","last_unstale":"2024-05-04T02:48:13.520113+0000","last_undegraded":"2024-05-04T02:48:13.520113+0000","last_fullsized":"2024-05-04T02:48:13.520113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:03:46.054307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":6149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"25'712","reported_seq":747,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:08.361906+0000","last_change":"2024-05-04T02:20:14.290469+0000","last_active":"2024-05-04T02:48:08.361906+0000","last_peered":"2024-05-04T02:48:08.361906+0000","last_clean":"2024-05-04T02:48:08.361906+0000","last_became_active":"2024-05-04T02:20:14.289651+0000","last_became_peered":"2024-05-04T02:20:14.289651+0000","last_unstale":"2024-05-04T02:48:08.361906+0000","last_undegraded":"2024-05-04T02:48:08.361906+0000","last_fullsized":"2024-05-04T02:48:08.361906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":712,"log_dups_size":0,"ondisk_log_size":712,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":710,"num_write_kb":4451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"25'81","reported_seq":114,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.713295+0000","last_change":"2024-05-04T02:20:15.305933+0000","last_active":"2024-05-04T02:48:13.713295+0000","last_peered":"2024-05-04T02:48:13.713295+0000","last_clean":"2024-05-04T02:48:13.713295+0000","last_became_active":"2024-05-04T02:20:15.305597+0000","last_became_peered":"2024-05-04T02:20:15.305597+0000","last_unstale":"2024-05-04T02:48:13.713295+0000","last_undegraded":"2024-05-04T02:48:13.713295+0000","last_fullsized":"2024-05-04T02:48:13.713295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":5085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"25'609","reported_seq":643,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:03.909161+0000","last_change":"2024-05-04T02:20:14.359094+0000","last_active":"2024-05-04T02:48:03.909161+0000","last_peered":"2024-05-04T02:48:03.909161+0000","last_clean":"2024-05-04T02:48:03.909161+0000","last_became_active":"2024-05-04T02:20:14.358394+0000","last_became_peered":"2024-05-04T02:20:14.358394+0000","last_unstale":"2024-05-04T02:48:03.909161+0000","last_undegraded":"2024-05-04T02:48:03.909161+0000","last_fullsized":"2024-05-04T02:48:03.909161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":609,"log_dups_size":0,"ondisk_log_size":609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:57:26.889464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":604,"num_write_kb":4430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"25'3","reported_seq":38,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:10.614055+0000","last_change":"2024-05-04T02:20:14.356259+0000","last_active":"2024-05-04T02:48:10.614055+0000","last_peered":"2024-05-04T02:48:10.614055+0000","last_clean":"2024-05-04T02:48:10.614055+0000","last_became_active":"2024-05-04T02:20:14.355988+0000","last_became_peered":"2024-05-04T02:20:14.355988+0000","last_unstale":"2024-05-04T02:48:10.614055+0000","last_undegraded":"2024-05-04T02:48:10.614055+0000","last_fullsized":"2024-05-04T02:48:10.614055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"25'73","reported_seq":106,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.568925+0000","last_change":"2024-05-04T02:20:15.295517+0000","last_active":"2024-05-04T02:48:13.568925+0000","last_peered":"2024-05-04T02:48:13.568925+0000","last_clean":"2024-05-04T02:48:13.568925+0000","last_became_active":"2024-05-04T02:20:15.295222+0000","last_became_peered":"2024-05-04T02:20:15.295222+0000","last_unstale":"2024-05-04T02:48:13.568925+0000","last_undegraded":"2024-05-04T02:48:13.568925+0000","last_fullsized":"2024-05-04T02:48:13.568925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":4655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"25'4","reported_seq":38,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:47:56.631136+0000","last_change":"2024-05-04T02:20:14.291543+0000","last_active":"2024-05-04T02:47:56.631136+0000","last_peered":"2024-05-04T02:47:56.631136+0000","last_clean":"2024-05-04T02:47:56.631136+0000","last_became_active":"2024-05-04T02:20:14.290893+0000","last_became_peered":"2024-05-04T02:20:14.290893+0000","last_unstale":"2024-05-04T02:47:56.631136+0000","last_undegraded":"2024-05-04T02:47:56.631136+0000","last_fullsized":"2024-05-04T02:47:56.631136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:57:10.542857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"25'86","reported_seq":119,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.494175+0000","last_change":"2024-05-04T02:20:15.291991+0000","last_active":"2024-05-04T02:48:13.494175+0000","last_peered":"2024-05-04T02:48:13.494175+0000","last_clean":"2024-05-04T02:48:13.494175+0000","last_became_active":"2024-05-04T02:20:15.291704+0000","last_became_peered":"2024-05-04T02:20:15.291704+0000","last_unstale":"2024-05-04T02:48:13.494175+0000","last_undegraded":"2024-05-04T02:48:13.494175+0000","last_fullsized":"2024-05-04T02:48:13.494175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":4969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"25'5","reported_seq":39,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:12.312177+0000","last_change":"2024-05-04T02:20:14.359336+0000","last_active":"2024-05-04T02:48:12.312177+0000","last_peered":"2024-05-04T02:48:12.312177+0000","last_clean":"2024-05-04T02:48:12.312177+0000","last_became_active":"2024-05-04T02:20:14.357940+0000","last_became_peered":"2024-05-04T02:20:14.357940+0000","last_unstale":"2024-05-04T02:48:12.312177+0000","last_undegraded":"2024-05-04T02:48:12.312177+0000","last_fullsized":"2024-05-04T02:48:12.312177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:48:24.055870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"25'92","reported_seq":124,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.529166+0000","last_change":"2024-05-04T02:20:15.301852+0000","last_active":"2024-05-04T02:48:13.529166+0000","last_peered":"2024-05-04T02:48:13.529166+0000","last_clean":"2024-05-04T02:48:13.529166+0000","last_became_active":"2024-05-04T02:20:15.300374+0000","last_became_peered":"2024-05-04T02:20:15.300374+0000","last_unstale":"2024-05-04T02:48:13.529166+0000","last_undegraded":"2024-05-04T02:48:13.529166+0000","last_fullsized":"2024-05-04T02:48:13.529166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:16:20.585860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":5924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"25'5","reported_seq":39,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:10.615618+0000","last_change":"2024-05-04T02:20:14.358952+0000","last_active":"2024-05-04T02:48:10.615618+0000","last_peered":"2024-05-04T02:48:10.615618+0000","last_clean":"2024-05-04T02:48:10.615618+0000","last_became_active":"2024-05-04T02:20:14.358625+0000","last_became_peered":"2024-05-04T02:20:14.358625+0000","last_unstale":"2024-05-04T02:48:10.615618+0000","last_undegraded":"2024-05-04T02:48:10.615618+0000","last_fullsized":"2024-05-04T02:48:10.615618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:52:21.185127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"25'59","reported_seq":92,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.676168+0000","last_change":"2024-05-04T02:20:15.307242+0000","last_active":"2024-05-04T02:48:13.676168+0000","last_peered":"2024-05-04T02:48:13.676168+0000","last_clean":"2024-05-04T02:48:13.676168+0000","last_became_active":"2024-05-04T02:20:15.306572+0000","last_became_peered":"2024-05-04T02:20:15.306572+0000","last_unstale":"2024-05-04T02:48:13.676168+0000","last_undegraded":"2024-05-04T02:48:13.676168+0000","last_fullsized":"2024-05-04T02:48:13.676168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":3639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"25'609","reported_seq":644,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.827256+0000","last_change":"2024-05-04T02:20:14.292979+0000","last_active":"2024-05-04T02:48:13.827256+0000","last_peered":"2024-05-04T02:48:13.827256+0000","last_clean":"2024-05-04T02:48:13.827256+0000","last_became_active":"2024-05-04T02:20:14.292564+0000","last_became_peered":"2024-05-04T02:20:14.292564+0000","last_unstale":"2024-05-04T02:48:13.827256+0000","last_undegraded":"2024-05-04T02:48:13.827256+0000","last_fullsized":"2024-05-04T02:48:13.827256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":609,"log_dups_size":0,"ondisk_log_size":609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":607,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"25'71","reported_seq":104,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.528110+0000","last_change":"2024-05-04T02:20:15.298392+0000","last_active":"2024-05-04T02:48:13.528110+0000","last_peered":"2024-05-04T02:48:13.528110+0000","last_clean":"2024-05-04T02:48:13.528110+0000","last_became_active":"2024-05-04T02:20:15.298018+0000","last_became_peered":"2024-05-04T02:20:15.298018+0000","last_unstale":"2024-05-04T02:48:13.528110+0000","last_undegraded":"2024-05-04T02:48:13.528110+0000","last_fullsized":"2024-05-04T02:48:13.528110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:42:57.398678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":3497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"25'830","reported_seq":865,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:17.567151+0000","last_change":"2024-05-04T02:20:14.360237+0000","last_active":"2024-05-04T02:48:17.567151+0000","last_peered":"2024-05-04T02:48:17.567151+0000","last_clean":"2024-05-04T02:48:17.567151+0000","last_became_active":"2024-05-04T02:20:14.359886+0000","last_became_peered":"2024-05-04T02:20:14.359886+0000","last_unstale":"2024-05-04T02:48:17.567151+0000","last_undegraded":"2024-05-04T02:48:17.567151+0000","last_fullsized":"2024-05-04T02:48:17.567151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":830,"log_dups_size":0,"ondisk_log_size":830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:34:37.703735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":827,"num_write_kb":4536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"25'64","reported_seq":101,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.606294+0000","last_change":"2024-05-04T02:20:53.117045+0000","last_active":"2024-05-04T02:48:13.606294+0000","last_peered":"2024-05-04T02:48:13.606294+0000","last_clean":"2024-05-04T02:48:13.606294+0000","last_became_active":"2024-05-04T02:20:53.116761+0000","last_became_peered":"2024-05-04T02:20:53.116761+0000","last_unstale":"2024-05-04T02:48:13.606294+0000","last_undegraded":"2024-05-04T02:48:13.606294+0000","last_fullsized":"2024-05-04T02:48:13.606294+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:30:15.675774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":3872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"25'11","reported_seq":55,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:25.067875+0000","last_change":"2024-05-04T02:48:25.067902+0000","last_active":"2024-05-04T02:48:25.067875+0000","last_peered":"2024-05-04T02:48:25.067875+0000","last_clean":"2024-05-04T02:48:25.067875+0000","last_became_active":"2024-05-04T02:20:14.274604+0000","last_became_peered":"2024-05-04T02:20:14.274604+0000","last_unstale":"2024-05-04T02:48:25.067875+0000","last_undegraded":"2024-05-04T02:48:25.067875+0000","last_fullsized":"2024-05-04T02:48:25.067875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'11","last_scrub_stamp":"2024-05-04T02:48:25.067792+0000","last_deep_scrub":"25'11","last_deep_scrub_stamp":"2024-05-04T02:48:25.067792+0000","last_clean_scrub_stamp":"2024-05-04T02:48:25.067792+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:38:57.277782+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"25'79","reported_seq":113,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:18.943794+0000","last_change":"2024-05-04T02:20:15.300355+0000","last_active":"2024-05-04T02:48:18.943794+0000","last_peered":"2024-05-04T02:48:18.943794+0000","last_clean":"2024-05-04T02:48:18.943794+0000","last_became_active":"2024-05-04T02:20:15.300052+0000","last_became_peered":"2024-05-04T02:20:15.300052+0000","last_unstale":"2024-05-04T02:48:18.943794+0000","last_undegraded":"2024-05-04T02:48:18.943794+0000","last_fullsized":"2024-05-04T02:48:18.943794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":4963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"25'6","reported_seq":41,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.822797+0000","last_change":"2024-05-04T02:20:14.290125+0000","last_active":"2024-05-04T02:48:13.822797+0000","last_peered":"2024-05-04T02:48:13.822797+0000","last_clean":"2024-05-04T02:48:13.822797+0000","last_became_active":"2024-05-04T02:20:14.289826+0000","last_became_peered":"2024-05-04T02:20:14.289826+0000","last_unstale":"2024-05-04T02:48:13.822797+0000","last_undegraded":"2024-05-04T02:48:13.822797+0000","last_fullsized":"2024-05-04T02:48:13.822797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:39:23.112031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"25'96","reported_seq":129,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.608379+0000","last_change":"2024-05-04T02:20:15.303257+0000","last_active":"2024-05-04T02:48:13.608379+0000","last_peered":"2024-05-04T02:48:13.608379+0000","last_clean":"2024-05-04T02:48:13.608379+0000","last_became_active":"2024-05-04T02:20:15.302963+0000","last_became_peered":"2024-05-04T02:20:15.302963+0000","last_unstale":"2024-05-04T02:48:13.608379+0000","last_undegraded":"2024-05-04T02:48:13.608379+0000","last_fullsized":"2024-05-04T02:48:13.608379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:05:46.729556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":14780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"25'5","reported_seq":40,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:01.665098+0000","last_change":"2024-05-04T02:20:14.359226+0000","last_active":"2024-05-04T02:48:01.665098+0000","last_peered":"2024-05-04T02:48:01.665098+0000","last_clean":"2024-05-04T02:48:01.665098+0000","last_became_active":"2024-05-04T02:20:14.358494+0000","last_became_peered":"2024-05-04T02:20:14.358494+0000","last_unstale":"2024-05-04T02:48:01.665098+0000","last_undegraded":"2024-05-04T02:48:01.665098+0000","last_fullsized":"2024-05-04T02:48:01.665098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:43:19.283728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"25'51","reported_seq":84,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.610357+0000","last_change":"2024-05-04T02:20:15.294689+0000","last_active":"2024-05-04T02:48:13.610357+0000","last_peered":"2024-05-04T02:48:13.610357+0000","last_clean":"2024-05-04T02:48:13.610357+0000","last_became_active":"2024-05-04T02:20:15.294400+0000","last_became_peered":"2024-05-04T02:20:15.294400+0000","last_unstale":"2024-05-04T02:48:13.610357+0000","last_undegraded":"2024-05-04T02:48:13.610357+0000","last_fullsized":"2024-05-04T02:48:13.610357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:22:33.019301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":2930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"25'16","reported_seq":60,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:26.997820+0000","last_change":"2024-05-04T02:48:26.997886+0000","last_active":"2024-05-04T02:48:26.997820+0000","last_peered":"2024-05-04T02:48:26.997820+0000","last_clean":"2024-05-04T02:48:26.997820+0000","last_became_active":"2024-05-04T02:20:14.269238+0000","last_became_peered":"2024-05-04T02:20:14.269238+0000","last_unstale":"2024-05-04T02:48:26.997820+0000","last_undegraded":"2024-05-04T02:48:26.997820+0000","last_fullsized":"2024-05-04T02:48:26.997820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'16","last_scrub_stamp":"2024-05-04T02:48:26.997726+0000","last_deep_scrub":"25'16","last_deep_scrub_stamp":"2024-05-04T02:48:26.997726+0000","last_clean_scrub_stamp":"2024-05-04T02:48:26.997726+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:21:24.249644+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"25'64","reported_seq":97,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.606107+0000","last_change":"2024-05-04T02:20:15.304355+0000","last_active":"2024-05-04T02:48:13.606107+0000","last_peered":"2024-05-04T02:48:13.606107+0000","last_clean":"2024-05-04T02:48:13.606107+0000","last_became_active":"2024-05-04T02:20:15.302736+0000","last_became_peered":"2024-05-04T02:20:15.302736+0000","last_unstale":"2024-05-04T02:48:13.606107+0000","last_undegraded":"2024-05-04T02:48:13.606107+0000","last_fullsized":"2024-05-04T02:48:13.606107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:35:15.732585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":3572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'5","reported_seq":40,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:10.617362+0000","last_change":"2024-05-04T02:20:14.272218+0000","last_active":"2024-05-04T02:48:10.617362+0000","last_peered":"2024-05-04T02:48:10.617362+0000","last_clean":"2024-05-04T02:48:10.617362+0000","last_became_active":"2024-05-04T02:20:14.271883+0000","last_became_peered":"2024-05-04T02:20:14.271883+0000","last_unstale":"2024-05-04T02:48:10.617362+0000","last_undegraded":"2024-05-04T02:48:10.617362+0000","last_fullsized":"2024-05-04T02:48:10.617362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:32:55.463882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"25'35","reported_seq":68,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.605988+0000","last_change":"2024-05-04T02:20:15.302202+0000","last_active":"2024-05-04T02:48:13.605988+0000","last_peered":"2024-05-04T02:48:13.605988+0000","last_clean":"2024-05-04T02:48:13.605988+0000","last_became_active":"2024-05-04T02:20:15.301880+0000","last_became_peered":"2024-05-04T02:20:15.301880+0000","last_unstale":"2024-05-04T02:48:13.605988+0000","last_undegraded":"2024-05-04T02:48:13.605988+0000","last_fullsized":"2024-05-04T02:48:13.605988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:32:43.559282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":1775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'4","reported_seq":40,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:10.616686+0000","last_change":"2024-05-04T02:20:14.292107+0000","last_active":"2024-05-04T02:48:10.616686+0000","last_peered":"2024-05-04T02:48:10.616686+0000","last_clean":"2024-05-04T02:48:10.616686+0000","last_became_active":"2024-05-04T02:20:14.290132+0000","last_became_peered":"2024-05-04T02:20:14.290132+0000","last_unstale":"2024-05-04T02:48:10.616686+0000","last_undegraded":"2024-05-04T02:48:10.616686+0000","last_fullsized":"2024-05-04T02:48:10.616686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"25'56","reported_seq":89,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.607231+0000","last_change":"2024-05-04T02:20:15.302140+0000","last_active":"2024-05-04T02:48:13.607231+0000","last_peered":"2024-05-04T02:48:13.607231+0000","last_clean":"2024-05-04T02:48:13.607231+0000","last_became_active":"2024-05-04T02:20:15.301798+0000","last_became_peered":"2024-05-04T02:20:15.301798+0000","last_unstale":"2024-05-04T02:48:13.607231+0000","last_undegraded":"2024-05-04T02:48:13.607231+0000","last_fullsized":"2024-05-04T02:48:13.607231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:20:28.069809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":3906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":37,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:47:16.200866+0000","last_change":"2024-05-04T02:20:14.274965+0000","last_active":"2024-05-04T02:47:16.200866+0000","last_peered":"2024-05-04T02:47:16.200866+0000","last_clean":"2024-05-04T02:47:16.200866+0000","last_became_active":"2024-05-04T02:20:14.274609+0000","last_became_peered":"2024-05-04T02:20:14.274609+0000","last_unstale":"2024-05-04T02:47:16.200866+0000","last_undegraded":"2024-05-04T02:47:16.200866+0000","last_fullsized":"2024-05-04T02:47:16.200866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"25'84","reported_seq":117,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.520405+0000","last_change":"2024-05-04T02:20:15.305486+0000","last_active":"2024-05-04T02:48:13.520405+0000","last_peered":"2024-05-04T02:48:13.520405+0000","last_clean":"2024-05-04T02:48:13.520405+0000","last_became_active":"2024-05-04T02:20:15.301880+0000","last_became_peered":"2024-05-04T02:20:15.301880+0000","last_unstale":"2024-05-04T02:48:13.520405+0000","last_undegraded":"2024-05-04T02:48:13.520405+0000","last_fullsized":"2024-05-04T02:48:13.520405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:13:25.600467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70,"num_write_kb":6433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"25'2","reported_seq":38,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:47:58.844523+0000","last_change":"2024-05-04T02:20:14.288834+0000","last_active":"2024-05-04T02:47:58.844523+0000","last_peered":"2024-05-04T02:47:58.844523+0000","last_clean":"2024-05-04T02:47:58.844523+0000","last_became_active":"2024-05-04T02:20:14.287992+0000","last_became_peered":"2024-05-04T02:20:14.287992+0000","last_unstale":"2024-05-04T02:47:58.844523+0000","last_undegraded":"2024-05-04T02:47:58.844523+0000","last_fullsized":"2024-05-04T02:47:58.844523+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"25'61","reported_seq":94,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.608504+0000","last_change":"2024-05-04T02:20:15.303880+0000","last_active":"2024-05-04T02:48:13.608504+0000","last_peered":"2024-05-04T02:48:13.608504+0000","last_clean":"2024-05-04T02:48:13.608504+0000","last_became_active":"2024-05-04T02:20:15.303601+0000","last_became_peered":"2024-05-04T02:20:15.303601+0000","last_unstale":"2024-05-04T02:48:13.608504+0000","last_undegraded":"2024-05-04T02:48:13.608504+0000","last_fullsized":"2024-05-04T02:48:13.608504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:26:17.650165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":2391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":132,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:46:07.109143+0000","last_change":"2024-05-04T02:20:02.920020+0000","last_active":"2024-05-04T02:46:07.109143+0000","last_peered":"2024-05-04T02:46:07.109143+0000","last_clean":"2024-05-04T02:46:07.109143+0000","last_became_active":"2024-05-04T02:20:02.918859+0000","last_became_peered":"2024-05-04T02:20:02.918859+0000","last_unstale":"2024-05-04T02:46:07.109143+0000","last_undegraded":"2024-05-04T02:46:07.109143+0000","last_fullsized":"2024-05-04T02:46:07.109143+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:00.162760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:00.162760+0000","last_clean_scrub_stamp":"2024-05-04T02:20:00.162760+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:25:04.934922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"25'1","reported_seq":37,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:47:22.179461+0000","last_change":"2024-05-04T02:20:14.290136+0000","last_active":"2024-05-04T02:47:22.179461+0000","last_peered":"2024-05-04T02:47:22.179461+0000","last_clean":"2024-05-04T02:47:22.179461+0000","last_became_active":"2024-05-04T02:20:14.289597+0000","last_became_peered":"2024-05-04T02:20:14.289597+0000","last_unstale":"2024-05-04T02:47:22.179461+0000","last_undegraded":"2024-05-04T02:47:22.179461+0000","last_fullsized":"2024-05-04T02:47:22.179461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:43:19.283728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"25'46","reported_seq":81,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.564974+0000","last_change":"2024-05-04T02:20:15.306971+0000","last_active":"2024-05-04T02:48:13.564974+0000","last_peered":"2024-05-04T02:48:13.564974+0000","last_clean":"2024-05-04T02:48:13.564974+0000","last_became_active":"2024-05-04T02:20:15.306640+0000","last_became_peered":"2024-05-04T02:20:15.306640+0000","last_unstale":"2024-05-04T02:48:13.564974+0000","last_undegraded":"2024-05-04T02:48:13.564974+0000","last_fullsized":"2024-05-04T02:48:13.564974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":2916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"25'363","reported_seq":400,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:17.567109+0000","last_change":"2024-05-04T02:20:14.291379+0000","last_active":"2024-05-04T02:48:17.567109+0000","last_peered":"2024-05-04T02:48:17.567109+0000","last_clean":"2024-05-04T02:48:17.567109+0000","last_became_active":"2024-05-04T02:20:14.291044+0000","last_became_peered":"2024-05-04T02:20:14.291044+0000","last_unstale":"2024-05-04T02:48:17.567109+0000","last_undegraded":"2024-05-04T02:48:17.567109+0000","last_fullsized":"2024-05-04T02:48:17.567109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:58:54.286093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3804637,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":357,"num_write_kb":3904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"25'52","reported_seq":87,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.712251+0000","last_change":"2024-05-04T02:20:15.305870+0000","last_active":"2024-05-04T02:48:13.712251+0000","last_peered":"2024-05-04T02:48:13.712251+0000","last_clean":"2024-05-04T02:48:13.712251+0000","last_became_active":"2024-05-04T02:20:15.305512+0000","last_became_peered":"2024-05-04T02:20:15.305512+0000","last_unstale":"2024-05-04T02:48:13.712251+0000","last_undegraded":"2024-05-04T02:48:13.712251+0000","last_fullsized":"2024-05-04T02:48:13.712251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":2895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"25'849","reported_seq":1727,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.671275+0000","last_change":"2024-05-04T02:20:14.287676+0000","last_active":"2024-05-04T02:48:13.671275+0000","last_peered":"2024-05-04T02:48:13.671275+0000","last_clean":"2024-05-04T02:48:13.671275+0000","last_became_active":"2024-05-04T02:20:14.287335+0000","last_became_peered":"2024-05-04T02:20:14.287335+0000","last_unstale":"2024-05-04T02:48:13.671275+0000","last_undegraded":"2024-05-04T02:48:13.671275+0000","last_fullsized":"2024-05-04T02:48:13.671275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":849,"log_dups_size":0,"ondisk_log_size":849,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":181194,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":841,"num_read_kb":897,"num_write":844,"num_write_kb":899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"25'71","reported_seq":107,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:16.206748+0000","last_change":"2024-05-04T02:20:15.297316+0000","last_active":"2024-05-04T02:48:16.206748+0000","last_peered":"2024-05-04T02:48:16.206748+0000","last_clean":"2024-05-04T02:48:16.206748+0000","last_became_active":"2024-05-04T02:20:15.297010+0000","last_became_peered":"2024-05-04T02:20:15.297010+0000","last_unstale":"2024-05-04T02:48:16.206748+0000","last_undegraded":"2024-05-04T02:48:16.206748+0000","last_fullsized":"2024-05-04T02:48:16.206748+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":1942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"25'5","reported_seq":41,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:01.666970+0000","last_change":"2024-05-04T02:20:14.292802+0000","last_active":"2024-05-04T02:48:01.666970+0000","last_peered":"2024-05-04T02:48:01.666970+0000","last_clean":"2024-05-04T02:48:01.666970+0000","last_became_active":"2024-05-04T02:20:14.292595+0000","last_became_peered":"2024-05-04T02:20:14.292595+0000","last_unstale":"2024-05-04T02:48:01.666970+0000","last_undegraded":"2024-05-04T02:48:01.666970+0000","last_fullsized":"2024-05-04T02:48:01.666970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:31:25.521717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"25'85","reported_seq":119,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.517744+0000","last_change":"2024-05-04T02:20:15.296358+0000","last_active":"2024-05-04T02:48:13.517744+0000","last_peered":"2024-05-04T02:48:13.517744+0000","last_clean":"2024-05-04T02:48:13.517744+0000","last_became_active":"2024-05-04T02:20:15.296075+0000","last_became_peered":"2024-05-04T02:20:15.296075+0000","last_unstale":"2024-05-04T02:48:13.517744+0000","last_undegraded":"2024-05-04T02:48:13.517744+0000","last_fullsized":"2024-05-04T02:48:13.517744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:30:50.014584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":6268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"25'3","reported_seq":48,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:26.023169+0000","last_change":"2024-05-04T02:48:26.023195+0000","last_active":"2024-05-04T02:48:26.023169+0000","last_peered":"2024-05-04T02:48:26.023169+0000","last_clean":"2024-05-04T02:48:26.023169+0000","last_became_active":"2024-05-04T02:20:14.253513+0000","last_became_peered":"2024-05-04T02:20:14.253513+0000","last_unstale":"2024-05-04T02:48:26.023169+0000","last_undegraded":"2024-05-04T02:48:26.023169+0000","last_fullsized":"2024-05-04T02:48:26.023169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'3","last_scrub_stamp":"2024-05-04T02:48:26.023077+0000","last_deep_scrub":"25'3","last_deep_scrub_stamp":"2024-05-04T02:48:26.023077+0000","last_clean_scrub_stamp":"2024-05-04T02:48:26.023077+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:40:14.800077+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"25'68","reported_seq":102,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.524589+0000","last_change":"2024-05-04T02:20:15.300702+0000","last_active":"2024-05-04T02:48:13.524589+0000","last_peered":"2024-05-04T02:48:13.524589+0000","last_clean":"2024-05-04T02:48:13.524589+0000","last_became_active":"2024-05-04T02:20:15.300251+0000","last_became_peered":"2024-05-04T02:20:15.300251+0000","last_unstale":"2024-05-04T02:48:13.524589+0000","last_undegraded":"2024-05-04T02:48:13.524589+0000","last_fullsized":"2024-05-04T02:48:13.524589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:05:46.729556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":2367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"25'2","reported_seq":38,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:08.375514+0000","last_change":"2024-05-04T02:20:14.291304+0000","last_active":"2024-05-04T02:48:08.375514+0000","last_peered":"2024-05-04T02:48:08.375514+0000","last_clean":"2024-05-04T02:48:08.375514+0000","last_became_active":"2024-05-04T02:20:14.290952+0000","last_became_peered":"2024-05-04T02:20:14.290952+0000","last_unstale":"2024-05-04T02:48:08.375514+0000","last_undegraded":"2024-05-04T02:48:08.375514+0000","last_fullsized":"2024-05-04T02:48:08.375514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:15:55.478496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"25'68","reported_seq":103,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.491288+0000","last_change":"2024-05-04T02:20:15.296895+0000","last_active":"2024-05-04T02:48:13.491288+0000","last_peered":"2024-05-04T02:48:13.491288+0000","last_clean":"2024-05-04T02:48:13.491288+0000","last_became_active":"2024-05-04T02:20:15.296562+0000","last_became_peered":"2024-05-04T02:20:15.296562+0000","last_unstale":"2024-05-04T02:48:13.491288+0000","last_undegraded":"2024-05-04T02:48:13.491288+0000","last_fullsized":"2024-05-04T02:48:13.491288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":2660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"25'1353","reported_seq":1390,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:25.380219+0000","last_change":"2024-05-04T02:20:14.358920+0000","last_active":"2024-05-04T02:48:25.380219+0000","last_peered":"2024-05-04T02:48:25.380219+0000","last_clean":"2024-05-04T02:48:25.380219+0000","last_became_active":"2024-05-04T02:20:14.358621+0000","last_became_peered":"2024-05-04T02:20:14.358621+0000","last_unstale":"2024-05-04T02:48:25.380219+0000","last_undegraded":"2024-05-04T02:48:25.380219+0000","last_fullsized":"2024-05-04T02:48:25.380219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":1353,"log_dups_size":0,"ondisk_log_size":1353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3394,"num_write_kb":1205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"25'74","reported_seq":109,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:27.143747+0000","last_change":"2024-05-04T02:20:15.299992+0000","last_active":"2024-05-04T02:48:27.143747+0000","last_peered":"2024-05-04T02:48:27.143747+0000","last_clean":"2024-05-04T02:48:27.143747+0000","last_became_active":"2024-05-04T02:20:15.299678+0000","last_became_peered":"2024-05-04T02:20:15.299678+0000","last_unstale":"2024-05-04T02:48:27.143747+0000","last_undegraded":"2024-05-04T02:48:27.143747+0000","last_fullsized":"2024-05-04T02:48:27.143747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":5134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"25'6","reported_seq":42,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.710431+0000","last_change":"2024-05-04T02:20:14.359479+0000","last_active":"2024-05-04T02:48:13.710431+0000","last_peered":"2024-05-04T02:48:13.710431+0000","last_clean":"2024-05-04T02:48:13.710431+0000","last_became_active":"2024-05-04T02:20:14.358524+0000","last_became_peered":"2024-05-04T02:20:14.358524+0000","last_unstale":"2024-05-04T02:48:13.710431+0000","last_undegraded":"2024-05-04T02:48:13.710431+0000","last_fullsized":"2024-05-04T02:48:13.710431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:40:36.439339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"25'73","reported_seq":116,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:28.131878+0000","last_change":"2024-05-04T02:48:28.131878+0000","last_active":"2024-05-04T02:48:28.131878+0000","last_peered":"2024-05-04T02:48:28.131878+0000","last_clean":"2024-05-04T02:48:28.131878+0000","last_became_active":"2024-05-04T02:20:15.293602+0000","last_became_peered":"2024-05-04T02:20:15.293602+0000","last_unstale":"2024-05-04T02:48:28.131878+0000","last_undegraded":"2024-05-04T02:48:28.131878+0000","last_fullsized":"2024-05-04T02:48:28.131878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'73","last_scrub_stamp":"2024-05-04T02:48:28.131693+0000","last_deep_scrub":"25'73","last_deep_scrub_stamp":"2024-05-04T02:48:28.131693+0000","last_clean_scrub_stamp":"2024-05-04T02:48:28.131693+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:33:47.960266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":2324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"25'6","reported_seq":42,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:10.613767+0000","last_change":"2024-05-04T02:20:14.291515+0000","last_active":"2024-05-04T02:48:10.613767+0000","last_peered":"2024-05-04T02:48:10.613767+0000","last_clean":"2024-05-04T02:48:10.613767+0000","last_became_active":"2024-05-04T02:20:14.291068+0000","last_became_peered":"2024-05-04T02:20:14.291068+0000","last_unstale":"2024-05-04T02:48:10.613767+0000","last_undegraded":"2024-05-04T02:48:10.613767+0000","last_fullsized":"2024-05-04T02:48:10.613767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:57:10.542857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"25'72","reported_seq":106,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.517438+0000","last_change":"2024-05-04T02:20:15.247885+0000","last_active":"2024-05-04T02:48:13.517438+0000","last_peered":"2024-05-04T02:48:13.517438+0000","last_clean":"2024-05-04T02:48:13.517438+0000","last_became_active":"2024-05-04T02:20:15.247583+0000","last_became_peered":"2024-05-04T02:20:15.247583+0000","last_unstale":"2024-05-04T02:48:13.517438+0000","last_undegraded":"2024-05-04T02:48:13.517438+0000","last_fullsized":"2024-05-04T02:48:13.517438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:39:16.967443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":6637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"25'3","reported_seq":40,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:25.380220+0000","last_change":"2024-05-04T02:20:14.289690+0000","last_active":"2024-05-04T02:48:25.380220+0000","last_peered":"2024-05-04T02:48:25.380220+0000","last_clean":"2024-05-04T02:48:25.380220+0000","last_became_active":"2024-05-04T02:20:14.289360+0000","last_became_peered":"2024-05-04T02:20:14.289360+0000","last_unstale":"2024-05-04T02:48:25.380220+0000","last_undegraded":"2024-05-04T02:48:25.380220+0000","last_fullsized":"2024-05-04T02:48:25.380220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"25'64","reported_seq":99,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:27.143737+0000","last_change":"2024-05-04T02:20:15.296623+0000","last_active":"2024-05-04T02:48:27.143737+0000","last_peered":"2024-05-04T02:48:27.143737+0000","last_clean":"2024-05-04T02:48:27.143737+0000","last_became_active":"2024-05-04T02:20:15.296330+0000","last_became_peered":"2024-05-04T02:20:15.296330+0000","last_unstale":"2024-05-04T02:48:27.143737+0000","last_undegraded":"2024-05-04T02:48:27.143737+0000","last_fullsized":"2024-05-04T02:48:27.143737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":4339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":37,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:25.380225+0000","last_change":"2024-05-04T02:20:14.289113+0000","last_active":"2024-05-04T02:48:25.380225+0000","last_peered":"2024-05-04T02:48:25.380225+0000","last_clean":"2024-05-04T02:48:25.380225+0000","last_became_active":"2024-05-04T02:20:14.288769+0000","last_became_peered":"2024-05-04T02:20:14.288769+0000","last_unstale":"2024-05-04T02:48:25.380225+0000","last_undegraded":"2024-05-04T02:48:25.380225+0000","last_fullsized":"2024-05-04T02:48:25.380225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"25'89","reported_seq":123,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.573912+0000","last_change":"2024-05-04T02:20:15.295428+0000","last_active":"2024-05-04T02:48:13.573912+0000","last_peered":"2024-05-04T02:48:13.573912+0000","last_clean":"2024-05-04T02:48:13.573912+0000","last_became_active":"2024-05-04T02:20:15.295128+0000","last_became_peered":"2024-05-04T02:20:15.295128+0000","last_unstale":"2024-05-04T02:48:13.573912+0000","last_undegraded":"2024-05-04T02:48:13.573912+0000","last_fullsized":"2024-05-04T02:48:13.573912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":2421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"25'555","reported_seq":590,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:04.961493+0000","last_change":"2024-05-04T02:20:14.294321+0000","last_active":"2024-05-04T02:48:04.961493+0000","last_peered":"2024-05-04T02:48:04.961493+0000","last_clean":"2024-05-04T02:48:04.961493+0000","last_became_active":"2024-05-04T02:20:14.293862+0000","last_became_peered":"2024-05-04T02:20:14.293862+0000","last_unstale":"2024-05-04T02:48:04.961493+0000","last_undegraded":"2024-05-04T02:48:04.961493+0000","last_fullsized":"2024-05-04T02:48:04.961493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":555,"log_dups_size":0,"ondisk_log_size":555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:39:17.000649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":4370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"25'73","reported_seq":106,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.623295+0000","last_change":"2024-05-04T02:20:15.296883+0000","last_active":"2024-05-04T02:48:13.623295+0000","last_peered":"2024-05-04T02:48:13.623295+0000","last_clean":"2024-05-04T02:48:13.623295+0000","last_became_active":"2024-05-04T02:20:15.296544+0000","last_became_peered":"2024-05-04T02:20:15.296544+0000","last_unstale":"2024-05-04T02:48:13.623295+0000","last_undegraded":"2024-05-04T02:48:13.623295+0000","last_fullsized":"2024-05-04T02:48:13.623295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:52:22.299082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":1715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"25'89","reported_seq":121,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.527857+0000","last_change":"2024-05-04T02:20:15.306263+0000","last_active":"2024-05-04T02:48:13.527857+0000","last_peered":"2024-05-04T02:48:13.527857+0000","last_clean":"2024-05-04T02:48:13.527857+0000","last_became_active":"2024-05-04T02:20:15.305941+0000","last_became_peered":"2024-05-04T02:20:15.305941+0000","last_unstale":"2024-05-04T02:48:13.527857+0000","last_undegraded":"2024-05-04T02:48:13.527857+0000","last_fullsized":"2024-05-04T02:48:13.527857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:33:31.416768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":3718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"25'4","reported_seq":38,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:04.954375+0000","last_change":"2024-05-04T02:20:14.294204+0000","last_active":"2024-05-04T02:48:04.954375+0000","last_peered":"2024-05-04T02:48:04.954375+0000","last_clean":"2024-05-04T02:48:04.954375+0000","last_became_active":"2024-05-04T02:20:14.293788+0000","last_became_peered":"2024-05-04T02:20:14.293788+0000","last_unstale":"2024-05-04T02:48:04.954375+0000","last_undegraded":"2024-05-04T02:48:04.954375+0000","last_fullsized":"2024-05-04T02:48:04.954375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:52:21.185127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"25'52","reported_seq":84,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.527627+0000","last_change":"2024-05-04T02:20:15.306357+0000","last_active":"2024-05-04T02:48:13.527627+0000","last_peered":"2024-05-04T02:48:13.527627+0000","last_clean":"2024-05-04T02:48:13.527627+0000","last_became_active":"2024-05-04T02:20:15.306050+0000","last_became_peered":"2024-05-04T02:20:15.306050+0000","last_unstale":"2024-05-04T02:48:13.527627+0000","last_undegraded":"2024-05-04T02:48:13.527627+0000","last_fullsized":"2024-05-04T02:48:13.527627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:39:18.114604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":4810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"25'1264","reported_seq":1298,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:08.375745+0000","last_change":"2024-05-04T02:20:14.357677+0000","last_active":"2024-05-04T02:48:08.375745+0000","last_peered":"2024-05-04T02:48:08.375745+0000","last_clean":"2024-05-04T02:48:08.375745+0000","last_became_active":"2024-05-04T02:20:14.357368+0000","last_became_peered":"2024-05-04T02:20:14.357368+0000","last_unstale":"2024-05-04T02:48:08.375745+0000","last_undegraded":"2024-05-04T02:48:08.375745+0000","last_fullsized":"2024-05-04T02:48:08.375745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":1264,"log_dups_size":0,"ondisk_log_size":1264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:10:19.934346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1255,"num_write_kb":8902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"25'94","reported_seq":134,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.712991+0000","last_change":"2024-05-04T02:20:53.107201+0000","last_active":"2024-05-04T02:48:13.712991+0000","last_peered":"2024-05-04T02:48:13.712991+0000","last_clean":"2024-05-04T02:48:13.712991+0000","last_became_active":"2024-05-04T02:20:53.106867+0000","last_became_peered":"2024-05-04T02:20:53.106867+0000","last_unstale":"2024-05-04T02:48:13.712991+0000","last_undegraded":"2024-05-04T02:48:13.712991+0000","last_fullsized":"2024-05-04T02:48:13.712991+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":7905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"25'740","reported_seq":778,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:17.199474+0000","last_change":"2024-05-04T02:20:14.291632+0000","last_active":"2024-05-04T02:48:17.199474+0000","last_peered":"2024-05-04T02:48:17.199474+0000","last_clean":"2024-05-04T02:48:17.199474+0000","last_became_active":"2024-05-04T02:20:14.291331+0000","last_became_peered":"2024-05-04T02:20:14.291331+0000","last_unstale":"2024-05-04T02:48:17.199474+0000","last_undegraded":"2024-05-04T02:48:17.199474+0000","last_fullsized":"2024-05-04T02:48:17.199474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:12.997037+0000","last_clean_scrub_stamp":"2024-05-04T02:20:12.997037+0000","objects_scrubbed":0,"log_size":740,"log_dups_size":0,"ondisk_log_size":740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":732,"num_write_kb":4528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"25'50","reported_seq":86,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:17.199449+0000","last_change":"2024-05-04T02:20:15.294309+0000","last_active":"2024-05-04T02:48:17.199449+0000","last_peered":"2024-05-04T02:48:17.199449+0000","last_clean":"2024-05-04T02:48:17.199449+0000","last_became_active":"2024-05-04T02:20:15.294026+0000","last_became_peered":"2024-05-04T02:20:15.294026+0000","last_unstale":"2024-05-04T02:48:17.199449+0000","last_undegraded":"2024-05-04T02:48:17.199449+0000","last_fullsized":"2024-05-04T02:48:17.199449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":3304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"25'591","reported_seq":636,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:26.096786+0000","last_change":"2024-05-04T02:48:26.096854+0000","last_active":"2024-05-04T02:48:26.096786+0000","last_peered":"2024-05-04T02:48:26.096786+0000","last_clean":"2024-05-04T02:48:26.096786+0000","last_became_active":"2024-05-04T02:20:14.291313+0000","last_became_peered":"2024-05-04T02:20:14.291313+0000","last_unstale":"2024-05-04T02:48:26.096786+0000","last_undegraded":"2024-05-04T02:48:26.096786+0000","last_fullsized":"2024-05-04T02:48:26.096786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'591","last_scrub_stamp":"2024-05-04T02:48:26.096694+0000","last_deep_scrub":"25'591","last_deep_scrub_stamp":"2024-05-04T02:48:26.096694+0000","last_clean_scrub_stamp":"2024-05-04T02:48:26.096694+0000","objects_scrubbed":3,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:01:43.904683+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":585,"num_write_kb":4378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3751,"num_write_kb":293548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4679,"ondisk_log_size":4679,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":37541733,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":841,"num_read_kb":897,"num_write":10490,"num_write_kb":42216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":48889856,"data_stored":75083466,"data_compressed":7496204,"data_compressed_allocated":11345920,"data_compressed_original":37601280,"omap_allocated":0,"internal_metadata":0},"log_size":8572,"ondisk_log_size":8572,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65100,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509786,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64824,"kb_used_data":15600,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94307016,"statfs":{"total":96636764160,"available":96570384384,"internally_reserved":0,"allocated":15974400,"data_stored":25463912,"data_compressed":2642721,"data_compressed_allocated":3952640,"data_compressed_original":13611008,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509786,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60228,"kb_used_data":11004,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94311612,"statfs":{"total":96636764160,"available":96575090688,"internally_reserved":0,"allocated":11268096,"data_stored":16874693,"data_compressed":1601255,"data_compressed_allocated":2412544,"data_compressed_original":8187904,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509786,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35592,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336248,"statfs":{"total":96636764160,"available":96600317952,"internally_reserved":0,"allocated":262144,"data_stored":96895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509786,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58680,"kb_used_data":9456,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94313160,"statfs":{"total":96636764160,"available":96576675840,"internally_reserved":0,"allocated":9682944,"data_stored":12861583,"data_compressed":1022835,"data_compressed_allocated":1699840,"data_compressed_original":5050368,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509786,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35768,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336072,"statfs":{"total":96636764160,"available":96600137728,"internally_reserved":0,"allocated":442368,"data_stored":277999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509785,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29248,"kb_used_data":2232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342592,"statfs":{"total":96636764160,"available":96606814208,"internally_reserved":0,"allocated":2285568,"data_stored":3901602,"data_compressed":519116,"data_compressed_allocated":720896,"data_compressed_original":2506752,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542490,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44836,"kb_used_data":5340,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94327004,"statfs":{"total":96636764160,"available":96590852096,"internally_reserved":0,"allocated":5468160,"data_stored":8485539,"data_compressed":908476,"data_compressed_allocated":1347584,"data_compressed_original":4538368,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575194,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32584,"kb_used_data":5568,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94339256,"statfs":{"total":96636764160,"available":96603398144,"internally_reserved":0,"allocated":5701632,"data_stored":9076419,"data_compressed":866901,"data_compressed_allocated":1302528,"data_compressed_original":4853760,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32550,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32550,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5378048,"data_stored":8389246,"data_compressed":834351,"data_compressed_allocated":1257472,"data_compressed_original":4280320,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2027520,"data_stored":3804797,"data_compressed":519116,"data_compressed_allocated":720896,"data_compressed_original":2506752,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":184320,"data_stored":181194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9424896,"data_stored":12764778,"data_compressed":1022835,"data_compressed_allocated":1699840,"data_compressed_original":5050368,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5210112,"data_stored":8388734,"data_compressed":908476,"data_compressed_allocated":1347584,"data_compressed_original":4538368,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":11010048,"data_stored":16777888,"data_compressed":1601255,"data_compressed_allocated":2412544,"data_compressed_original":8187904,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":15650816,"data_stored":24776739,"data_compressed":2610171,"data_compressed_allocated":3907584,"data_compressed_original":13037568,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-04T02:48:31.465 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-05-04T02:20:14.110992+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.466 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-05-04T02:20:14.110992+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.466 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-05-04T02:20:14.110992+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.466 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-05-04T02:20:14.110992+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.466 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-05-04T02:20:14.110992+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.466 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-05-04T02:20:14.110992+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.466 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-05-04T02:20:14.110992+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.466 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-05-04T02:20:14.110992+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.466 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-05-04T02:20:14.110992+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.466 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-05-04T02:20:14.110992+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.467 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-05-04T02:20:14.110992+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.467 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-05-04T02:20:14.110992+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.467 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-05-04T02:20:14.110992+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.467 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-05-04T02:20:14.110992+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.467 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-05-04T02:20:14.110992+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.467 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-05-04T02:20:14.110992+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.467 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-05-04T02:20:14.110992+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.467 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-05-04T02:20:14.110992+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.467 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-05-04T02:20:14.110992+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.468 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-05-04T02:20:14.110992+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.468 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-05-04T02:20:14.110992+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.468 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-05-04T02:20:14.110992+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.468 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-05-04T02:20:14.110992+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.468 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-05-04T02:20:14.110992+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.468 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-05-04T02:20:14.110992+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.468 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-05-04T02:20:14.110992+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.468 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-05-04T02:20:14.110992+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.468 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-05-04T02:20:14.110992+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.468 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-05-04T02:20:14.110992+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.469 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-05-04T02:20:14.110992+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.469 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-05-04T02:20:14.110992+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.469 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-05-04T02:20:14.110992+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.469 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-05-04T02:20:12.997037+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=12, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.469 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-05-04T02:20:14.110992+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.469 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-05-04T02:20:12.997037+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=12, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.469 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-05-04T02:20:12.997037+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=12, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.469 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-05-04T02:20:14.110992+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.469 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-05-04T02:20:12.997037+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=12, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.470 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-05-04T02:20:14.110992+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.470 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-05-04T02:20:12.997037+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=12, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.470 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-05-04T02:20:14.110992+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.470 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-05-04T02:20:12.997037+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=12, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.470 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-05-04T02:20:14.110992+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.470 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-05-04T02:20:12.997037+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=12, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.470 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-05-04T02:20:14.110992+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.470 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-05-04T02:20:12.997037+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=12, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.470 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-05-04T02:20:14.110992+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.471 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-05-04T02:20:14.110992+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.471 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-05-04T02:20:12.997037+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=12, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.471 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-04T02:20:14.110992+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.471 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-05-04T02:20:12.997037+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=12, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.471 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-05-04T02:20:14.110992+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.471 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-05-04T02:20:14.110992+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.471 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-05-04T02:20:12.997037+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=12, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.471 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-05-04T02:20:14.110992+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.472 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-05-04T02:20:12.997037+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=12, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.472 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-05-04T02:20:14.110992+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.472 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-05-04T02:20:12.997037+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=12, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.472 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-05-04T02:20:14.110992+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.472 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-05-04T02:20:12.997037+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=12, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.472 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-05-04T02:20:14.110992+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.472 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-04T02:20:00.162760+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=0, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.472 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-05-04T02:20:12.997037+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=12, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.473 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-05-04T02:20:14.110992+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.473 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-05-04T02:20:12.997037+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=12, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.473 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-05-04T02:20:14.110992+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.473 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-05-04T02:20:12.997037+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=12, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.473 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-05-04T02:20:14.110992+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.473 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-05-04T02:20:12.997037+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=12, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.473 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-05-04T02:20:14.110992+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.473 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-05-04T02:20:14.110992+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.473 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-05-04T02:20:12.997037+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=12, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.473 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-05-04T02:20:14.110992+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.474 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-05-04T02:20:12.997037+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=12, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.474 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-05-04T02:20:14.110992+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.474 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-05-04T02:20:12.997037+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=12, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.474 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-05-04T02:20:12.997037+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=12, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.474 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-05-04T02:20:14.110992+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.474 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-05-04T02:20:12.997037+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=12, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.475 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-05-04T02:20:14.110992+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.475 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-05-04T02:20:12.997037+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=12, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.475 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-05-04T02:20:14.110992+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.475 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-05-04T02:20:12.997037+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=12, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.475 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-05-04T02:20:14.110992+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.475 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-05-04T02:20:14.110992+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.475 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-05-04T02:20:12.997037+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=12, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.475 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-05-04T02:20:14.110992+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.475 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-05-04T02:20:12.997037+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=12, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.475 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-05-04T02:20:14.110992+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.476 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-05-04T02:20:12.997037+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=12, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.476 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-05-04T02:20:14.110992+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:31.476 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-04T02:48:51.476 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-04T02:48:51.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:51.603+0000 7ff94a296640 1 Processor -- start 2024-05-04T02:48:51.604 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:51.603+0000 7ff94a296640 1 -- start start 2024-05-04T02:48:51.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:51.604+0000 7ff94a296640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff9440c8470 0x7ff9441545d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:51.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:51.604+0000 7ff94a296640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7ff94406dd40 0x7ff94415a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:51.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:51.604+0000 7ff94a296640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff94415db00 con 0x7ff94406d930 2024-05-04T02:48:51.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:51.604+0000 7ff94a296640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7ff94415d8d0 con 0x7ff94406dd40 2024-05-04T02:48:51.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:51.604+0000 7ff94a296640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff9440c80b0 con 0x7ff9440c8470 2024-05-04T02:48:51.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:51.605+0000 7ff9437fe640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7ff94406d930 0x7ff94406cc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:54704/0 (socket says 172.21.15.1:54704) 2024-05-04T02:48:51.605 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:51.605+0000 7ff9437fe640 1 -- 172.21.15.1:0/1276735647 learned_addr learned my addr 172.21.15.1:0/1276735647 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-05-04T02:48:51.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:51.605+0000 7ff943fff640 1 --2- 172.21.15.1:0/1276735647 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff9440c8470 0x7ff9441545d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:51.606 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:51.605+0000 7ff948833640 1 --2- 172.21.15.1:0/1276735647 >> v2:172.21.15.107:3300/0 conn(0x7ff94406dd40 0x7ff94415a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:51.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:51.607+0000 7ff942ffd640 1 -- 172.21.15.1:0/1276735647 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1241640925 0 0) 0x7ff94415db00 con 0x7ff94406d930 2024-05-04T02:48:51.608 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:51.607+0000 7ff942ffd640 1 -- 172.21.15.1:0/1276735647 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff930003520 con 0x7ff94406d930 2024-05-04T02:48:51.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:51.609+0000 7ff948833640 1 -- 172.21.15.1:0/1276735647 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff9440c8470 msgr2=0x7ff9441545d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:48:51.609 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:51.609+0000 7ff948833640 1 --2- 172.21.15.1:0/1276735647 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff9440c8470 0x7ff9441545d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:51.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:51.609+0000 7ff948833640 1 -- 172.21.15.1:0/1276735647 >> v1:172.21.15.1:6789/0 conn(0x7ff94406d930 legacy=0x7ff94406cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:51.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:51.609+0000 7ff948833640 1 -- 172.21.15.1:0/1276735647 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff94415a2e0 con 0x7ff94406dd40 2024-05-04T02:48:51.610 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:51.609+0000 7ff943fff640 1 --2- 172.21.15.1:0/1276735647 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff9440c8470 0x7ff9441545d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-04T02:48:51.612 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:51.611+0000 7ff948833640 1 --2- 172.21.15.1:0/1276735647 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff94406dd40 0x7ff94415a7e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff93c009d90 tx=0x7ff93c02a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea7c3bdada8e20f7 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:51.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:51.616+0000 7ff942ffd640 1 -- 172.21.15.1:0/1276735647 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff93c007740 con 0x7ff94406dd40 2024-05-04T02:48:51.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:51.616+0000 7ff942ffd640 1 -- 172.21.15.1:0/1276735647 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff93c0078e0 con 0x7ff94406dd40 2024-05-04T02:48:51.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:51.616+0000 7ff942ffd640 1 -- 172.21.15.1:0/1276735647 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff93c007cb0 con 0x7ff94406dd40 2024-05-04T02:48:51.617 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:51.617+0000 7ff94a296640 1 -- 172.21.15.1:0/1276735647 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff94406dd40 msgr2=0x7ff94415a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:51.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:51.617+0000 7ff94a296640 1 --2- 172.21.15.1:0/1276735647 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff94406dd40 0x7ff94415a7e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff93c009d90 tx=0x7ff93c02a660 comp rx=0 tx=0).stop 2024-05-04T02:48:51.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:51.617+0000 7ff94a296640 1 -- 172.21.15.1:0/1276735647 shutdown_connections 2024-05-04T02:48:51.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:51.617+0000 7ff94a296640 1 --2- 172.21.15.1:0/1276735647 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff94406dd40 0x7ff94415a7e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:51.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:51.617+0000 7ff94a296640 1 --2- 172.21.15.1:0/1276735647 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff9440c8470 0x7ff9441545d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:51.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:51.617+0000 7ff94a296640 1 -- 172.21.15.1:0/1276735647 >> 172.21.15.1:0/1276735647 conn(0x7ff9440ca060 msgr2=0x7ff9440ca470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:48:51.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:51.617+0000 7ff94a296640 1 -- 172.21.15.1:0/1276735647 shutdown_connections 2024-05-04T02:48:51.618 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:51.617+0000 7ff94a296640 1 -- 172.21.15.1:0/1276735647 wait complete. 2024-05-04T02:48:51.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:51.618+0000 7ff94a296640 1 Processor -- start 2024-05-04T02:48:51.619 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:51.619+0000 7ff94a296640 1 -- start start 2024-05-04T02:48:51.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:51.620+0000 7ff94a296640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff94406d930 0x7ff9441f3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:51.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:51.620+0000 7ff94a296640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff94406dd40 0x7ff9441e4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:51.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:51.620+0000 7ff94a296640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff9440c8470 0x7ff94415c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:51.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:51.620+0000 7ff94a296640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7ff94415e380 con 0x7ff9440c8470 2024-05-04T02:48:51.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:51.620+0000 7ff94a296640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7ff94415e0a0 con 0x7ff94406d930 2024-05-04T02:48:51.621 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:51.620+0000 7ff94a296640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7ff94415e660 con 0x7ff94406dd40 2024-05-04T02:48:51.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:51.620+0000 7ff948833640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff9440c8470 0x7ff94415c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:51.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:51.621+0000 7ff943fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff94406d930 0x7ff9441f3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:51.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:51.621+0000 7ff9437fe640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff94406dd40 0x7ff9441e4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:51.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:51.621+0000 7ff948833640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff9440c8470 0x7ff94415c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:49014/0 (socket says 172.21.15.1:49014) 2024-05-04T02:48:51.622 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:51.621+0000 7ff948833640 1 -- 172.21.15.1:0/3430950160 learned_addr learned my addr 172.21.15.1:0/3430950160 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:48:51.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:51.625+0000 7ff948833640 1 -- 172.21.15.1:0/3430950160 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff94406dd40 msgr2=0x7ff9441e4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:51.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:51.625+0000 7ff948833640 1 --2- 172.21.15.1:0/3430950160 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff94406dd40 0x7ff9441e4870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:51.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:51.625+0000 7ff948833640 1 -- 172.21.15.1:0/3430950160 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff94406d930 msgr2=0x7ff9441f3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:51.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:51.625+0000 7ff948833640 1 --2- 172.21.15.1:0/3430950160 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff94406d930 0x7ff9441f3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:51.626 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:51.625+0000 7ff948833640 1 -- 172.21.15.1:0/3430950160 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9441e4db0 con 0x7ff9440c8470 2024-05-04T02:48:51.628 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:51.627+0000 7ff948833640 1 --2- 172.21.15.1:0/3430950160 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff9440c8470 0x7ff94415c7f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff93c02ac50 tx=0x7ff93c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:51.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:51.632+0000 7ff940ff9640 1 -- 172.21.15.1:0/3430950160 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff93c03f070 con 0x7ff9440c8470 2024-05-04T02:48:51.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:51.632+0000 7ff940ff9640 1 -- 172.21.15.1:0/3430950160 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff93c031b40 con 0x7ff9440c8470 2024-05-04T02:48:51.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:51.632+0000 7ff94a296640 1 -- 172.21.15.1:0/3430950160 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff94414d970 con 0x7ff9440c8470 2024-05-04T02:48:51.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:51.632+0000 7ff940ff9640 1 -- 172.21.15.1:0/3430950160 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff93c044460 con 0x7ff9440c8470 2024-05-04T02:48:51.633 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:51.632+0000 7ff94a296640 1 -- 172.21.15.1:0/3430950160 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff94414dc30 con 0x7ff9440c8470 2024-05-04T02:48:51.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:51.633+0000 7ff94a296640 1 -- 172.21.15.1:0/3430950160 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff944069bc0 con 0x7ff9440c8470 2024-05-04T02:48:51.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:51.657+0000 7ff940ff9640 1 -- 172.21.15.1:0/3430950160 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff93c03b410 con 0x7ff9440c8470 2024-05-04T02:48:51.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:51.657+0000 7ff940ff9640 1 --2- 172.21.15.1:0/3430950160 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7ff9240762d0 0x7ff9240787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:48:51.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:51.658+0000 7ff943fff640 1 --2- 172.21.15.1:0/3430950160 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7ff9240762d0 0x7ff9240787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:48:51.659 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:51.658+0000 7ff943fff640 1 --2- 172.21.15.1:0/3430950160 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7ff9240762d0 0x7ff9240787e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff934009560 tx=0x7ff934009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:48:51.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:51.949+0000 7ff940ff9640 1 -- 172.21.15.1:0/3430950160 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5854+0+0 (secure 0 0 0) 0x7ff93c007840 con 0x7ff9440c8470 2024-05-04T02:48:51.950 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:51.949+0000 7ff940ff9640 1 -- 172.21.15.1:0/3430950160 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff93c0821c0 con 0x7ff9440c8470 2024-05-04T02:48:52.144 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:52.143+0000 7ff94a296640 1 -- 172.21.15.1:0/3430950160 --> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff9440c9e20 con 0x7ff9240762d0 2024-05-04T02:48:52.150 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:52.150+0000 7ff940ff9640 1 -- 172.21.15.1:0/3430950160 <== mgr.4108 v2:172.21.15.107:6800/3809222574 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+253381 (secure 0 0 0) 0x7ff9440c9e20 con 0x7ff9240762d0 2024-05-04T02:48:52.154 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:48:52.155 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-05-04T02:48:52.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:52.152+0000 7ff94a296640 1 -- 172.21.15.1:0/3430950160 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7ff9240762d0 msgr2=0x7ff9240787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:52.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:52.152+0000 7ff94a296640 1 --2- 172.21.15.1:0/3430950160 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7ff9240762d0 0x7ff9240787e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff934009560 tx=0x7ff934009190 comp rx=0 tx=0).stop 2024-05-04T02:48:52.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:52.152+0000 7ff94a296640 1 -- 172.21.15.1:0/3430950160 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff9440c8470 msgr2=0x7ff94415c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:48:52.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:52.152+0000 7ff94a296640 1 --2- 172.21.15.1:0/3430950160 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff9440c8470 0x7ff94415c7f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff93c02ac50 tx=0x7ff93c004a40 comp rx=0 tx=0).stop 2024-05-04T02:48:52.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:52.152+0000 7ff94a296640 1 -- 172.21.15.1:0/3430950160 shutdown_connections 2024-05-04T02:48:52.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:52.152+0000 7ff94a296640 1 --2- 172.21.15.1:0/3430950160 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7ff9240762d0 0x7ff9240787e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:52.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:52.152+0000 7ff94a296640 1 --2- 172.21.15.1:0/3430950160 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7ff9440c8470 0x7ff94415c7f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:52.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:52.152+0000 7ff94a296640 1 --2- 172.21.15.1:0/3430950160 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7ff94406dd40 0x7ff9441e4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:52.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:52.152+0000 7ff94a296640 1 --2- 172.21.15.1:0/3430950160 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7ff94406d930 0x7ff9441f3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:48:52.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:52.152+0000 7ff94a296640 1 -- 172.21.15.1:0/3430950160 >> 172.21.15.1:0/3430950160 conn(0x7ff9440ca060 msgr2=0x7ff9441590b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:48:52.157 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:52.153+0000 7ff94a296640 1 -- 172.21.15.1:0/3430950160 shutdown_connections 2024-05-04T02:48:52.158 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:48:52.153+0000 7ff94a296640 1 -- 172.21.15.1:0/3430950160 wait complete. 2024-05-04T02:48:52.165 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":885,"stamp":"2024-05-04T02:48:51.522242+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":38132101,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":907,"num_read_kb":952,"num_write":14342,"num_write_kb":337392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13342,"ondisk_log_size":13342,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":361760,"kb_used_data":49888,"kb_used_omap":12,"kb_used_meta":311795,"kb_avail":754612960,"statfs":{"total":773094113280,"available":772723671040,"internally_reserved":0,"allocated":51085312,"data_stored":77038642,"data_compressed":7561304,"data_compressed_allocated":11436032,"data_compressed_original":38748160,"omap_allocated":12752,"internal_metadata":319278640},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003073"},"pg_stats":[{"pgid":"3.3f","version":"25'66","reported_seq":98,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:34.990671+0000","last_change":"2024-05-04T02:48:34.990696+0000","last_active":"2024-05-04T02:48:34.990671+0000","last_peered":"2024-05-04T02:48:34.990671+0000","last_clean":"2024-05-04T02:48:34.990671+0000","last_became_active":"2024-05-04T02:20:53.380291+0000","last_became_peered":"2024-05-04T02:20:53.380291+0000","last_unstale":"2024-05-04T02:48:34.990671+0000","last_undegraded":"2024-05-04T02:48:34.990671+0000","last_fullsized":"2024-05-04T02:48:34.990671+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'66","last_scrub_stamp":"2024-05-04T02:48:34.990596+0000","last_deep_scrub":"25'66","last_deep_scrub_stamp":"2024-05-04T02:48:34.990596+0000","last_clean_scrub_stamp":"2024-05-04T02:48:34.990596+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:54:57.366615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":3382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3e","version":"25'82","reported_seq":125,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:34.972015+0000","last_change":"2024-05-04T02:48:34.972063+0000","last_active":"2024-05-04T02:48:34.972015+0000","last_peered":"2024-05-04T02:48:34.972015+0000","last_clean":"2024-05-04T02:48:34.972015+0000","last_became_active":"2024-05-04T02:20:15.298956+0000","last_became_peered":"2024-05-04T02:20:15.298956+0000","last_unstale":"2024-05-04T02:48:34.972015+0000","last_undegraded":"2024-05-04T02:48:34.972015+0000","last_fullsized":"2024-05-04T02:48:34.972015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'82","last_scrub_stamp":"2024-05-04T02:48:34.971921+0000","last_deep_scrub":"25'82","last_deep_scrub_stamp":"2024-05-04T02:48:34.971921+0000","last_clean_scrub_stamp":"2024-05-04T02:48:34.971921+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:48:17.870181+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":2093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"25'86","reported_seq":129,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:30.124224+0000","last_change":"2024-05-04T02:48:30.124250+0000","last_active":"2024-05-04T02:48:30.124224+0000","last_peered":"2024-05-04T02:48:30.124224+0000","last_clean":"2024-05-04T02:48:30.124224+0000","last_became_active":"2024-05-04T02:20:15.297150+0000","last_became_peered":"2024-05-04T02:20:15.297150+0000","last_unstale":"2024-05-04T02:48:30.124224+0000","last_undegraded":"2024-05-04T02:48:30.124224+0000","last_fullsized":"2024-05-04T02:48:30.124224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'86","last_scrub_stamp":"2024-05-04T02:48:30.124138+0000","last_deep_scrub":"25'86","last_deep_scrub_stamp":"2024-05-04T02:48:30.124138+0000","last_clean_scrub_stamp":"2024-05-04T02:48:30.124138+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:16:47.005238+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":4094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"25'50","reported_seq":94,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:36.306411+0000","last_change":"2024-05-04T02:48:36.306465+0000","last_active":"2024-05-04T02:48:36.306411+0000","last_peered":"2024-05-04T02:48:36.306411+0000","last_clean":"2024-05-04T02:48:36.306411+0000","last_became_active":"2024-05-04T02:20:15.301113+0000","last_became_peered":"2024-05-04T02:20:15.301113+0000","last_unstale":"2024-05-04T02:48:36.306411+0000","last_undegraded":"2024-05-04T02:48:36.306411+0000","last_fullsized":"2024-05-04T02:48:36.306411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'50","last_scrub_stamp":"2024-05-04T02:48:36.306304+0000","last_deep_scrub":"25'50","last_deep_scrub_stamp":"2024-05-04T02:48:36.306304+0000","last_clean_scrub_stamp":"2024-05-04T02:48:36.306304+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:01:30.334574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":1582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"25'54","reported_seq":95,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:39.175831+0000","last_change":"2024-05-04T02:48:39.175877+0000","last_active":"2024-05-04T02:48:39.175831+0000","last_peered":"2024-05-04T02:48:39.175831+0000","last_clean":"2024-05-04T02:48:39.175831+0000","last_became_active":"2024-05-04T02:20:15.297511+0000","last_became_peered":"2024-05-04T02:20:15.297511+0000","last_unstale":"2024-05-04T02:48:39.175831+0000","last_undegraded":"2024-05-04T02:48:39.175831+0000","last_fullsized":"2024-05-04T02:48:39.175831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'54","last_scrub_stamp":"2024-05-04T02:48:39.175735+0000","last_deep_scrub":"25'54","last_deep_scrub_stamp":"2024-05-04T02:48:39.175735+0000","last_clean_scrub_stamp":"2024-05-04T02:48:39.175735+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:46:04.461089+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":3466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"25'86","reported_seq":127,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:43.328110+0000","last_change":"2024-05-04T02:48:43.328139+0000","last_active":"2024-05-04T02:48:43.328110+0000","last_peered":"2024-05-04T02:48:43.328110+0000","last_clean":"2024-05-04T02:48:43.328110+0000","last_became_active":"2024-05-04T02:20:15.306537+0000","last_became_peered":"2024-05-04T02:20:15.306537+0000","last_unstale":"2024-05-04T02:48:43.328110+0000","last_undegraded":"2024-05-04T02:48:43.328110+0000","last_fullsized":"2024-05-04T02:48:43.328110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'86","last_scrub_stamp":"2024-05-04T02:48:43.328032+0000","last_deep_scrub":"25'86","last_deep_scrub_stamp":"2024-05-04T02:48:43.328032+0000","last_clean_scrub_stamp":"2024-05-04T02:48:43.328032+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:27:28.627358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":4281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"25'87","reported_seq":128,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:40.141164+0000","last_change":"2024-05-04T02:48:40.141215+0000","last_active":"2024-05-04T02:48:40.141164+0000","last_peered":"2024-05-04T02:48:40.141164+0000","last_clean":"2024-05-04T02:48:40.141164+0000","last_became_active":"2024-05-04T02:20:15.299177+0000","last_became_peered":"2024-05-04T02:20:15.299177+0000","last_unstale":"2024-05-04T02:48:40.141164+0000","last_undegraded":"2024-05-04T02:48:40.141164+0000","last_fullsized":"2024-05-04T02:48:40.141164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'87","last_scrub_stamp":"2024-05-04T02:48:40.140984+0000","last_deep_scrub":"25'87","last_deep_scrub_stamp":"2024-05-04T02:48:40.140984+0000","last_clean_scrub_stamp":"2024-05-04T02:48:40.140984+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:20:46.332836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75,"num_write_kb":3160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"25'62","reported_seq":103,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:39.635199+0000","last_change":"2024-05-04T02:48:39.635252+0000","last_active":"2024-05-04T02:48:39.635199+0000","last_peered":"2024-05-04T02:48:39.635199+0000","last_clean":"2024-05-04T02:48:39.635199+0000","last_became_active":"2024-05-04T02:20:15.306663+0000","last_became_peered":"2024-05-04T02:20:15.306663+0000","last_unstale":"2024-05-04T02:48:39.635199+0000","last_undegraded":"2024-05-04T02:48:39.635199+0000","last_fullsized":"2024-05-04T02:48:39.635199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'62","last_scrub_stamp":"2024-05-04T02:48:39.635089+0000","last_deep_scrub":"25'62","last_deep_scrub_stamp":"2024-05-04T02:48:39.635089+0000","last_clean_scrub_stamp":"2024-05-04T02:48:39.635089+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:46:52.958691+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":4413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"25'72","reported_seq":113,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:44.221221+0000","last_change":"2024-05-04T02:48:44.221250+0000","last_active":"2024-05-04T02:48:44.221221+0000","last_peered":"2024-05-04T02:48:44.221221+0000","last_clean":"2024-05-04T02:48:44.221221+0000","last_became_active":"2024-05-04T02:20:15.303055+0000","last_became_peered":"2024-05-04T02:20:15.303055+0000","last_unstale":"2024-05-04T02:48:44.221221+0000","last_undegraded":"2024-05-04T02:48:44.221221+0000","last_fullsized":"2024-05-04T02:48:44.221221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'72","last_scrub_stamp":"2024-05-04T02:48:44.221115+0000","last_deep_scrub":"25'72","last_deep_scrub_stamp":"2024-05-04T02:48:44.221115+0000","last_clean_scrub_stamp":"2024-05-04T02:48:44.221115+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:58:25.422472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":5860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"25'70","reported_seq":111,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:41.072425+0000","last_change":"2024-05-04T02:48:41.072474+0000","last_active":"2024-05-04T02:48:41.072425+0000","last_peered":"2024-05-04T02:48:41.072425+0000","last_clean":"2024-05-04T02:48:41.072425+0000","last_became_active":"2024-05-04T02:20:15.307124+0000","last_became_peered":"2024-05-04T02:20:15.307124+0000","last_unstale":"2024-05-04T02:48:41.072425+0000","last_undegraded":"2024-05-04T02:48:41.072425+0000","last_fullsized":"2024-05-04T02:48:41.072425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'70","last_scrub_stamp":"2024-05-04T02:48:41.072328+0000","last_deep_scrub":"25'70","last_deep_scrub_stamp":"2024-05-04T02:48:41.072328+0000","last_clean_scrub_stamp":"2024-05-04T02:48:41.072328+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:51:45.100023+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":2059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"25'65","reported_seq":106,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:40.028991+0000","last_change":"2024-05-04T02:48:40.029017+0000","last_active":"2024-05-04T02:48:40.028991+0000","last_peered":"2024-05-04T02:48:40.028991+0000","last_clean":"2024-05-04T02:48:40.028991+0000","last_became_active":"2024-05-04T02:20:15.306409+0000","last_became_peered":"2024-05-04T02:20:15.306409+0000","last_unstale":"2024-05-04T02:48:40.028991+0000","last_undegraded":"2024-05-04T02:48:40.028991+0000","last_fullsized":"2024-05-04T02:48:40.028991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'65","last_scrub_stamp":"2024-05-04T02:48:40.028897+0000","last_deep_scrub":"25'65","last_deep_scrub_stamp":"2024-05-04T02:48:40.028897+0000","last_clean_scrub_stamp":"2024-05-04T02:48:40.028897+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:47:53.036299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"25'50","reported_seq":91,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:31.751566+0000","last_change":"2024-05-04T02:48:31.751590+0000","last_active":"2024-05-04T02:48:31.751566+0000","last_peered":"2024-05-04T02:48:31.751566+0000","last_clean":"2024-05-04T02:48:31.751566+0000","last_became_active":"2024-05-04T02:20:15.296640+0000","last_became_peered":"2024-05-04T02:20:15.296640+0000","last_unstale":"2024-05-04T02:48:31.751566+0000","last_undegraded":"2024-05-04T02:48:31.751566+0000","last_fullsized":"2024-05-04T02:48:31.751566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'50","last_scrub_stamp":"2024-05-04T02:48:31.751487+0000","last_deep_scrub":"25'50","last_deep_scrub_stamp":"2024-05-04T02:48:31.751487+0000","last_clean_scrub_stamp":"2024-05-04T02:48:31.751487+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:23:58.198420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":2327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"25'84","reported_seq":125,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:31.422097+0000","last_change":"2024-05-04T02:48:31.422125+0000","last_active":"2024-05-04T02:48:31.422097+0000","last_peered":"2024-05-04T02:48:31.422097+0000","last_clean":"2024-05-04T02:48:31.422097+0000","last_became_active":"2024-05-04T02:20:15.293909+0000","last_became_peered":"2024-05-04T02:20:15.293909+0000","last_unstale":"2024-05-04T02:48:31.422097+0000","last_undegraded":"2024-05-04T02:48:31.422097+0000","last_fullsized":"2024-05-04T02:48:31.422097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'84","last_scrub_stamp":"2024-05-04T02:48:31.422017+0000","last_deep_scrub":"25'84","last_deep_scrub_stamp":"2024-05-04T02:48:31.422017+0000","last_clean_scrub_stamp":"2024-05-04T02:48:31.422017+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:23:12.328514+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":6748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"25'70","reported_seq":112,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:27.133338+0000","last_change":"2024-05-04T02:48:27.133362+0000","last_active":"2024-05-04T02:48:27.133338+0000","last_peered":"2024-05-04T02:48:27.133338+0000","last_clean":"2024-05-04T02:48:27.133338+0000","last_became_active":"2024-05-04T02:20:15.293550+0000","last_became_peered":"2024-05-04T02:20:15.293550+0000","last_unstale":"2024-05-04T02:48:27.133338+0000","last_undegraded":"2024-05-04T02:48:27.133338+0000","last_fullsized":"2024-05-04T02:48:27.133338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'70","last_scrub_stamp":"2024-05-04T02:48:27.133257+0000","last_deep_scrub":"25'70","last_deep_scrub_stamp":"2024-05-04T02:48:27.133257+0000","last_clean_scrub_stamp":"2024-05-04T02:48:27.133257+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:28:58.351012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":6468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"25'94","reported_seq":136,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:37.033166+0000","last_change":"2024-05-04T02:48:37.033194+0000","last_active":"2024-05-04T02:48:37.033166+0000","last_peered":"2024-05-04T02:48:37.033166+0000","last_clean":"2024-05-04T02:48:37.033166+0000","last_became_active":"2024-05-04T02:20:15.305549+0000","last_became_peered":"2024-05-04T02:20:15.305549+0000","last_unstale":"2024-05-04T02:48:37.033166+0000","last_undegraded":"2024-05-04T02:48:37.033166+0000","last_fullsized":"2024-05-04T02:48:37.033166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'94","last_scrub_stamp":"2024-05-04T02:48:37.033079+0000","last_deep_scrub":"25'94","last_deep_scrub_stamp":"2024-05-04T02:48:37.033079+0000","last_clean_scrub_stamp":"2024-05-04T02:48:37.033079+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:51:41.060774+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":3628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"25'80","reported_seq":122,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:39.273557+0000","last_change":"2024-05-04T02:48:39.273583+0000","last_active":"2024-05-04T02:48:39.273557+0000","last_peered":"2024-05-04T02:48:39.273557+0000","last_clean":"2024-05-04T02:48:39.273557+0000","last_became_active":"2024-05-04T02:20:15.301515+0000","last_became_peered":"2024-05-04T02:20:15.301515+0000","last_unstale":"2024-05-04T02:48:39.273557+0000","last_undegraded":"2024-05-04T02:48:39.273557+0000","last_fullsized":"2024-05-04T02:48:39.273557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'80","last_scrub_stamp":"2024-05-04T02:48:39.273478+0000","last_deep_scrub":"25'80","last_deep_scrub_stamp":"2024-05-04T02:48:39.273478+0000","last_clean_scrub_stamp":"2024-05-04T02:48:39.273478+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:51:55.734989+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":4426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"25'78","reported_seq":120,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:35.343698+0000","last_change":"2024-05-04T02:48:35.343744+0000","last_active":"2024-05-04T02:48:35.343698+0000","last_peered":"2024-05-04T02:48:35.343698+0000","last_clean":"2024-05-04T02:48:35.343698+0000","last_became_active":"2024-05-04T02:20:15.300707+0000","last_became_peered":"2024-05-04T02:20:15.300707+0000","last_unstale":"2024-05-04T02:48:35.343698+0000","last_undegraded":"2024-05-04T02:48:35.343698+0000","last_fullsized":"2024-05-04T02:48:35.343698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'78","last_scrub_stamp":"2024-05-04T02:48:35.343576+0000","last_deep_scrub":"25'78","last_deep_scrub_stamp":"2024-05-04T02:48:35.343576+0000","last_clean_scrub_stamp":"2024-05-04T02:48:35.343576+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:19:07.538480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":4257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"25'87","reported_seq":129,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:30.997207+0000","last_change":"2024-05-04T02:48:30.997257+0000","last_active":"2024-05-04T02:48:30.997207+0000","last_peered":"2024-05-04T02:48:30.997207+0000","last_clean":"2024-05-04T02:48:30.997207+0000","last_became_active":"2024-05-04T02:20:15.291766+0000","last_became_peered":"2024-05-04T02:20:15.291766+0000","last_unstale":"2024-05-04T02:48:30.997207+0000","last_undegraded":"2024-05-04T02:48:30.997207+0000","last_fullsized":"2024-05-04T02:48:30.997207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'87","last_scrub_stamp":"2024-05-04T02:48:30.997083+0000","last_deep_scrub":"25'87","last_deep_scrub_stamp":"2024-05-04T02:48:30.997083+0000","last_clean_scrub_stamp":"2024-05-04T02:48:30.997083+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:30:09.921309+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":5570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"25'65","reported_seq":107,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:31.240337+0000","last_change":"2024-05-04T02:48:31.240368+0000","last_active":"2024-05-04T02:48:31.240337+0000","last_peered":"2024-05-04T02:48:31.240337+0000","last_clean":"2024-05-04T02:48:31.240337+0000","last_became_active":"2024-05-04T02:20:15.297568+0000","last_became_peered":"2024-05-04T02:20:15.297568+0000","last_unstale":"2024-05-04T02:48:31.240337+0000","last_undegraded":"2024-05-04T02:48:31.240337+0000","last_fullsized":"2024-05-04T02:48:31.240337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'65","last_scrub_stamp":"2024-05-04T02:48:31.240262+0000","last_deep_scrub":"25'65","last_deep_scrub_stamp":"2024-05-04T02:48:31.240262+0000","last_clean_scrub_stamp":"2024-05-04T02:48:31.240262+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:49:50.164054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":4387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"25'89","reported_seq":131,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:38.995549+0000","last_change":"2024-05-04T02:48:38.995577+0000","last_active":"2024-05-04T02:48:38.995549+0000","last_peered":"2024-05-04T02:48:38.995549+0000","last_clean":"2024-05-04T02:48:38.995549+0000","last_became_active":"2024-05-04T02:20:15.302743+0000","last_became_peered":"2024-05-04T02:20:15.302743+0000","last_unstale":"2024-05-04T02:48:38.995549+0000","last_undegraded":"2024-05-04T02:48:38.995549+0000","last_fullsized":"2024-05-04T02:48:38.995549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'89","last_scrub_stamp":"2024-05-04T02:48:38.995452+0000","last_deep_scrub":"25'89","last_deep_scrub_stamp":"2024-05-04T02:48:38.995452+0000","last_clean_scrub_stamp":"2024-05-04T02:48:38.995452+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:48:21.893712+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75,"num_write_kb":8052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"25'110","reported_seq":152,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:32.107196+0000","last_change":"2024-05-04T02:48:32.107252+0000","last_active":"2024-05-04T02:48:32.107196+0000","last_peered":"2024-05-04T02:48:32.107196+0000","last_clean":"2024-05-04T02:48:32.107196+0000","last_became_active":"2024-05-04T02:20:15.300709+0000","last_became_peered":"2024-05-04T02:20:15.300709+0000","last_unstale":"2024-05-04T02:48:32.107196+0000","last_undegraded":"2024-05-04T02:48:32.107196+0000","last_fullsized":"2024-05-04T02:48:32.107196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'110","last_scrub_stamp":"2024-05-04T02:48:32.107072+0000","last_deep_scrub":"25'110","last_deep_scrub_stamp":"2024-05-04T02:48:32.107072+0000","last_clean_scrub_stamp":"2024-05-04T02:48:32.107072+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:40:08.369243+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":9218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"25'64","reported_seq":106,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:37.306186+0000","last_change":"2024-05-04T02:48:37.306225+0000","last_active":"2024-05-04T02:48:37.306186+0000","last_peered":"2024-05-04T02:48:37.306186+0000","last_clean":"2024-05-04T02:48:37.306186+0000","last_became_active":"2024-05-04T02:20:15.300848+0000","last_became_peered":"2024-05-04T02:20:15.300848+0000","last_unstale":"2024-05-04T02:48:37.306186+0000","last_undegraded":"2024-05-04T02:48:37.306186+0000","last_fullsized":"2024-05-04T02:48:37.306186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'64","last_scrub_stamp":"2024-05-04T02:48:37.306071+0000","last_deep_scrub":"25'64","last_deep_scrub_stamp":"2024-05-04T02:48:37.306071+0000","last_clean_scrub_stamp":"2024-05-04T02:48:37.306071+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:18:43.808053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":2229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"25'75","reported_seq":117,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:37.603918+0000","last_change":"2024-05-04T02:48:37.603961+0000","last_active":"2024-05-04T02:48:37.603918+0000","last_peered":"2024-05-04T02:48:37.603918+0000","last_clean":"2024-05-04T02:48:37.603918+0000","last_became_active":"2024-05-04T02:20:15.301879+0000","last_became_peered":"2024-05-04T02:20:15.301879+0000","last_unstale":"2024-05-04T02:48:37.603918+0000","last_undegraded":"2024-05-04T02:48:37.603918+0000","last_fullsized":"2024-05-04T02:48:37.603918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'75","last_scrub_stamp":"2024-05-04T02:48:37.603807+0000","last_deep_scrub":"25'75","last_deep_scrub_stamp":"2024-05-04T02:48:37.603807+0000","last_clean_scrub_stamp":"2024-05-04T02:48:37.603807+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:27:30.651448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":4046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"25'55","reported_seq":86,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:32.984841+0000","last_change":"2024-05-04T02:48:32.984882+0000","last_active":"2024-05-04T02:48:32.984841+0000","last_peered":"2024-05-04T02:48:32.984841+0000","last_clean":"2024-05-04T02:48:32.984841+0000","last_became_active":"2024-05-04T02:20:53.115499+0000","last_became_peered":"2024-05-04T02:20:53.115499+0000","last_unstale":"2024-05-04T02:48:32.984841+0000","last_undegraded":"2024-05-04T02:48:32.984841+0000","last_fullsized":"2024-05-04T02:48:32.984841+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'55","last_scrub_stamp":"2024-05-04T02:48:32.984760+0000","last_deep_scrub":"25'55","last_deep_scrub_stamp":"2024-05-04T02:48:32.984760+0000","last_clean_scrub_stamp":"2024-05-04T02:48:32.984760+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:50:38.901172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":4120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"25'84","reported_seq":127,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:36.557361+0000","last_change":"2024-05-04T02:48:36.557389+0000","last_active":"2024-05-04T02:48:36.557361+0000","last_peered":"2024-05-04T02:48:36.557361+0000","last_clean":"2024-05-04T02:48:36.557361+0000","last_became_active":"2024-05-04T02:20:15.301363+0000","last_became_peered":"2024-05-04T02:20:15.301363+0000","last_unstale":"2024-05-04T02:48:36.557361+0000","last_undegraded":"2024-05-04T02:48:36.557361+0000","last_fullsized":"2024-05-04T02:48:36.557361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'84","last_scrub_stamp":"2024-05-04T02:48:36.557265+0000","last_deep_scrub":"25'84","last_deep_scrub_stamp":"2024-05-04T02:48:36.557265+0000","last_clean_scrub_stamp":"2024-05-04T02:48:36.557265+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:18:45.744169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":4697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"25'75","reported_seq":118,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:37.029508+0000","last_change":"2024-05-04T02:48:37.029555+0000","last_active":"2024-05-04T02:48:37.029508+0000","last_peered":"2024-05-04T02:48:37.029508+0000","last_clean":"2024-05-04T02:48:37.029508+0000","last_became_active":"2024-05-04T02:20:15.295577+0000","last_became_peered":"2024-05-04T02:20:15.295577+0000","last_unstale":"2024-05-04T02:48:37.029508+0000","last_undegraded":"2024-05-04T02:48:37.029508+0000","last_fullsized":"2024-05-04T02:48:37.029508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'75","last_scrub_stamp":"2024-05-04T02:48:37.029387+0000","last_deep_scrub":"25'75","last_deep_scrub_stamp":"2024-05-04T02:48:37.029387+0000","last_clean_scrub_stamp":"2024-05-04T02:48:37.029387+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:31:26.170341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":3524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"25'87","reported_seq":130,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:36.022080+0000","last_change":"2024-05-04T02:48:36.022104+0000","last_active":"2024-05-04T02:48:36.022080+0000","last_peered":"2024-05-04T02:48:36.022080+0000","last_clean":"2024-05-04T02:48:36.022080+0000","last_became_active":"2024-05-04T02:20:15.299230+0000","last_became_peered":"2024-05-04T02:20:15.299230+0000","last_unstale":"2024-05-04T02:48:36.022080+0000","last_undegraded":"2024-05-04T02:48:36.022080+0000","last_fullsized":"2024-05-04T02:48:36.022080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'87","last_scrub_stamp":"2024-05-04T02:48:36.022002+0000","last_deep_scrub":"25'87","last_deep_scrub_stamp":"2024-05-04T02:48:36.022002+0000","last_clean_scrub_stamp":"2024-05-04T02:48:36.022002+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:23:24.893540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":4545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"25'51","reported_seq":94,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:38.605455+0000","last_change":"2024-05-04T02:48:38.605514+0000","last_active":"2024-05-04T02:48:38.605455+0000","last_peered":"2024-05-04T02:48:38.605455+0000","last_clean":"2024-05-04T02:48:38.605455+0000","last_became_active":"2024-05-04T02:20:15.302456+0000","last_became_peered":"2024-05-04T02:20:15.302456+0000","last_unstale":"2024-05-04T02:48:38.605455+0000","last_undegraded":"2024-05-04T02:48:38.605455+0000","last_fullsized":"2024-05-04T02:48:38.605455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'51","last_scrub_stamp":"2024-05-04T02:48:38.605344+0000","last_deep_scrub":"25'51","last_deep_scrub_stamp":"2024-05-04T02:48:38.605344+0000","last_clean_scrub_stamp":"2024-05-04T02:48:38.605344+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:19:10.800248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":7049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"25'65","reported_seq":108,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:29.160044+0000","last_change":"2024-05-04T02:48:29.160073+0000","last_active":"2024-05-04T02:48:29.160044+0000","last_peered":"2024-05-04T02:48:29.160044+0000","last_clean":"2024-05-04T02:48:29.160044+0000","last_became_active":"2024-05-04T02:20:15.296235+0000","last_became_peered":"2024-05-04T02:20:15.296235+0000","last_unstale":"2024-05-04T02:48:29.160044+0000","last_undegraded":"2024-05-04T02:48:29.160044+0000","last_fullsized":"2024-05-04T02:48:29.160044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'65","last_scrub_stamp":"2024-05-04T02:48:29.159965+0000","last_deep_scrub":"25'65","last_deep_scrub_stamp":"2024-05-04T02:48:29.159965+0000","last_clean_scrub_stamp":"2024-05-04T02:48:29.159965+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:07:45.599162+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":6740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"25'135","reported_seq":167,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:34.020936+0000","last_change":"2024-05-04T02:48:34.020961+0000","last_active":"2024-05-04T02:48:34.020936+0000","last_peered":"2024-05-04T02:48:34.020936+0000","last_clean":"2024-05-04T02:48:34.020936+0000","last_became_active":"2024-05-04T02:20:53.116069+0000","last_became_peered":"2024-05-04T02:20:53.116069+0000","last_unstale":"2024-05-04T02:48:34.020936+0000","last_undegraded":"2024-05-04T02:48:34.020936+0000","last_fullsized":"2024-05-04T02:48:34.020936+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'135","last_scrub_stamp":"2024-05-04T02:48:34.020861+0000","last_deep_scrub":"25'135","last_deep_scrub_stamp":"2024-05-04T02:48:34.020861+0000","last_clean_scrub_stamp":"2024-05-04T02:48:34.020861+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:40:22.797861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":7251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"25'77","reported_seq":120,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:31.947461+0000","last_change":"2024-05-04T02:48:31.947487+0000","last_active":"2024-05-04T02:48:31.947461+0000","last_peered":"2024-05-04T02:48:31.947461+0000","last_clean":"2024-05-04T02:48:31.947461+0000","last_became_active":"2024-05-04T02:20:15.301424+0000","last_became_peered":"2024-05-04T02:20:15.301424+0000","last_unstale":"2024-05-04T02:48:31.947461+0000","last_undegraded":"2024-05-04T02:48:31.947461+0000","last_fullsized":"2024-05-04T02:48:31.947461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'77","last_scrub_stamp":"2024-05-04T02:48:31.947378+0000","last_deep_scrub":"25'77","last_deep_scrub_stamp":"2024-05-04T02:48:31.947378+0000","last_clean_scrub_stamp":"2024-05-04T02:48:31.947378+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:15:37.622831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":8003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"25'86","reported_seq":129,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:35.009500+0000","last_change":"2024-05-04T02:48:35.009525+0000","last_active":"2024-05-04T02:48:35.009500+0000","last_peered":"2024-05-04T02:48:35.009500+0000","last_clean":"2024-05-04T02:48:35.009500+0000","last_became_active":"2024-05-04T02:20:15.292840+0000","last_became_peered":"2024-05-04T02:20:15.292840+0000","last_unstale":"2024-05-04T02:48:35.009500+0000","last_undegraded":"2024-05-04T02:48:35.009500+0000","last_fullsized":"2024-05-04T02:48:35.009500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'86","last_scrub_stamp":"2024-05-04T02:48:35.009424+0000","last_deep_scrub":"25'86","last_deep_scrub_stamp":"2024-05-04T02:48:35.009424+0000","last_clean_scrub_stamp":"2024-05-04T02:48:35.009424+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:23:40.893262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":6858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"25'66","reported_seq":107,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:32.787654+0000","last_change":"2024-05-04T02:48:32.787679+0000","last_active":"2024-05-04T02:48:32.787654+0000","last_peered":"2024-05-04T02:48:32.787654+0000","last_clean":"2024-05-04T02:48:32.787654+0000","last_became_active":"2024-05-04T02:20:15.297415+0000","last_became_peered":"2024-05-04T02:20:15.297415+0000","last_unstale":"2024-05-04T02:48:32.787654+0000","last_undegraded":"2024-05-04T02:48:32.787654+0000","last_fullsized":"2024-05-04T02:48:32.787654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'66","last_scrub_stamp":"2024-05-04T02:48:32.787560+0000","last_deep_scrub":"25'66","last_deep_scrub_stamp":"2024-05-04T02:48:32.787560+0000","last_clean_scrub_stamp":"2024-05-04T02:48:32.787560+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:05:34.942851+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":6149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"25'713","reported_seq":756,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:27.353209+0000","last_change":"2024-05-04T02:48:27.353238+0000","last_active":"2024-05-04T02:48:27.353209+0000","last_peered":"2024-05-04T02:48:27.353209+0000","last_clean":"2024-05-04T02:48:27.353209+0000","last_became_active":"2024-05-04T02:20:14.289651+0000","last_became_peered":"2024-05-04T02:20:14.289651+0000","last_unstale":"2024-05-04T02:48:27.353209+0000","last_undegraded":"2024-05-04T02:48:27.353209+0000","last_fullsized":"2024-05-04T02:48:27.353209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'713","last_scrub_stamp":"2024-05-04T02:48:27.353125+0000","last_deep_scrub":"25'713","last_deep_scrub_stamp":"2024-05-04T02:48:27.353125+0000","last_clean_scrub_stamp":"2024-05-04T02:48:27.353125+0000","objects_scrubbed":1,"log_size":713,"log_dups_size":0,"ondisk_log_size":713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:59:59.743644+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":710,"num_write_kb":4451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"25'81","reported_seq":122,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:34.101092+0000","last_change":"2024-05-04T02:48:34.101116+0000","last_active":"2024-05-04T02:48:34.101092+0000","last_peered":"2024-05-04T02:48:34.101092+0000","last_clean":"2024-05-04T02:48:34.101092+0000","last_became_active":"2024-05-04T02:20:15.305597+0000","last_became_peered":"2024-05-04T02:20:15.305597+0000","last_unstale":"2024-05-04T02:48:34.101092+0000","last_undegraded":"2024-05-04T02:48:34.101092+0000","last_fullsized":"2024-05-04T02:48:34.101092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'81","last_scrub_stamp":"2024-05-04T02:48:34.101010+0000","last_deep_scrub":"25'81","last_deep_scrub_stamp":"2024-05-04T02:48:34.101010+0000","last_clean_scrub_stamp":"2024-05-04T02:48:34.101010+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:07:45.342827+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":5085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"25'610","reported_seq":653,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:30.013693+0000","last_change":"2024-05-04T02:48:30.013720+0000","last_active":"2024-05-04T02:48:30.013693+0000","last_peered":"2024-05-04T02:48:30.013693+0000","last_clean":"2024-05-04T02:48:30.013693+0000","last_became_active":"2024-05-04T02:20:14.358394+0000","last_became_peered":"2024-05-04T02:20:14.358394+0000","last_unstale":"2024-05-04T02:48:30.013693+0000","last_undegraded":"2024-05-04T02:48:30.013693+0000","last_fullsized":"2024-05-04T02:48:30.013693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'610","last_scrub_stamp":"2024-05-04T02:48:30.013620+0000","last_deep_scrub":"25'610","last_deep_scrub_stamp":"2024-05-04T02:48:30.013620+0000","last_clean_scrub_stamp":"2024-05-04T02:48:30.013620+0000","objects_scrubbed":1,"log_size":610,"log_dups_size":0,"ondisk_log_size":610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:27:20.462339+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":604,"num_write_kb":4430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"25'3","reported_seq":46,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:29.408338+0000","last_change":"2024-05-04T02:48:29.408382+0000","last_active":"2024-05-04T02:48:29.408338+0000","last_peered":"2024-05-04T02:48:29.408338+0000","last_clean":"2024-05-04T02:48:29.408338+0000","last_became_active":"2024-05-04T02:20:14.355988+0000","last_became_peered":"2024-05-04T02:20:14.355988+0000","last_unstale":"2024-05-04T02:48:29.408338+0000","last_undegraded":"2024-05-04T02:48:29.408338+0000","last_fullsized":"2024-05-04T02:48:29.408338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'3","last_scrub_stamp":"2024-05-04T02:48:29.408250+0000","last_deep_scrub":"25'3","last_deep_scrub_stamp":"2024-05-04T02:48:29.408250+0000","last_clean_scrub_stamp":"2024-05-04T02:48:29.408250+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:03:45.957652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"25'73","reported_seq":114,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:33.480426+0000","last_change":"2024-05-04T02:48:33.480458+0000","last_active":"2024-05-04T02:48:33.480426+0000","last_peered":"2024-05-04T02:48:33.480426+0000","last_clean":"2024-05-04T02:48:33.480426+0000","last_became_active":"2024-05-04T02:20:15.295222+0000","last_became_peered":"2024-05-04T02:20:15.295222+0000","last_unstale":"2024-05-04T02:48:33.480426+0000","last_undegraded":"2024-05-04T02:48:33.480426+0000","last_fullsized":"2024-05-04T02:48:33.480426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'73","last_scrub_stamp":"2024-05-04T02:48:33.480312+0000","last_deep_scrub":"25'73","last_deep_scrub_stamp":"2024-05-04T02:48:33.480312+0000","last_clean_scrub_stamp":"2024-05-04T02:48:33.480312+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:47:46.487713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":4655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"25'4","reported_seq":47,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:31.382367+0000","last_change":"2024-05-04T02:48:31.382403+0000","last_active":"2024-05-04T02:48:31.382367+0000","last_peered":"2024-05-04T02:48:31.382367+0000","last_clean":"2024-05-04T02:48:31.382367+0000","last_became_active":"2024-05-04T02:20:14.290893+0000","last_became_peered":"2024-05-04T02:20:14.290893+0000","last_unstale":"2024-05-04T02:48:31.382367+0000","last_undegraded":"2024-05-04T02:48:31.382367+0000","last_fullsized":"2024-05-04T02:48:31.382367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'4","last_scrub_stamp":"2024-05-04T02:48:31.382273+0000","last_deep_scrub":"25'4","last_deep_scrub_stamp":"2024-05-04T02:48:31.382273+0000","last_clean_scrub_stamp":"2024-05-04T02:48:31.382273+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:43:28.316669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"25'86","reported_seq":127,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:31.956962+0000","last_change":"2024-05-04T02:48:31.956987+0000","last_active":"2024-05-04T02:48:31.956962+0000","last_peered":"2024-05-04T02:48:31.956962+0000","last_clean":"2024-05-04T02:48:31.956962+0000","last_became_active":"2024-05-04T02:20:15.291704+0000","last_became_peered":"2024-05-04T02:20:15.291704+0000","last_unstale":"2024-05-04T02:48:31.956962+0000","last_undegraded":"2024-05-04T02:48:31.956962+0000","last_fullsized":"2024-05-04T02:48:31.956962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'86","last_scrub_stamp":"2024-05-04T02:48:31.956886+0000","last_deep_scrub":"25'86","last_deep_scrub_stamp":"2024-05-04T02:48:31.956886+0000","last_clean_scrub_stamp":"2024-05-04T02:48:31.956886+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:33:01.599344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":4969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"25'5","reported_seq":48,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:31.991828+0000","last_change":"2024-05-04T02:48:31.991854+0000","last_active":"2024-05-04T02:48:31.991828+0000","last_peered":"2024-05-04T02:48:31.991828+0000","last_clean":"2024-05-04T02:48:31.991828+0000","last_became_active":"2024-05-04T02:20:14.357940+0000","last_became_peered":"2024-05-04T02:20:14.357940+0000","last_unstale":"2024-05-04T02:48:31.991828+0000","last_undegraded":"2024-05-04T02:48:31.991828+0000","last_fullsized":"2024-05-04T02:48:31.991828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5","last_scrub_stamp":"2024-05-04T02:48:31.991751+0000","last_deep_scrub":"25'5","last_deep_scrub_stamp":"2024-05-04T02:48:31.991751+0000","last_clean_scrub_stamp":"2024-05-04T02:48:31.991751+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:32:06.607530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"25'92","reported_seq":133,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:38.257180+0000","last_change":"2024-05-04T02:48:38.257207+0000","last_active":"2024-05-04T02:48:38.257180+0000","last_peered":"2024-05-04T02:48:38.257180+0000","last_clean":"2024-05-04T02:48:38.257180+0000","last_became_active":"2024-05-04T02:20:15.300374+0000","last_became_peered":"2024-05-04T02:20:15.300374+0000","last_unstale":"2024-05-04T02:48:38.257180+0000","last_undegraded":"2024-05-04T02:48:38.257180+0000","last_fullsized":"2024-05-04T02:48:38.257180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'92","last_scrub_stamp":"2024-05-04T02:48:38.257093+0000","last_deep_scrub":"25'92","last_deep_scrub_stamp":"2024-05-04T02:48:38.257093+0000","last_clean_scrub_stamp":"2024-05-04T02:48:38.257093+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:08:41.039110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":5924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"25'5","reported_seq":48,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:33.410849+0000","last_change":"2024-05-04T02:48:33.410897+0000","last_active":"2024-05-04T02:48:33.410849+0000","last_peered":"2024-05-04T02:48:33.410849+0000","last_clean":"2024-05-04T02:48:33.410849+0000","last_became_active":"2024-05-04T02:20:14.358625+0000","last_became_peered":"2024-05-04T02:20:14.358625+0000","last_unstale":"2024-05-04T02:48:33.410849+0000","last_undegraded":"2024-05-04T02:48:33.410849+0000","last_fullsized":"2024-05-04T02:48:33.410849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5","last_scrub_stamp":"2024-05-04T02:48:33.410717+0000","last_deep_scrub":"25'5","last_deep_scrub_stamp":"2024-05-04T02:48:33.410717+0000","last_clean_scrub_stamp":"2024-05-04T02:48:33.410717+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:15:02.761856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"25'59","reported_seq":100,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:35.120388+0000","last_change":"2024-05-04T02:48:35.120413+0000","last_active":"2024-05-04T02:48:35.120388+0000","last_peered":"2024-05-04T02:48:35.120388+0000","last_clean":"2024-05-04T02:48:35.120388+0000","last_became_active":"2024-05-04T02:20:15.306572+0000","last_became_peered":"2024-05-04T02:20:15.306572+0000","last_unstale":"2024-05-04T02:48:35.120388+0000","last_undegraded":"2024-05-04T02:48:35.120388+0000","last_fullsized":"2024-05-04T02:48:35.120388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'59","last_scrub_stamp":"2024-05-04T02:48:35.120312+0000","last_deep_scrub":"25'59","last_deep_scrub_stamp":"2024-05-04T02:48:35.120312+0000","last_clean_scrub_stamp":"2024-05-04T02:48:35.120312+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:44:29.336702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":3639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"25'610","reported_seq":653,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:29.991567+0000","last_change":"2024-05-04T02:48:29.991594+0000","last_active":"2024-05-04T02:48:29.991567+0000","last_peered":"2024-05-04T02:48:29.991567+0000","last_clean":"2024-05-04T02:48:29.991567+0000","last_became_active":"2024-05-04T02:20:14.292564+0000","last_became_peered":"2024-05-04T02:20:14.292564+0000","last_unstale":"2024-05-04T02:48:29.991567+0000","last_undegraded":"2024-05-04T02:48:29.991567+0000","last_fullsized":"2024-05-04T02:48:29.991567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'610","last_scrub_stamp":"2024-05-04T02:48:29.991482+0000","last_deep_scrub":"25'610","last_deep_scrub_stamp":"2024-05-04T02:48:29.991482+0000","last_clean_scrub_stamp":"2024-05-04T02:48:29.991482+0000","objects_scrubbed":2,"log_size":610,"log_dups_size":0,"ondisk_log_size":610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:16:11.120180+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":607,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"25'71","reported_seq":113,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:33.798900+0000","last_change":"2024-05-04T02:48:33.798929+0000","last_active":"2024-05-04T02:48:33.798900+0000","last_peered":"2024-05-04T02:48:33.798900+0000","last_clean":"2024-05-04T02:48:33.798900+0000","last_became_active":"2024-05-04T02:20:15.298018+0000","last_became_peered":"2024-05-04T02:20:15.298018+0000","last_unstale":"2024-05-04T02:48:33.798900+0000","last_undegraded":"2024-05-04T02:48:33.798900+0000","last_fullsized":"2024-05-04T02:48:33.798900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'71","last_scrub_stamp":"2024-05-04T02:48:33.798820+0000","last_deep_scrub":"25'71","last_deep_scrub_stamp":"2024-05-04T02:48:33.798820+0000","last_clean_scrub_stamp":"2024-05-04T02:48:33.798820+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:56:33.848832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":3497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"25'833","reported_seq":877,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:34.033665+0000","last_change":"2024-05-04T02:48:34.033697+0000","last_active":"2024-05-04T02:48:34.033665+0000","last_peered":"2024-05-04T02:48:34.033665+0000","last_clean":"2024-05-04T02:48:34.033665+0000","last_became_active":"2024-05-04T02:20:14.359886+0000","last_became_peered":"2024-05-04T02:20:14.359886+0000","last_unstale":"2024-05-04T02:48:34.033665+0000","last_undegraded":"2024-05-04T02:48:34.033665+0000","last_fullsized":"2024-05-04T02:48:34.033665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'833","last_scrub_stamp":"2024-05-04T02:48:34.033595+0000","last_deep_scrub":"25'833","last_deep_scrub_stamp":"2024-05-04T02:48:34.033595+0000","last_clean_scrub_stamp":"2024-05-04T02:48:34.033595+0000","objects_scrubbed":4,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:16:15.162293+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":827,"num_write_kb":4536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"25'64","reported_seq":102,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:13.606366+0000","last_change":"2024-05-04T02:20:53.117045+0000","last_active":"2024-05-04T02:48:13.606366+0000","last_peered":"2024-05-04T02:48:13.606366+0000","last_clean":"2024-05-04T02:48:13.606366+0000","last_became_active":"2024-05-04T02:20:53.116761+0000","last_became_peered":"2024-05-04T02:20:53.116761+0000","last_unstale":"2024-05-04T02:48:13.606366+0000","last_undegraded":"2024-05-04T02:48:13.606366+0000","last_fullsized":"2024-05-04T02:48:13.606366+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:20:14.110992+0000","last_clean_scrub_stamp":"2024-05-04T02:20:14.110992+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":3872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"25'11","reported_seq":55,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:25.067875+0000","last_change":"2024-05-04T02:48:25.067902+0000","last_active":"2024-05-04T02:48:25.067875+0000","last_peered":"2024-05-04T02:48:25.067875+0000","last_clean":"2024-05-04T02:48:25.067875+0000","last_became_active":"2024-05-04T02:20:14.274604+0000","last_became_peered":"2024-05-04T02:20:14.274604+0000","last_unstale":"2024-05-04T02:48:25.067875+0000","last_undegraded":"2024-05-04T02:48:25.067875+0000","last_fullsized":"2024-05-04T02:48:25.067875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'11","last_scrub_stamp":"2024-05-04T02:48:25.067792+0000","last_deep_scrub":"25'11","last_deep_scrub_stamp":"2024-05-04T02:48:25.067792+0000","last_clean_scrub_stamp":"2024-05-04T02:48:25.067792+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:38:57.277782+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"25'79","reported_seq":121,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:31.154219+0000","last_change":"2024-05-04T02:48:31.154265+0000","last_active":"2024-05-04T02:48:31.154219+0000","last_peered":"2024-05-04T02:48:31.154219+0000","last_clean":"2024-05-04T02:48:31.154219+0000","last_became_active":"2024-05-04T02:20:15.300052+0000","last_became_peered":"2024-05-04T02:20:15.300052+0000","last_unstale":"2024-05-04T02:48:31.154219+0000","last_undegraded":"2024-05-04T02:48:31.154219+0000","last_fullsized":"2024-05-04T02:48:31.154219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'79","last_scrub_stamp":"2024-05-04T02:48:31.154087+0000","last_deep_scrub":"25'79","last_deep_scrub_stamp":"2024-05-04T02:48:31.154087+0000","last_clean_scrub_stamp":"2024-05-04T02:48:31.154087+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:37:41.297077+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":4963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"25'6","reported_seq":50,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:30.423759+0000","last_change":"2024-05-04T02:48:30.423784+0000","last_active":"2024-05-04T02:48:30.423759+0000","last_peered":"2024-05-04T02:48:30.423759+0000","last_clean":"2024-05-04T02:48:30.423759+0000","last_became_active":"2024-05-04T02:20:14.289826+0000","last_became_peered":"2024-05-04T02:20:14.289826+0000","last_unstale":"2024-05-04T02:48:30.423759+0000","last_undegraded":"2024-05-04T02:48:30.423759+0000","last_fullsized":"2024-05-04T02:48:30.423759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6","last_scrub_stamp":"2024-05-04T02:48:30.423687+0000","last_deep_scrub":"25'6","last_deep_scrub_stamp":"2024-05-04T02:48:30.423687+0000","last_clean_scrub_stamp":"2024-05-04T02:48:30.423687+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:51:34.451382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"25'96","reported_seq":138,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:43.175466+0000","last_change":"2024-05-04T02:48:43.175494+0000","last_active":"2024-05-04T02:48:43.175466+0000","last_peered":"2024-05-04T02:48:43.175466+0000","last_clean":"2024-05-04T02:48:43.175466+0000","last_became_active":"2024-05-04T02:20:15.302963+0000","last_became_peered":"2024-05-04T02:20:15.302963+0000","last_unstale":"2024-05-04T02:48:43.175466+0000","last_undegraded":"2024-05-04T02:48:43.175466+0000","last_fullsized":"2024-05-04T02:48:43.175466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'96","last_scrub_stamp":"2024-05-04T02:48:43.175384+0000","last_deep_scrub":"25'96","last_deep_scrub_stamp":"2024-05-04T02:48:43.175384+0000","last_clean_scrub_stamp":"2024-05-04T02:48:43.175384+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:14:16.187424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":14780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"25'5","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:30.962313+0000","last_change":"2024-05-04T02:48:30.962362+0000","last_active":"2024-05-04T02:48:30.962313+0000","last_peered":"2024-05-04T02:48:30.962313+0000","last_clean":"2024-05-04T02:48:30.962313+0000","last_became_active":"2024-05-04T02:20:14.358494+0000","last_became_peered":"2024-05-04T02:20:14.358494+0000","last_unstale":"2024-05-04T02:48:30.962313+0000","last_undegraded":"2024-05-04T02:48:30.962313+0000","last_fullsized":"2024-05-04T02:48:30.962313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5","last_scrub_stamp":"2024-05-04T02:48:30.962224+0000","last_deep_scrub":"25'5","last_deep_scrub_stamp":"2024-05-04T02:48:30.962224+0000","last_clean_scrub_stamp":"2024-05-04T02:48:30.962224+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:54:53.338243+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"25'51","reported_seq":93,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:35.986422+0000","last_change":"2024-05-04T02:48:35.986449+0000","last_active":"2024-05-04T02:48:35.986422+0000","last_peered":"2024-05-04T02:48:35.986422+0000","last_clean":"2024-05-04T02:48:35.986422+0000","last_became_active":"2024-05-04T02:20:15.294400+0000","last_became_peered":"2024-05-04T02:20:15.294400+0000","last_unstale":"2024-05-04T02:48:35.986422+0000","last_undegraded":"2024-05-04T02:48:35.986422+0000","last_fullsized":"2024-05-04T02:48:35.986422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'51","last_scrub_stamp":"2024-05-04T02:48:35.986343+0000","last_deep_scrub":"25'51","last_deep_scrub_stamp":"2024-05-04T02:48:35.986343+0000","last_clean_scrub_stamp":"2024-05-04T02:48:35.986343+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:33:05.628801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":2930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"25'16","reported_seq":60,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:26.997820+0000","last_change":"2024-05-04T02:48:26.997886+0000","last_active":"2024-05-04T02:48:26.997820+0000","last_peered":"2024-05-04T02:48:26.997820+0000","last_clean":"2024-05-04T02:48:26.997820+0000","last_became_active":"2024-05-04T02:20:14.269238+0000","last_became_peered":"2024-05-04T02:20:14.269238+0000","last_unstale":"2024-05-04T02:48:26.997820+0000","last_undegraded":"2024-05-04T02:48:26.997820+0000","last_fullsized":"2024-05-04T02:48:26.997820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'16","last_scrub_stamp":"2024-05-04T02:48:26.997726+0000","last_deep_scrub":"25'16","last_deep_scrub_stamp":"2024-05-04T02:48:26.997726+0000","last_clean_scrub_stamp":"2024-05-04T02:48:26.997726+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:21:24.249644+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"25'64","reported_seq":106,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:46.189365+0000","last_change":"2024-05-04T02:48:46.189390+0000","last_active":"2024-05-04T02:48:46.189365+0000","last_peered":"2024-05-04T02:48:46.189365+0000","last_clean":"2024-05-04T02:48:46.189365+0000","last_became_active":"2024-05-04T02:20:15.302736+0000","last_became_peered":"2024-05-04T02:20:15.302736+0000","last_unstale":"2024-05-04T02:48:46.189365+0000","last_undegraded":"2024-05-04T02:48:46.189365+0000","last_fullsized":"2024-05-04T02:48:46.189365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'64","last_scrub_stamp":"2024-05-04T02:48:46.189282+0000","last_deep_scrub":"25'64","last_deep_scrub_stamp":"2024-05-04T02:48:46.189282+0000","last_clean_scrub_stamp":"2024-05-04T02:48:46.189282+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:07:29.625184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":3572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'6","reported_seq":50,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:28.709408+0000","last_change":"2024-05-04T02:48:28.709441+0000","last_active":"2024-05-04T02:48:28.709408+0000","last_peered":"2024-05-04T02:48:28.709408+0000","last_clean":"2024-05-04T02:48:28.709408+0000","last_became_active":"2024-05-04T02:20:14.271883+0000","last_became_peered":"2024-05-04T02:20:14.271883+0000","last_unstale":"2024-05-04T02:48:28.709408+0000","last_undegraded":"2024-05-04T02:48:28.709408+0000","last_fullsized":"2024-05-04T02:48:28.709408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6","last_scrub_stamp":"2024-05-04T02:48:28.709327+0000","last_deep_scrub":"25'6","last_deep_scrub_stamp":"2024-05-04T02:48:28.709327+0000","last_clean_scrub_stamp":"2024-05-04T02:48:28.709327+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:11:53.616458+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"25'35","reported_seq":77,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:42.184747+0000","last_change":"2024-05-04T02:48:42.184774+0000","last_active":"2024-05-04T02:48:42.184747+0000","last_peered":"2024-05-04T02:48:42.184747+0000","last_clean":"2024-05-04T02:48:42.184747+0000","last_became_active":"2024-05-04T02:20:15.301880+0000","last_became_peered":"2024-05-04T02:20:15.301880+0000","last_unstale":"2024-05-04T02:48:42.184747+0000","last_undegraded":"2024-05-04T02:48:42.184747+0000","last_fullsized":"2024-05-04T02:48:42.184747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'35","last_scrub_stamp":"2024-05-04T02:48:42.184663+0000","last_deep_scrub":"25'35","last_deep_scrub_stamp":"2024-05-04T02:48:42.184663+0000","last_clean_scrub_stamp":"2024-05-04T02:48:42.184663+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:27:27.483989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":1775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'5","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:30.010414+0000","last_change":"2024-05-04T02:48:30.010462+0000","last_active":"2024-05-04T02:48:30.010414+0000","last_peered":"2024-05-04T02:48:30.010414+0000","last_clean":"2024-05-04T02:48:30.010414+0000","last_became_active":"2024-05-04T02:20:14.290132+0000","last_became_peered":"2024-05-04T02:20:14.290132+0000","last_unstale":"2024-05-04T02:48:30.010414+0000","last_undegraded":"2024-05-04T02:48:30.010414+0000","last_fullsized":"2024-05-04T02:48:30.010414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5","last_scrub_stamp":"2024-05-04T02:48:30.010299+0000","last_deep_scrub":"25'5","last_deep_scrub_stamp":"2024-05-04T02:48:30.010299+0000","last_clean_scrub_stamp":"2024-05-04T02:48:30.010299+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:04:10.909702+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"25'56","reported_seq":98,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:41.135706+0000","last_change":"2024-05-04T02:48:41.135733+0000","last_active":"2024-05-04T02:48:41.135706+0000","last_peered":"2024-05-04T02:48:41.135706+0000","last_clean":"2024-05-04T02:48:41.135706+0000","last_became_active":"2024-05-04T02:20:15.301798+0000","last_became_peered":"2024-05-04T02:20:15.301798+0000","last_unstale":"2024-05-04T02:48:41.135706+0000","last_undegraded":"2024-05-04T02:48:41.135706+0000","last_fullsized":"2024-05-04T02:48:41.135706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'56","last_scrub_stamp":"2024-05-04T02:48:41.135628+0000","last_deep_scrub":"25'56","last_deep_scrub_stamp":"2024-05-04T02:48:41.135628+0000","last_clean_scrub_stamp":"2024-05-04T02:48:41.135628+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:28:33.527308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":3906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"25'2","reported_seq":46,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:27.044115+0000","last_change":"2024-05-04T02:48:27.044165+0000","last_active":"2024-05-04T02:48:27.044115+0000","last_peered":"2024-05-04T02:48:27.044115+0000","last_clean":"2024-05-04T02:48:27.044115+0000","last_became_active":"2024-05-04T02:20:14.274609+0000","last_became_peered":"2024-05-04T02:20:14.274609+0000","last_unstale":"2024-05-04T02:48:27.044115+0000","last_undegraded":"2024-05-04T02:48:27.044115+0000","last_fullsized":"2024-05-04T02:48:27.044115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-05-04T02:48:27.043997+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-05-04T02:48:27.043997+0000","last_clean_scrub_stamp":"2024-05-04T02:48:27.043997+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:54:49.420016+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"25'84","reported_seq":126,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:40.286224+0000","last_change":"2024-05-04T02:48:40.286250+0000","last_active":"2024-05-04T02:48:40.286224+0000","last_peered":"2024-05-04T02:48:40.286224+0000","last_clean":"2024-05-04T02:48:40.286224+0000","last_became_active":"2024-05-04T02:20:15.301880+0000","last_became_peered":"2024-05-04T02:20:15.301880+0000","last_unstale":"2024-05-04T02:48:40.286224+0000","last_undegraded":"2024-05-04T02:48:40.286224+0000","last_fullsized":"2024-05-04T02:48:40.286224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'84","last_scrub_stamp":"2024-05-04T02:48:40.286133+0000","last_deep_scrub":"25'84","last_deep_scrub_stamp":"2024-05-04T02:48:40.286133+0000","last_clean_scrub_stamp":"2024-05-04T02:48:40.286133+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:43:10.451669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70,"num_write_kb":6433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"25'2","reported_seq":46,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:28.976531+0000","last_change":"2024-05-04T02:48:28.976558+0000","last_active":"2024-05-04T02:48:28.976531+0000","last_peered":"2024-05-04T02:48:28.976531+0000","last_clean":"2024-05-04T02:48:28.976531+0000","last_became_active":"2024-05-04T02:20:14.287992+0000","last_became_peered":"2024-05-04T02:20:14.287992+0000","last_unstale":"2024-05-04T02:48:28.976531+0000","last_undegraded":"2024-05-04T02:48:28.976531+0000","last_fullsized":"2024-05-04T02:48:28.976531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-05-04T02:48:28.976446+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-05-04T02:48:28.976446+0000","last_clean_scrub_stamp":"2024-05-04T02:48:28.976446+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:56:46.362493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"25'61","reported_seq":103,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:45.218703+0000","last_change":"2024-05-04T02:48:45.218747+0000","last_active":"2024-05-04T02:48:45.218703+0000","last_peered":"2024-05-04T02:48:45.218703+0000","last_clean":"2024-05-04T02:48:45.218703+0000","last_became_active":"2024-05-04T02:20:15.303601+0000","last_became_peered":"2024-05-04T02:20:15.303601+0000","last_unstale":"2024-05-04T02:48:45.218703+0000","last_undegraded":"2024-05-04T02:48:45.218703+0000","last_fullsized":"2024-05-04T02:48:45.218703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'61","last_scrub_stamp":"2024-05-04T02:48:45.218584+0000","last_deep_scrub":"25'61","last_deep_scrub_stamp":"2024-05-04T02:48:45.218584+0000","last_clean_scrub_stamp":"2024-05-04T02:48:45.218584+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:28:35.606825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":2391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"25'74","reported_seq":143,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:32.200640+0000","last_change":"2024-05-04T02:48:32.200673+0000","last_active":"2024-05-04T02:48:32.200640+0000","last_peered":"2024-05-04T02:48:32.200640+0000","last_clean":"2024-05-04T02:48:32.200640+0000","last_became_active":"2024-05-04T02:20:02.918859+0000","last_became_peered":"2024-05-04T02:20:02.918859+0000","last_unstale":"2024-05-04T02:48:32.200640+0000","last_undegraded":"2024-05-04T02:48:32.200640+0000","last_fullsized":"2024-05-04T02:48:32.200640+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'74","last_scrub_stamp":"2024-05-04T02:48:32.200566+0000","last_deep_scrub":"25'74","last_deep_scrub_stamp":"2024-05-04T02:48:32.200566+0000","last_clean_scrub_stamp":"2024-05-04T02:48:32.200566+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:43:25.005262+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"25'1","reported_seq":46,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:29.453470+0000","last_change":"2024-05-04T02:48:29.453495+0000","last_active":"2024-05-04T02:48:29.453470+0000","last_peered":"2024-05-04T02:48:29.453470+0000","last_clean":"2024-05-04T02:48:29.453470+0000","last_became_active":"2024-05-04T02:20:14.289597+0000","last_became_peered":"2024-05-04T02:20:14.289597+0000","last_unstale":"2024-05-04T02:48:29.453470+0000","last_undegraded":"2024-05-04T02:48:29.453470+0000","last_fullsized":"2024-05-04T02:48:29.453470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-05-04T02:48:29.453384+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-05-04T02:48:29.453384+0000","last_clean_scrub_stamp":"2024-05-04T02:48:29.453384+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:23:18.324922+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"25'46","reported_seq":89,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:40.667574+0000","last_change":"2024-05-04T02:48:40.667605+0000","last_active":"2024-05-04T02:48:40.667574+0000","last_peered":"2024-05-04T02:48:40.667574+0000","last_clean":"2024-05-04T02:48:40.667574+0000","last_became_active":"2024-05-04T02:20:15.306640+0000","last_became_peered":"2024-05-04T02:20:15.306640+0000","last_unstale":"2024-05-04T02:48:40.667574+0000","last_undegraded":"2024-05-04T02:48:40.667574+0000","last_fullsized":"2024-05-04T02:48:40.667574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'46","last_scrub_stamp":"2024-05-04T02:48:40.667484+0000","last_deep_scrub":"25'46","last_deep_scrub_stamp":"2024-05-04T02:48:40.667484+0000","last_clean_scrub_stamp":"2024-05-04T02:48:40.667484+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:36:40.579592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":2916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"25'363","reported_seq":409,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:34.244227+0000","last_change":"2024-05-04T02:48:34.244256+0000","last_active":"2024-05-04T02:48:34.244227+0000","last_peered":"2024-05-04T02:48:34.244227+0000","last_clean":"2024-05-04T02:48:34.244227+0000","last_became_active":"2024-05-04T02:20:14.291044+0000","last_became_peered":"2024-05-04T02:20:14.291044+0000","last_unstale":"2024-05-04T02:48:34.244227+0000","last_undegraded":"2024-05-04T02:48:34.244227+0000","last_fullsized":"2024-05-04T02:48:34.244227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'363","last_scrub_stamp":"2024-05-04T02:48:34.244126+0000","last_deep_scrub":"25'363","last_deep_scrub_stamp":"2024-05-04T02:48:34.244126+0000","last_clean_scrub_stamp":"2024-05-04T02:48:34.244126+0000","objects_scrubbed":1,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:27:27.291767+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3804637,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":357,"num_write_kb":3904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"25'52","reported_seq":95,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:33.074483+0000","last_change":"2024-05-04T02:48:33.074532+0000","last_active":"2024-05-04T02:48:33.074483+0000","last_peered":"2024-05-04T02:48:33.074483+0000","last_clean":"2024-05-04T02:48:33.074483+0000","last_became_active":"2024-05-04T02:20:15.305512+0000","last_became_peered":"2024-05-04T02:20:15.305512+0000","last_unstale":"2024-05-04T02:48:33.074483+0000","last_undegraded":"2024-05-04T02:48:33.074483+0000","last_fullsized":"2024-05-04T02:48:33.074483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'52","last_scrub_stamp":"2024-05-04T02:48:33.074376+0000","last_deep_scrub":"25'52","last_deep_scrub_stamp":"2024-05-04T02:48:33.074376+0000","last_clean_scrub_stamp":"2024-05-04T02:48:33.074376+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:31:19.704666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":2895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"25'849","reported_seq":1735,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:28.001545+0000","last_change":"2024-05-04T02:48:28.001571+0000","last_active":"2024-05-04T02:48:28.001545+0000","last_peered":"2024-05-04T02:48:28.001545+0000","last_clean":"2024-05-04T02:48:28.001545+0000","last_became_active":"2024-05-04T02:20:14.287335+0000","last_became_peered":"2024-05-04T02:20:14.287335+0000","last_unstale":"2024-05-04T02:48:28.001545+0000","last_undegraded":"2024-05-04T02:48:28.001545+0000","last_fullsized":"2024-05-04T02:48:28.001545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'849","last_scrub_stamp":"2024-05-04T02:48:28.001477+0000","last_deep_scrub":"25'849","last_deep_scrub_stamp":"2024-05-04T02:48:28.001477+0000","last_clean_scrub_stamp":"2024-05-04T02:48:28.001477+0000","objects_scrubbed":1,"log_size":849,"log_dups_size":0,"ondisk_log_size":849,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:02:23.155893+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":181194,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":841,"num_read_kb":897,"num_write":844,"num_write_kb":899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"25'71","reported_seq":115,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:33.922413+0000","last_change":"2024-05-04T02:48:33.922440+0000","last_active":"2024-05-04T02:48:33.922413+0000","last_peered":"2024-05-04T02:48:33.922413+0000","last_clean":"2024-05-04T02:48:33.922413+0000","last_became_active":"2024-05-04T02:20:15.297010+0000","last_became_peered":"2024-05-04T02:20:15.297010+0000","last_unstale":"2024-05-04T02:48:33.922413+0000","last_undegraded":"2024-05-04T02:48:33.922413+0000","last_fullsized":"2024-05-04T02:48:33.922413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'71","last_scrub_stamp":"2024-05-04T02:48:33.922328+0000","last_deep_scrub":"25'71","last_deep_scrub_stamp":"2024-05-04T02:48:33.922328+0000","last_clean_scrub_stamp":"2024-05-04T02:48:33.922328+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:32:35.921185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":1942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"25'5","reported_seq":50,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:32.369390+0000","last_change":"2024-05-04T02:48:32.369435+0000","last_active":"2024-05-04T02:48:32.369390+0000","last_peered":"2024-05-04T02:48:32.369390+0000","last_clean":"2024-05-04T02:48:32.369390+0000","last_became_active":"2024-05-04T02:20:14.292595+0000","last_became_peered":"2024-05-04T02:20:14.292595+0000","last_unstale":"2024-05-04T02:48:32.369390+0000","last_undegraded":"2024-05-04T02:48:32.369390+0000","last_fullsized":"2024-05-04T02:48:32.369390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5","last_scrub_stamp":"2024-05-04T02:48:32.369296+0000","last_deep_scrub":"25'5","last_deep_scrub_stamp":"2024-05-04T02:48:32.369296+0000","last_clean_scrub_stamp":"2024-05-04T02:48:32.369296+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:28:41.741808+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"25'85","reported_seq":128,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:30.767252+0000","last_change":"2024-05-04T02:48:30.767279+0000","last_active":"2024-05-04T02:48:30.767252+0000","last_peered":"2024-05-04T02:48:30.767252+0000","last_clean":"2024-05-04T02:48:30.767252+0000","last_became_active":"2024-05-04T02:20:15.296075+0000","last_became_peered":"2024-05-04T02:20:15.296075+0000","last_unstale":"2024-05-04T02:48:30.767252+0000","last_undegraded":"2024-05-04T02:48:30.767252+0000","last_fullsized":"2024-05-04T02:48:30.767252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'85","last_scrub_stamp":"2024-05-04T02:48:30.767170+0000","last_deep_scrub":"25'85","last_deep_scrub_stamp":"2024-05-04T02:48:30.767170+0000","last_clean_scrub_stamp":"2024-05-04T02:48:30.767170+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:34:54.473302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":6268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"25'3","reported_seq":48,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:26.023169+0000","last_change":"2024-05-04T02:48:26.023195+0000","last_active":"2024-05-04T02:48:26.023169+0000","last_peered":"2024-05-04T02:48:26.023169+0000","last_clean":"2024-05-04T02:48:26.023169+0000","last_became_active":"2024-05-04T02:20:14.253513+0000","last_became_peered":"2024-05-04T02:20:14.253513+0000","last_unstale":"2024-05-04T02:48:26.023169+0000","last_undegraded":"2024-05-04T02:48:26.023169+0000","last_fullsized":"2024-05-04T02:48:26.023169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'3","last_scrub_stamp":"2024-05-04T02:48:26.023077+0000","last_deep_scrub":"25'3","last_deep_scrub_stamp":"2024-05-04T02:48:26.023077+0000","last_clean_scrub_stamp":"2024-05-04T02:48:26.023077+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:40:14.800077+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"25'68","reported_seq":111,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:34.367493+0000","last_change":"2024-05-04T02:48:34.367534+0000","last_active":"2024-05-04T02:48:34.367493+0000","last_peered":"2024-05-04T02:48:34.367493+0000","last_clean":"2024-05-04T02:48:34.367493+0000","last_became_active":"2024-05-04T02:20:15.300251+0000","last_became_peered":"2024-05-04T02:20:15.300251+0000","last_unstale":"2024-05-04T02:48:34.367493+0000","last_undegraded":"2024-05-04T02:48:34.367493+0000","last_fullsized":"2024-05-04T02:48:34.367493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'68","last_scrub_stamp":"2024-05-04T02:48:34.367372+0000","last_deep_scrub":"25'68","last_deep_scrub_stamp":"2024-05-04T02:48:34.367372+0000","last_clean_scrub_stamp":"2024-05-04T02:48:34.367372+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:58:38.334270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":2367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"25'2","reported_seq":47,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:33.193319+0000","last_change":"2024-05-04T02:48:33.193351+0000","last_active":"2024-05-04T02:48:33.193319+0000","last_peered":"2024-05-04T02:48:33.193319+0000","last_clean":"2024-05-04T02:48:33.193319+0000","last_became_active":"2024-05-04T02:20:14.290952+0000","last_became_peered":"2024-05-04T02:20:14.290952+0000","last_unstale":"2024-05-04T02:48:33.193319+0000","last_undegraded":"2024-05-04T02:48:33.193319+0000","last_fullsized":"2024-05-04T02:48:33.193319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-05-04T02:48:33.193244+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-05-04T02:48:33.193244+0000","last_clean_scrub_stamp":"2024-05-04T02:48:33.193244+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:15:02.544383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"25'68","reported_seq":111,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:32.943758+0000","last_change":"2024-05-04T02:48:32.943795+0000","last_active":"2024-05-04T02:48:32.943758+0000","last_peered":"2024-05-04T02:48:32.943758+0000","last_clean":"2024-05-04T02:48:32.943758+0000","last_became_active":"2024-05-04T02:20:15.296562+0000","last_became_peered":"2024-05-04T02:20:15.296562+0000","last_unstale":"2024-05-04T02:48:32.943758+0000","last_undegraded":"2024-05-04T02:48:32.943758+0000","last_fullsized":"2024-05-04T02:48:32.943758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'68","last_scrub_stamp":"2024-05-04T02:48:32.943672+0000","last_deep_scrub":"25'68","last_deep_scrub_stamp":"2024-05-04T02:48:32.943672+0000","last_clean_scrub_stamp":"2024-05-04T02:48:32.943672+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:31:22.084627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":2660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"25'1353","reported_seq":1398,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:30.962058+0000","last_change":"2024-05-04T02:48:30.962089+0000","last_active":"2024-05-04T02:48:30.962058+0000","last_peered":"2024-05-04T02:48:30.962058+0000","last_clean":"2024-05-04T02:48:30.962058+0000","last_became_active":"2024-05-04T02:20:14.358621+0000","last_became_peered":"2024-05-04T02:20:14.358621+0000","last_unstale":"2024-05-04T02:48:30.962058+0000","last_undegraded":"2024-05-04T02:48:30.962058+0000","last_fullsized":"2024-05-04T02:48:30.962058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1353","last_scrub_stamp":"2024-05-04T02:48:30.961971+0000","last_deep_scrub":"25'1353","last_deep_scrub_stamp":"2024-05-04T02:48:30.961971+0000","last_clean_scrub_stamp":"2024-05-04T02:48:30.961971+0000","objects_scrubbed":1,"log_size":1353,"log_dups_size":0,"ondisk_log_size":1353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:23:36.845809+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3394,"num_write_kb":1205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"25'74","reported_seq":117,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:35.548670+0000","last_change":"2024-05-04T02:48:35.548697+0000","last_active":"2024-05-04T02:48:35.548670+0000","last_peered":"2024-05-04T02:48:35.548670+0000","last_clean":"2024-05-04T02:48:35.548670+0000","last_became_active":"2024-05-04T02:20:15.299678+0000","last_became_peered":"2024-05-04T02:20:15.299678+0000","last_unstale":"2024-05-04T02:48:35.548670+0000","last_undegraded":"2024-05-04T02:48:35.548670+0000","last_fullsized":"2024-05-04T02:48:35.548670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'74","last_scrub_stamp":"2024-05-04T02:48:35.548586+0000","last_deep_scrub":"25'74","last_deep_scrub_stamp":"2024-05-04T02:48:35.548586+0000","last_clean_scrub_stamp":"2024-05-04T02:48:35.548586+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:43:28.353282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":5134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"25'7","reported_seq":52,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:32.989279+0000","last_change":"2024-05-04T02:48:32.989306+0000","last_active":"2024-05-04T02:48:32.989279+0000","last_peered":"2024-05-04T02:48:32.989279+0000","last_clean":"2024-05-04T02:48:32.989279+0000","last_became_active":"2024-05-04T02:20:14.358524+0000","last_became_peered":"2024-05-04T02:20:14.358524+0000","last_unstale":"2024-05-04T02:48:32.989279+0000","last_undegraded":"2024-05-04T02:48:32.989279+0000","last_fullsized":"2024-05-04T02:48:32.989279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7","last_scrub_stamp":"2024-05-04T02:48:32.989205+0000","last_deep_scrub":"25'7","last_deep_scrub_stamp":"2024-05-04T02:48:32.989205+0000","last_clean_scrub_stamp":"2024-05-04T02:48:32.989205+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:40:12.136448+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"25'73","reported_seq":116,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:28.131878+0000","last_change":"2024-05-04T02:48:28.131878+0000","last_active":"2024-05-04T02:48:28.131878+0000","last_peered":"2024-05-04T02:48:28.131878+0000","last_clean":"2024-05-04T02:48:28.131878+0000","last_became_active":"2024-05-04T02:20:15.293602+0000","last_became_peered":"2024-05-04T02:20:15.293602+0000","last_unstale":"2024-05-04T02:48:28.131878+0000","last_undegraded":"2024-05-04T02:48:28.131878+0000","last_fullsized":"2024-05-04T02:48:28.131878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'73","last_scrub_stamp":"2024-05-04T02:48:28.131693+0000","last_deep_scrub":"25'73","last_deep_scrub_stamp":"2024-05-04T02:48:28.131693+0000","last_clean_scrub_stamp":"2024-05-04T02:48:28.131693+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:33:47.960266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":2324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"25'6","reported_seq":51,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:35.226727+0000","last_change":"2024-05-04T02:48:35.226753+0000","last_active":"2024-05-04T02:48:35.226727+0000","last_peered":"2024-05-04T02:48:35.226727+0000","last_clean":"2024-05-04T02:48:35.226727+0000","last_became_active":"2024-05-04T02:20:14.291068+0000","last_became_peered":"2024-05-04T02:20:14.291068+0000","last_unstale":"2024-05-04T02:48:35.226727+0000","last_undegraded":"2024-05-04T02:48:35.226727+0000","last_fullsized":"2024-05-04T02:48:35.226727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6","last_scrub_stamp":"2024-05-04T02:48:35.226647+0000","last_deep_scrub":"25'6","last_deep_scrub_stamp":"2024-05-04T02:48:35.226647+0000","last_clean_scrub_stamp":"2024-05-04T02:48:35.226647+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:19:07.421551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"25'72","reported_seq":115,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:29.737124+0000","last_change":"2024-05-04T02:48:29.737177+0000","last_active":"2024-05-04T02:48:29.737124+0000","last_peered":"2024-05-04T02:48:29.737124+0000","last_clean":"2024-05-04T02:48:29.737124+0000","last_became_active":"2024-05-04T02:20:15.247583+0000","last_became_peered":"2024-05-04T02:20:15.247583+0000","last_unstale":"2024-05-04T02:48:29.737124+0000","last_undegraded":"2024-05-04T02:48:29.737124+0000","last_fullsized":"2024-05-04T02:48:29.737124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'72","last_scrub_stamp":"2024-05-04T02:48:29.736991+0000","last_deep_scrub":"25'72","last_deep_scrub_stamp":"2024-05-04T02:48:29.736991+0000","last_clean_scrub_stamp":"2024-05-04T02:48:29.736991+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:28:55.144297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":6637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"25'3","reported_seq":48,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:28.963198+0000","last_change":"2024-05-04T02:48:28.963224+0000","last_active":"2024-05-04T02:48:28.963198+0000","last_peered":"2024-05-04T02:48:28.963198+0000","last_clean":"2024-05-04T02:48:28.963198+0000","last_became_active":"2024-05-04T02:20:14.289360+0000","last_became_peered":"2024-05-04T02:20:14.289360+0000","last_unstale":"2024-05-04T02:48:28.963198+0000","last_undegraded":"2024-05-04T02:48:28.963198+0000","last_fullsized":"2024-05-04T02:48:28.963198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'3","last_scrub_stamp":"2024-05-04T02:48:28.963113+0000","last_deep_scrub":"25'3","last_deep_scrub_stamp":"2024-05-04T02:48:28.963113+0000","last_clean_scrub_stamp":"2024-05-04T02:48:28.963113+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:40:08.110356+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"25'64","reported_seq":107,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:34.521433+0000","last_change":"2024-05-04T02:48:34.521486+0000","last_active":"2024-05-04T02:48:34.521433+0000","last_peered":"2024-05-04T02:48:34.521433+0000","last_clean":"2024-05-04T02:48:34.521433+0000","last_became_active":"2024-05-04T02:20:15.296330+0000","last_became_peered":"2024-05-04T02:20:15.296330+0000","last_unstale":"2024-05-04T02:48:34.521433+0000","last_undegraded":"2024-05-04T02:48:34.521433+0000","last_fullsized":"2024-05-04T02:48:34.521433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'64","last_scrub_stamp":"2024-05-04T02:48:34.521323+0000","last_deep_scrub":"25'64","last_deep_scrub_stamp":"2024-05-04T02:48:34.521323+0000","last_clean_scrub_stamp":"2024-05-04T02:48:34.521323+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:51:38.549018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":4339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":45,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:28.000047+0000","last_change":"2024-05-04T02:48:28.000087+0000","last_active":"2024-05-04T02:48:28.000047+0000","last_peered":"2024-05-04T02:48:28.000047+0000","last_clean":"2024-05-04T02:48:28.000047+0000","last_became_active":"2024-05-04T02:20:14.288769+0000","last_became_peered":"2024-05-04T02:20:14.288769+0000","last_unstale":"2024-05-04T02:48:28.000047+0000","last_undegraded":"2024-05-04T02:48:28.000047+0000","last_fullsized":"2024-05-04T02:48:28.000047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:48:27.999913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:48:27.999913+0000","last_clean_scrub_stamp":"2024-05-04T02:48:27.999913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:32:02.615692+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"25'89","reported_seq":131,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:32.455706+0000","last_change":"2024-05-04T02:48:32.455736+0000","last_active":"2024-05-04T02:48:32.455706+0000","last_peered":"2024-05-04T02:48:32.455706+0000","last_clean":"2024-05-04T02:48:32.455706+0000","last_became_active":"2024-05-04T02:20:15.295128+0000","last_became_peered":"2024-05-04T02:20:15.295128+0000","last_unstale":"2024-05-04T02:48:32.455706+0000","last_undegraded":"2024-05-04T02:48:32.455706+0000","last_fullsized":"2024-05-04T02:48:32.455706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'89","last_scrub_stamp":"2024-05-04T02:48:32.455604+0000","last_deep_scrub":"25'89","last_deep_scrub_stamp":"2024-05-04T02:48:32.455604+0000","last_clean_scrub_stamp":"2024-05-04T02:48:32.455604+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:56:18.655433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":2421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"25'557","reported_seq":601,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:37.164355+0000","last_change":"2024-05-04T02:48:37.164386+0000","last_active":"2024-05-04T02:48:37.164355+0000","last_peered":"2024-05-04T02:48:37.164355+0000","last_clean":"2024-05-04T02:48:37.164355+0000","last_became_active":"2024-05-04T02:20:14.293862+0000","last_became_peered":"2024-05-04T02:20:14.293862+0000","last_unstale":"2024-05-04T02:48:37.164355+0000","last_undegraded":"2024-05-04T02:48:37.164355+0000","last_fullsized":"2024-05-04T02:48:37.164355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'557","last_scrub_stamp":"2024-05-04T02:48:37.164283+0000","last_deep_scrub":"25'557","last_deep_scrub_stamp":"2024-05-04T02:48:37.164283+0000","last_clean_scrub_stamp":"2024-05-04T02:48:37.164283+0000","objects_scrubbed":2,"log_size":557,"log_dups_size":0,"ondisk_log_size":557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:36:37.076391+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":4370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"25'73","reported_seq":116,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:38.008779+0000","last_change":"2024-05-04T02:48:38.008806+0000","last_active":"2024-05-04T02:48:38.008779+0000","last_peered":"2024-05-04T02:48:38.008779+0000","last_clean":"2024-05-04T02:48:38.008779+0000","last_became_active":"2024-05-04T02:20:15.296544+0000","last_became_peered":"2024-05-04T02:20:15.296544+0000","last_unstale":"2024-05-04T02:48:38.008779+0000","last_undegraded":"2024-05-04T02:48:38.008779+0000","last_fullsized":"2024-05-04T02:48:38.008779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'73","last_scrub_stamp":"2024-05-04T02:48:38.008688+0000","last_deep_scrub":"25'73","last_deep_scrub_stamp":"2024-05-04T02:48:38.008688+0000","last_clean_scrub_stamp":"2024-05-04T02:48:38.008688+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:23:18.915185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":1715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"25'89","reported_seq":130,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:41.319647+0000","last_change":"2024-05-04T02:48:41.319691+0000","last_active":"2024-05-04T02:48:41.319647+0000","last_peered":"2024-05-04T02:48:41.319647+0000","last_clean":"2024-05-04T02:48:41.319647+0000","last_became_active":"2024-05-04T02:20:15.305941+0000","last_became_peered":"2024-05-04T02:20:15.305941+0000","last_unstale":"2024-05-04T02:48:41.319647+0000","last_undegraded":"2024-05-04T02:48:41.319647+0000","last_fullsized":"2024-05-04T02:48:41.319647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'89","last_scrub_stamp":"2024-05-04T02:48:41.319551+0000","last_deep_scrub":"25'89","last_deep_scrub_stamp":"2024-05-04T02:48:41.319551+0000","last_clean_scrub_stamp":"2024-05-04T02:48:41.319551+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:20:47.511403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":3718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"25'5","reported_seq":48,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:36.185741+0000","last_change":"2024-05-04T02:48:36.185770+0000","last_active":"2024-05-04T02:48:36.185741+0000","last_peered":"2024-05-04T02:48:36.185741+0000","last_clean":"2024-05-04T02:48:36.185741+0000","last_became_active":"2024-05-04T02:20:14.293788+0000","last_became_peered":"2024-05-04T02:20:14.293788+0000","last_unstale":"2024-05-04T02:48:36.185741+0000","last_undegraded":"2024-05-04T02:48:36.185741+0000","last_fullsized":"2024-05-04T02:48:36.185741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5","last_scrub_stamp":"2024-05-04T02:48:36.185650+0000","last_deep_scrub":"25'5","last_deep_scrub_stamp":"2024-05-04T02:48:36.185650+0000","last_clean_scrub_stamp":"2024-05-04T02:48:36.185650+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:01:30.213921+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"25'52","reported_seq":93,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:42.322952+0000","last_change":"2024-05-04T02:48:42.322976+0000","last_active":"2024-05-04T02:48:42.322952+0000","last_peered":"2024-05-04T02:48:42.322952+0000","last_clean":"2024-05-04T02:48:42.322952+0000","last_became_active":"2024-05-04T02:20:15.306050+0000","last_became_peered":"2024-05-04T02:20:15.306050+0000","last_unstale":"2024-05-04T02:48:42.322952+0000","last_undegraded":"2024-05-04T02:48:42.322952+0000","last_fullsized":"2024-05-04T02:48:42.322952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'52","last_scrub_stamp":"2024-05-04T02:48:42.322864+0000","last_deep_scrub":"25'52","last_deep_scrub_stamp":"2024-05-04T02:48:42.322864+0000","last_clean_scrub_stamp":"2024-05-04T02:48:42.322864+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:28:14.614809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":4810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"25'1267","reported_seq":1310,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:38.160121+0000","last_change":"2024-05-04T02:48:38.160184+0000","last_active":"2024-05-04T02:48:38.160121+0000","last_peered":"2024-05-04T02:48:38.160121+0000","last_clean":"2024-05-04T02:48:38.160121+0000","last_became_active":"2024-05-04T02:20:14.357368+0000","last_became_peered":"2024-05-04T02:20:14.357368+0000","last_unstale":"2024-05-04T02:48:38.160121+0000","last_undegraded":"2024-05-04T02:48:38.160121+0000","last_fullsized":"2024-05-04T02:48:38.160121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1267","last_scrub_stamp":"2024-05-04T02:48:38.160033+0000","last_deep_scrub":"25'1267","last_deep_scrub_stamp":"2024-05-04T02:48:38.160033+0000","last_clean_scrub_stamp":"2024-05-04T02:48:38.160033+0000","objects_scrubbed":3,"log_size":1267,"log_dups_size":0,"ondisk_log_size":1267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:51:54.621544+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1255,"num_write_kb":8902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"25'94","reported_seq":142,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:36.153240+0000","last_change":"2024-05-04T02:48:36.153265+0000","last_active":"2024-05-04T02:48:36.153240+0000","last_peered":"2024-05-04T02:48:36.153240+0000","last_clean":"2024-05-04T02:48:36.153240+0000","last_became_active":"2024-05-04T02:20:53.106867+0000","last_became_peered":"2024-05-04T02:20:53.106867+0000","last_unstale":"2024-05-04T02:48:36.153240+0000","last_undegraded":"2024-05-04T02:48:36.153240+0000","last_fullsized":"2024-05-04T02:48:36.153240+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'94","last_scrub_stamp":"2024-05-04T02:48:36.153161+0000","last_deep_scrub":"25'94","last_deep_scrub_stamp":"2024-05-04T02:48:36.153161+0000","last_clean_scrub_stamp":"2024-05-04T02:48:36.153161+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:14:28.390608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":7905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"25'741","reported_seq":787,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:28.379565+0000","last_change":"2024-05-04T02:48:28.379594+0000","last_active":"2024-05-04T02:48:28.379565+0000","last_peered":"2024-05-04T02:48:28.379565+0000","last_clean":"2024-05-04T02:48:28.379565+0000","last_became_active":"2024-05-04T02:20:14.291331+0000","last_became_peered":"2024-05-04T02:20:14.291331+0000","last_unstale":"2024-05-04T02:48:28.379565+0000","last_undegraded":"2024-05-04T02:48:28.379565+0000","last_fullsized":"2024-05-04T02:48:28.379565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'741","last_scrub_stamp":"2024-05-04T02:48:28.379462+0000","last_deep_scrub":"25'741","last_deep_scrub_stamp":"2024-05-04T02:48:28.379462+0000","last_clean_scrub_stamp":"2024-05-04T02:48:28.379462+0000","objects_scrubbed":1,"log_size":741,"log_dups_size":0,"ondisk_log_size":741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:10:17.837877+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":732,"num_write_kb":4528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"25'50","reported_seq":94,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:30.394187+0000","last_change":"2024-05-04T02:48:30.394238+0000","last_active":"2024-05-04T02:48:30.394187+0000","last_peered":"2024-05-04T02:48:30.394187+0000","last_clean":"2024-05-04T02:48:30.394187+0000","last_became_active":"2024-05-04T02:20:15.294026+0000","last_became_peered":"2024-05-04T02:20:15.294026+0000","last_unstale":"2024-05-04T02:48:30.394187+0000","last_undegraded":"2024-05-04T02:48:30.394187+0000","last_fullsized":"2024-05-04T02:48:30.394187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'50","last_scrub_stamp":"2024-05-04T02:48:30.394102+0000","last_deep_scrub":"25'50","last_deep_scrub_stamp":"2024-05-04T02:48:30.394102+0000","last_clean_scrub_stamp":"2024-05-04T02:48:30.394102+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:39:44.098146+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":3304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"25'591","reported_seq":636,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:26.096786+0000","last_change":"2024-05-04T02:48:26.096854+0000","last_active":"2024-05-04T02:48:26.096786+0000","last_peered":"2024-05-04T02:48:26.096786+0000","last_clean":"2024-05-04T02:48:26.096786+0000","last_became_active":"2024-05-04T02:20:14.291313+0000","last_became_peered":"2024-05-04T02:20:14.291313+0000","last_unstale":"2024-05-04T02:48:26.096786+0000","last_undegraded":"2024-05-04T02:48:26.096786+0000","last_fullsized":"2024-05-04T02:48:26.096786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'591","last_scrub_stamp":"2024-05-04T02:48:26.096694+0000","last_deep_scrub":"25'591","last_deep_scrub_stamp":"2024-05-04T02:48:26.096694+0000","last_clean_scrub_stamp":"2024-05-04T02:48:26.096694+0000","objects_scrubbed":3,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:01:43.904683+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":585,"num_write_kb":4378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3751,"num_write_kb":293548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4679,"ondisk_log_size":4679,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":37541733,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":841,"num_read_kb":897,"num_write":10490,"num_write_kb":42216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":48889856,"data_stored":75083466,"data_compressed":7496204,"data_compressed_allocated":11345920,"data_compressed_original":37601280,"omap_allocated":0,"internal_metadata":0},"log_size":8589,"ondisk_log_size":8589,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65100,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509790,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64824,"kb_used_data":15600,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94307016,"statfs":{"total":96636764160,"available":96570384384,"internally_reserved":0,"allocated":15974400,"data_stored":25463912,"data_compressed":2642721,"data_compressed_allocated":3952640,"data_compressed_original":13611008,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509790,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60228,"kb_used_data":11004,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94311612,"statfs":{"total":96636764160,"available":96575090688,"internally_reserved":0,"allocated":11268096,"data_stored":16874693,"data_compressed":1601255,"data_compressed_allocated":2412544,"data_compressed_original":8187904,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509790,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35592,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336248,"statfs":{"total":96636764160,"available":96600317952,"internally_reserved":0,"allocated":262144,"data_stored":96895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509790,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58680,"kb_used_data":9456,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94313160,"statfs":{"total":96636764160,"available":96576675840,"internally_reserved":0,"allocated":9682944,"data_stored":12861583,"data_compressed":1022835,"data_compressed_allocated":1699840,"data_compressed_original":5050368,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509790,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35768,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336072,"statfs":{"total":96636764160,"available":96600137728,"internally_reserved":0,"allocated":442368,"data_stored":277999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509790,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29248,"kb_used_data":2232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342592,"statfs":{"total":96636764160,"available":96606814208,"internally_reserved":0,"allocated":2285568,"data_stored":3901602,"data_compressed":519116,"data_compressed_allocated":720896,"data_compressed_original":2506752,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542495,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44836,"kb_used_data":5340,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94327004,"statfs":{"total":96636764160,"available":96590852096,"internally_reserved":0,"allocated":5468160,"data_stored":8485539,"data_compressed":908476,"data_compressed_allocated":1347584,"data_compressed_original":4538368,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575198,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32584,"kb_used_data":5568,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94339256,"statfs":{"total":96636764160,"available":96603398144,"internally_reserved":0,"allocated":5701632,"data_stored":9076419,"data_compressed":866901,"data_compressed_allocated":1302528,"data_compressed_original":4853760,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32550,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32550,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5378048,"data_stored":8389246,"data_compressed":834351,"data_compressed_allocated":1257472,"data_compressed_original":4280320,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2027520,"data_stored":3804797,"data_compressed":519116,"data_compressed_allocated":720896,"data_compressed_original":2506752,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":184320,"data_stored":181194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9424896,"data_stored":12764778,"data_compressed":1022835,"data_compressed_allocated":1699840,"data_compressed_original":5050368,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5210112,"data_stored":8388734,"data_compressed":908476,"data_compressed_allocated":1347584,"data_compressed_original":4538368,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":11010048,"data_stored":16777888,"data_compressed":1601255,"data_compressed_allocated":2412544,"data_compressed_original":8187904,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":15650816,"data_stored":24776739,"data_compressed":2610171,"data_compressed_allocated":3907584,"data_compressed_original":13037568,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-04T02:48:52.170 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-05-04T02:20:14.110992+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=5, tm_yday=125, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=4, tm_hour=2, tm_min=48, tm_sec=22, tm_wday=5, tm_yday=125, tm_isdst=0) 2024-05-04T02:48:52.171 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-04T02:48:59.190 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:48:59.193 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:49:12.173 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-04T02:49:12.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:12.290+0000 7fae02ea7640 1 Processor -- start 2024-05-04T02:49:12.292 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:12.290+0000 7fae02ea7640 1 -- start start 2024-05-04T02:49:12.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:12.291+0000 7fae02ea7640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fadfc156890 0x7fadfc072e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:49:12.293 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:12.292+0000 7fae02ea7640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fadfc15cf50 0x7fadfc0b3b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:49:12.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:12.292+0000 7fae02ea7640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fadfc0b40d0 0x7fadfc071920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:49:12.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:12.292+0000 7fae02ea7640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7fadfc156ca0 con 0x7fadfc15cf50 2024-05-04T02:49:12.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:12.292+0000 7fae02ea7640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fadfc0cb580 con 0x7fadfc0b40d0 2024-05-04T02:49:12.294 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:12.292+0000 7fae02ea7640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fadfc0ca200 con 0x7fadfc156890 2024-05-04T02:49:12.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:12.292+0000 7fadfbfff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fadfc15cf50 0x7fadfc0b3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:49:12.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:12.292+0000 7fae01444640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fadfc0b40d0 0x7fadfc071920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:49:12.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:12.292+0000 7fae00c43640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fadfc156890 0x7fadfc072e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:49:12.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:12.293+0000 7fadfbfff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fadfc15cf50 0x7fadfc0b3b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50240/0 (socket says 172.21.15.1:50240) 2024-05-04T02:49:12.295 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:12.293+0000 7fadfbfff640 1 -- 172.21.15.1:0/905806096 learned_addr learned my addr 172.21.15.1:0/905806096 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:49:12.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:12.295+0000 7fadfbfff640 1 -- 172.21.15.1:0/905806096 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fadfc156890 msgr2=0x7fadfc072e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:49:12.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:12.295+0000 7fadfbfff640 1 --2- 172.21.15.1:0/905806096 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fadfc156890 0x7fadfc072e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:12.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:12.295+0000 7fadfbfff640 1 -- 172.21.15.1:0/905806096 >> v2:172.21.15.107:3300/0 conn(0x7fadfc0b40d0 msgr2=0x7fadfc071920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:49:12.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:12.295+0000 7fadfbfff640 1 --2- 172.21.15.1:0/905806096 >> v2:172.21.15.107:3300/0 conn(0x7fadfc0b40d0 0x7fadfc071920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:12.297 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:12.295+0000 7fadfbfff640 1 -- 172.21.15.1:0/905806096 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadfc0ca4e0 con 0x7fadfc15cf50 2024-05-04T02:49:12.299 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:12.298+0000 7fadfbfff640 1 --2- 172.21.15.1:0/905806096 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fadfc15cf50 0x7fadfc0b3b90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fadfc071340 tx=0x7fade402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62d0c109e32156d9 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:49:12.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:12.302+0000 7fadfb7fe640 1 -- 172.21.15.1:0/905806096 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade4037070 con 0x7fadfc15cf50 2024-05-04T02:49:12.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:12.302+0000 7fadfb7fe640 1 -- 172.21.15.1:0/905806096 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fade4032440 con 0x7fadfc15cf50 2024-05-04T02:49:12.304 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:12.302+0000 7fadfb7fe640 1 -- 172.21.15.1:0/905806096 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade4032810 con 0x7fadfc15cf50 2024-05-04T02:49:12.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:12.303+0000 7fae02ea7640 1 -- 172.21.15.1:0/905806096 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fadfc15cf50 msgr2=0x7fadfc0b3b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:49:12.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:12.303+0000 7fae02ea7640 1 --2- 172.21.15.1:0/905806096 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fadfc15cf50 0x7fadfc0b3b90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fadfc071340 tx=0x7fade402a1e0 comp rx=0 tx=0).stop 2024-05-04T02:49:12.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:12.303+0000 7fae02ea7640 1 -- 172.21.15.1:0/905806096 shutdown_connections 2024-05-04T02:49:12.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:12.303+0000 7fae02ea7640 1 --2- 172.21.15.1:0/905806096 >> v2:172.21.15.107:3300/0 conn(0x7fadfc0b40d0 0x7fadfc071920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:12.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:12.303+0000 7fae02ea7640 1 --2- 172.21.15.1:0/905806096 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fadfc15cf50 0x7fadfc0b3b90 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:12.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:12.303+0000 7fae02ea7640 1 --2- 172.21.15.1:0/905806096 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fadfc156890 0x7fadfc072e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:12.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:12.303+0000 7fae02ea7640 1 -- 172.21.15.1:0/905806096 >> 172.21.15.1:0/905806096 conn(0x7fadfc073f80 msgr2=0x7fadfc0cf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:49:12.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:12.303+0000 7fae02ea7640 1 -- 172.21.15.1:0/905806096 shutdown_connections 2024-05-04T02:49:12.305 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:12.303+0000 7fae02ea7640 1 -- 172.21.15.1:0/905806096 wait complete. 2024-05-04T02:49:12.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:12.305+0000 7fae02ea7640 1 Processor -- start 2024-05-04T02:49:12.306 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:12.305+0000 7fae02ea7640 1 -- start start 2024-05-04T02:49:12.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:12.306+0000 7fae02ea7640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fadfc0b40d0 0x7fadfc06f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:49:12.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:12.306+0000 7fae02ea7640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fadfc156890 0x7fadfc14f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:49:12.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:12.306+0000 7fae02ea7640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fadfc15cf50 0x7fadfc14f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:49:12.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:12.306+0000 7fae02ea7640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fadfc0cad80 con 0x7fadfc15cf50 2024-05-04T02:49:12.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:12.306+0000 7fae02ea7640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fadfc0caaa0 con 0x7fadfc0b40d0 2024-05-04T02:49:12.308 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:12.306+0000 7fae02ea7640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fadfc0cb060 con 0x7fadfc156890 2024-05-04T02:49:12.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:12.307+0000 7fae00c43640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fadfc0b40d0 0x7fadfc06f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:49:12.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:12.307+0000 7fae01444640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fadfc15cf50 0x7fadfc14f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:49:12.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:12.307+0000 7fadfbfff640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fadfc156890 0x7fadfc14f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:49:12.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:12.307+0000 7fae01444640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fadfc15cf50 0x7fadfc14f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:50246/0 (socket says 172.21.15.1:50246) 2024-05-04T02:49:12.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:12.307+0000 7fae01444640 1 -- 172.21.15.1:0/1032237986 learned_addr learned my addr 172.21.15.1:0/1032237986 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:49:12.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:12.311+0000 7fae01444640 1 -- 172.21.15.1:0/1032237986 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fadfc156890 msgr2=0x7fadfc14f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:49:12.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:12.311+0000 7fae01444640 1 --2- 172.21.15.1:0/1032237986 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fadfc156890 0x7fadfc14f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:12.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:12.311+0000 7fae01444640 1 -- 172.21.15.1:0/1032237986 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fadfc0b40d0 msgr2=0x7fadfc06f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:49:12.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:12.311+0000 7fae01444640 1 --2- 172.21.15.1:0/1032237986 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fadfc0b40d0 0x7fadfc06f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:12.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:12.311+0000 7fae01444640 1 -- 172.21.15.1:0/1032237986 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadfc06f740 con 0x7fadfc15cf50 2024-05-04T02:49:12.315 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:12.314+0000 7fae01444640 1 --2- 172.21.15.1:0/1032237986 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fadfc15cf50 0x7fadfc14f7d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fadf400ef90 tx=0x7fadf400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:49:12.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:12.318+0000 7fadf97fa640 1 -- 172.21.15.1:0/1032237986 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf4018020 con 0x7fadfc15cf50 2024-05-04T02:49:12.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:12.318+0000 7fadf97fa640 1 -- 172.21.15.1:0/1032237986 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadf4014480 con 0x7fadfc15cf50 2024-05-04T02:49:12.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:12.318+0000 7fae02ea7640 1 -- 172.21.15.1:0/1032237986 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadfc15be30 con 0x7fadfc15cf50 2024-05-04T02:49:12.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:12.318+0000 7fadf97fa640 1 -- 172.21.15.1:0/1032237986 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf4009e60 con 0x7fadfc15cf50 2024-05-04T02:49:12.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:12.318+0000 7fae02ea7640 1 -- 172.21.15.1:0/1032237986 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadfc06ea00 con 0x7fadfc15cf50 2024-05-04T02:49:12.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:12.319+0000 7fae02ea7640 1 -- 172.21.15.1:0/1032237986 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadfc15bba0 con 0x7fadfc15cf50 2024-05-04T02:49:12.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:12.343+0000 7fadf97fa640 1 -- 172.21.15.1:0/1032237986 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fadf4005d10 con 0x7fadfc15cf50 2024-05-04T02:49:12.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:12.343+0000 7fadf97fa640 1 --2- 172.21.15.1:0/1032237986 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7faddc0762d0 0x7faddc0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:49:12.345 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:12.344+0000 7fae00c43640 1 --2- 172.21.15.1:0/1032237986 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7faddc0762d0 0x7faddc0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:49:12.346 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:12.344+0000 7fae00c43640 1 --2- 172.21.15.1:0/1032237986 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7faddc0762d0 0x7faddc0787e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fadec009a20 tx=0x7fadec009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:49:12.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:12.632+0000 7fadf97fa640 1 -- 172.21.15.1:0/1032237986 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5854+0+0 (secure 0 0 0) 0x7fadf405dd10 con 0x7fadfc15cf50 2024-05-04T02:49:12.634 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:12.632+0000 7fadf97fa640 1 -- 172.21.15.1:0/1032237986 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fadf4022030 con 0x7fadfc15cf50 2024-05-04T02:49:12.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:12.822+0000 7fae02ea7640 1 -- 172.21.15.1:0/1032237986 --> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fadfc14a850 con 0x7faddc0762d0 2024-05-04T02:49:12.831 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:12.829+0000 7fadf97fa640 1 -- 172.21.15.1:0/1032237986 <== mgr.4108 v2:172.21.15.107:6800/3809222574 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+253422 (secure 0 0 0) 0x7fadec011940 con 0x7faddc0762d0 2024-05-04T02:49:12.834 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:49:12.835 INFO:teuthology.orchestra.run.smithi001.stderr:dumped all 2024-05-04T02:49:12.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:12.832+0000 7fae02ea7640 1 -- 172.21.15.1:0/1032237986 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7faddc0762d0 msgr2=0x7faddc0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:49:12.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:12.832+0000 7fae02ea7640 1 --2- 172.21.15.1:0/1032237986 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7faddc0762d0 0x7faddc0787e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fadec009a20 tx=0x7fadec009190 comp rx=0 tx=0).stop 2024-05-04T02:49:12.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:12.832+0000 7fae02ea7640 1 -- 172.21.15.1:0/1032237986 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fadfc15cf50 msgr2=0x7fadfc14f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:49:12.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:12.832+0000 7fae02ea7640 1 --2- 172.21.15.1:0/1032237986 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fadfc15cf50 0x7fadfc14f7d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fadf400ef90 tx=0x7fadf400c490 comp rx=0 tx=0).stop 2024-05-04T02:49:12.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:12.833+0000 7fae02ea7640 1 -- 172.21.15.1:0/1032237986 shutdown_connections 2024-05-04T02:49:12.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:12.833+0000 7fae02ea7640 1 --2- 172.21.15.1:0/1032237986 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7faddc0762d0 0x7faddc0787e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:12.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:12.833+0000 7fae02ea7640 1 --2- 172.21.15.1:0/1032237986 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fadfc15cf50 0x7fadfc14f7d0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:12.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:12.833+0000 7fae02ea7640 1 --2- 172.21.15.1:0/1032237986 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fadfc156890 0x7fadfc14f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:12.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:12.833+0000 7fae02ea7640 1 --2- 172.21.15.1:0/1032237986 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fadfc0b40d0 0x7fadfc06f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:12.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:12.833+0000 7fae02ea7640 1 -- 172.21.15.1:0/1032237986 >> 172.21.15.1:0/1032237986 conn(0x7fadfc073f80 msgr2=0x7fadfc1e2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:49:12.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:12.833+0000 7fae02ea7640 1 -- 172.21.15.1:0/1032237986 shutdown_connections 2024-05-04T02:49:12.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:12.833+0000 7fae02ea7640 1 -- 172.21.15.1:0/1032237986 wait complete. 2024-05-04T02:49:12.847 INFO:teuthology.orchestra.run.smithi001.stdout:{"pg_ready":true,"pg_map":{"version":895,"stamp":"2024-05-04T02:49:11.528414+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":38132101,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":907,"num_read_kb":952,"num_write":14342,"num_write_kb":337392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13342,"ondisk_log_size":13342,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":361760,"kb_used_data":49888,"kb_used_omap":12,"kb_used_meta":311795,"kb_avail":754612960,"statfs":{"total":773094113280,"available":772723671040,"internally_reserved":0,"allocated":51085312,"data_stored":77038642,"data_compressed":7561304,"data_compressed_allocated":11436032,"data_compressed_original":38748160,"omap_allocated":12752,"internal_metadata":319278640},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003582"},"pg_stats":[{"pgid":"3.3f","version":"25'66","reported_seq":98,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:34.990671+0000","last_change":"2024-05-04T02:48:34.990696+0000","last_active":"2024-05-04T02:48:34.990671+0000","last_peered":"2024-05-04T02:48:34.990671+0000","last_clean":"2024-05-04T02:48:34.990671+0000","last_became_active":"2024-05-04T02:20:53.380291+0000","last_became_peered":"2024-05-04T02:20:53.380291+0000","last_unstale":"2024-05-04T02:48:34.990671+0000","last_undegraded":"2024-05-04T02:48:34.990671+0000","last_fullsized":"2024-05-04T02:48:34.990671+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'66","last_scrub_stamp":"2024-05-04T02:48:34.990596+0000","last_deep_scrub":"25'66","last_deep_scrub_stamp":"2024-05-04T02:48:34.990596+0000","last_clean_scrub_stamp":"2024-05-04T02:48:34.990596+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:54:57.366615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":3382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3e","version":"25'82","reported_seq":125,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:34.972015+0000","last_change":"2024-05-04T02:48:34.972063+0000","last_active":"2024-05-04T02:48:34.972015+0000","last_peered":"2024-05-04T02:48:34.972015+0000","last_clean":"2024-05-04T02:48:34.972015+0000","last_became_active":"2024-05-04T02:20:15.298956+0000","last_became_peered":"2024-05-04T02:20:15.298956+0000","last_unstale":"2024-05-04T02:48:34.972015+0000","last_undegraded":"2024-05-04T02:48:34.972015+0000","last_fullsized":"2024-05-04T02:48:34.972015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'82","last_scrub_stamp":"2024-05-04T02:48:34.971921+0000","last_deep_scrub":"25'82","last_deep_scrub_stamp":"2024-05-04T02:48:34.971921+0000","last_clean_scrub_stamp":"2024-05-04T02:48:34.971921+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:48:17.870181+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":73,"num_write_kb":2093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"25'86","reported_seq":129,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:30.124224+0000","last_change":"2024-05-04T02:48:30.124250+0000","last_active":"2024-05-04T02:48:30.124224+0000","last_peered":"2024-05-04T02:48:30.124224+0000","last_clean":"2024-05-04T02:48:30.124224+0000","last_became_active":"2024-05-04T02:20:15.297150+0000","last_became_peered":"2024-05-04T02:20:15.297150+0000","last_unstale":"2024-05-04T02:48:30.124224+0000","last_undegraded":"2024-05-04T02:48:30.124224+0000","last_fullsized":"2024-05-04T02:48:30.124224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'86","last_scrub_stamp":"2024-05-04T02:48:30.124138+0000","last_deep_scrub":"25'86","last_deep_scrub_stamp":"2024-05-04T02:48:30.124138+0000","last_clean_scrub_stamp":"2024-05-04T02:48:30.124138+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:16:47.005238+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":4094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"25'50","reported_seq":94,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:36.306411+0000","last_change":"2024-05-04T02:48:36.306465+0000","last_active":"2024-05-04T02:48:36.306411+0000","last_peered":"2024-05-04T02:48:36.306411+0000","last_clean":"2024-05-04T02:48:36.306411+0000","last_became_active":"2024-05-04T02:20:15.301113+0000","last_became_peered":"2024-05-04T02:20:15.301113+0000","last_unstale":"2024-05-04T02:48:36.306411+0000","last_undegraded":"2024-05-04T02:48:36.306411+0000","last_fullsized":"2024-05-04T02:48:36.306411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'50","last_scrub_stamp":"2024-05-04T02:48:36.306304+0000","last_deep_scrub":"25'50","last_deep_scrub_stamp":"2024-05-04T02:48:36.306304+0000","last_clean_scrub_stamp":"2024-05-04T02:48:36.306304+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:01:30.334574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":1582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"25'54","reported_seq":95,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:39.175831+0000","last_change":"2024-05-04T02:48:39.175877+0000","last_active":"2024-05-04T02:48:39.175831+0000","last_peered":"2024-05-04T02:48:39.175831+0000","last_clean":"2024-05-04T02:48:39.175831+0000","last_became_active":"2024-05-04T02:20:15.297511+0000","last_became_peered":"2024-05-04T02:20:15.297511+0000","last_unstale":"2024-05-04T02:48:39.175831+0000","last_undegraded":"2024-05-04T02:48:39.175831+0000","last_fullsized":"2024-05-04T02:48:39.175831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'54","last_scrub_stamp":"2024-05-04T02:48:39.175735+0000","last_deep_scrub":"25'54","last_deep_scrub_stamp":"2024-05-04T02:48:39.175735+0000","last_clean_scrub_stamp":"2024-05-04T02:48:39.175735+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:46:04.461089+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":3466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"25'86","reported_seq":127,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:43.328110+0000","last_change":"2024-05-04T02:48:43.328139+0000","last_active":"2024-05-04T02:48:43.328110+0000","last_peered":"2024-05-04T02:48:43.328110+0000","last_clean":"2024-05-04T02:48:43.328110+0000","last_became_active":"2024-05-04T02:20:15.306537+0000","last_became_peered":"2024-05-04T02:20:15.306537+0000","last_unstale":"2024-05-04T02:48:43.328110+0000","last_undegraded":"2024-05-04T02:48:43.328110+0000","last_fullsized":"2024-05-04T02:48:43.328110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'86","last_scrub_stamp":"2024-05-04T02:48:43.328032+0000","last_deep_scrub":"25'86","last_deep_scrub_stamp":"2024-05-04T02:48:43.328032+0000","last_clean_scrub_stamp":"2024-05-04T02:48:43.328032+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:27:28.627358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74,"num_write_kb":4281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"25'87","reported_seq":128,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:40.141164+0000","last_change":"2024-05-04T02:48:40.141215+0000","last_active":"2024-05-04T02:48:40.141164+0000","last_peered":"2024-05-04T02:48:40.141164+0000","last_clean":"2024-05-04T02:48:40.141164+0000","last_became_active":"2024-05-04T02:20:15.299177+0000","last_became_peered":"2024-05-04T02:20:15.299177+0000","last_unstale":"2024-05-04T02:48:40.141164+0000","last_undegraded":"2024-05-04T02:48:40.141164+0000","last_fullsized":"2024-05-04T02:48:40.141164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'87","last_scrub_stamp":"2024-05-04T02:48:40.140984+0000","last_deep_scrub":"25'87","last_deep_scrub_stamp":"2024-05-04T02:48:40.140984+0000","last_clean_scrub_stamp":"2024-05-04T02:48:40.140984+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:20:46.332836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75,"num_write_kb":3160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"25'62","reported_seq":103,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:39.635199+0000","last_change":"2024-05-04T02:48:39.635252+0000","last_active":"2024-05-04T02:48:39.635199+0000","last_peered":"2024-05-04T02:48:39.635199+0000","last_clean":"2024-05-04T02:48:39.635199+0000","last_became_active":"2024-05-04T02:20:15.306663+0000","last_became_peered":"2024-05-04T02:20:15.306663+0000","last_unstale":"2024-05-04T02:48:39.635199+0000","last_undegraded":"2024-05-04T02:48:39.635199+0000","last_fullsized":"2024-05-04T02:48:39.635199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'62","last_scrub_stamp":"2024-05-04T02:48:39.635089+0000","last_deep_scrub":"25'62","last_deep_scrub_stamp":"2024-05-04T02:48:39.635089+0000","last_clean_scrub_stamp":"2024-05-04T02:48:39.635089+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:46:52.958691+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":4413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"25'72","reported_seq":113,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:44.221221+0000","last_change":"2024-05-04T02:48:44.221250+0000","last_active":"2024-05-04T02:48:44.221221+0000","last_peered":"2024-05-04T02:48:44.221221+0000","last_clean":"2024-05-04T02:48:44.221221+0000","last_became_active":"2024-05-04T02:20:15.303055+0000","last_became_peered":"2024-05-04T02:20:15.303055+0000","last_unstale":"2024-05-04T02:48:44.221221+0000","last_undegraded":"2024-05-04T02:48:44.221221+0000","last_fullsized":"2024-05-04T02:48:44.221221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'72","last_scrub_stamp":"2024-05-04T02:48:44.221115+0000","last_deep_scrub":"25'72","last_deep_scrub_stamp":"2024-05-04T02:48:44.221115+0000","last_clean_scrub_stamp":"2024-05-04T02:48:44.221115+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:58:25.422472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":5860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"25'70","reported_seq":111,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:41.072425+0000","last_change":"2024-05-04T02:48:41.072474+0000","last_active":"2024-05-04T02:48:41.072425+0000","last_peered":"2024-05-04T02:48:41.072425+0000","last_clean":"2024-05-04T02:48:41.072425+0000","last_became_active":"2024-05-04T02:20:15.307124+0000","last_became_peered":"2024-05-04T02:20:15.307124+0000","last_unstale":"2024-05-04T02:48:41.072425+0000","last_undegraded":"2024-05-04T02:48:41.072425+0000","last_fullsized":"2024-05-04T02:48:41.072425+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'70","last_scrub_stamp":"2024-05-04T02:48:41.072328+0000","last_deep_scrub":"25'70","last_deep_scrub_stamp":"2024-05-04T02:48:41.072328+0000","last_clean_scrub_stamp":"2024-05-04T02:48:41.072328+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:51:45.100023+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":2059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"25'65","reported_seq":106,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:40.028991+0000","last_change":"2024-05-04T02:48:40.029017+0000","last_active":"2024-05-04T02:48:40.028991+0000","last_peered":"2024-05-04T02:48:40.028991+0000","last_clean":"2024-05-04T02:48:40.028991+0000","last_became_active":"2024-05-04T02:20:15.306409+0000","last_became_peered":"2024-05-04T02:20:15.306409+0000","last_unstale":"2024-05-04T02:48:40.028991+0000","last_undegraded":"2024-05-04T02:48:40.028991+0000","last_fullsized":"2024-05-04T02:48:40.028991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'65","last_scrub_stamp":"2024-05-04T02:48:40.028897+0000","last_deep_scrub":"25'65","last_deep_scrub_stamp":"2024-05-04T02:48:40.028897+0000","last_clean_scrub_stamp":"2024-05-04T02:48:40.028897+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:47:53.036299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"25'50","reported_seq":91,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:31.751566+0000","last_change":"2024-05-04T02:48:31.751590+0000","last_active":"2024-05-04T02:48:31.751566+0000","last_peered":"2024-05-04T02:48:31.751566+0000","last_clean":"2024-05-04T02:48:31.751566+0000","last_became_active":"2024-05-04T02:20:15.296640+0000","last_became_peered":"2024-05-04T02:20:15.296640+0000","last_unstale":"2024-05-04T02:48:31.751566+0000","last_undegraded":"2024-05-04T02:48:31.751566+0000","last_fullsized":"2024-05-04T02:48:31.751566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'50","last_scrub_stamp":"2024-05-04T02:48:31.751487+0000","last_deep_scrub":"25'50","last_deep_scrub_stamp":"2024-05-04T02:48:31.751487+0000","last_clean_scrub_stamp":"2024-05-04T02:48:31.751487+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:23:58.198420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":2327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"25'84","reported_seq":125,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:31.422097+0000","last_change":"2024-05-04T02:48:31.422125+0000","last_active":"2024-05-04T02:48:31.422097+0000","last_peered":"2024-05-04T02:48:31.422097+0000","last_clean":"2024-05-04T02:48:31.422097+0000","last_became_active":"2024-05-04T02:20:15.293909+0000","last_became_peered":"2024-05-04T02:20:15.293909+0000","last_unstale":"2024-05-04T02:48:31.422097+0000","last_undegraded":"2024-05-04T02:48:31.422097+0000","last_fullsized":"2024-05-04T02:48:31.422097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'84","last_scrub_stamp":"2024-05-04T02:48:31.422017+0000","last_deep_scrub":"25'84","last_deep_scrub_stamp":"2024-05-04T02:48:31.422017+0000","last_clean_scrub_stamp":"2024-05-04T02:48:31.422017+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:23:12.328514+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71,"num_write_kb":6748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"25'70","reported_seq":112,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:27.133338+0000","last_change":"2024-05-04T02:48:27.133362+0000","last_active":"2024-05-04T02:48:27.133338+0000","last_peered":"2024-05-04T02:48:27.133338+0000","last_clean":"2024-05-04T02:48:27.133338+0000","last_became_active":"2024-05-04T02:20:15.293550+0000","last_became_peered":"2024-05-04T02:20:15.293550+0000","last_unstale":"2024-05-04T02:48:27.133338+0000","last_undegraded":"2024-05-04T02:48:27.133338+0000","last_fullsized":"2024-05-04T02:48:27.133338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'70","last_scrub_stamp":"2024-05-04T02:48:27.133257+0000","last_deep_scrub":"25'70","last_deep_scrub_stamp":"2024-05-04T02:48:27.133257+0000","last_clean_scrub_stamp":"2024-05-04T02:48:27.133257+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:28:58.351012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":6468,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"25'94","reported_seq":136,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:37.033166+0000","last_change":"2024-05-04T02:48:37.033194+0000","last_active":"2024-05-04T02:48:37.033166+0000","last_peered":"2024-05-04T02:48:37.033166+0000","last_clean":"2024-05-04T02:48:37.033166+0000","last_became_active":"2024-05-04T02:20:15.305549+0000","last_became_peered":"2024-05-04T02:20:15.305549+0000","last_unstale":"2024-05-04T02:48:37.033166+0000","last_undegraded":"2024-05-04T02:48:37.033166+0000","last_fullsized":"2024-05-04T02:48:37.033166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'94","last_scrub_stamp":"2024-05-04T02:48:37.033079+0000","last_deep_scrub":"25'94","last_deep_scrub_stamp":"2024-05-04T02:48:37.033079+0000","last_clean_scrub_stamp":"2024-05-04T02:48:37.033079+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:51:41.060774+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":3628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"25'80","reported_seq":122,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:39.273557+0000","last_change":"2024-05-04T02:48:39.273583+0000","last_active":"2024-05-04T02:48:39.273557+0000","last_peered":"2024-05-04T02:48:39.273557+0000","last_clean":"2024-05-04T02:48:39.273557+0000","last_became_active":"2024-05-04T02:20:15.301515+0000","last_became_peered":"2024-05-04T02:20:15.301515+0000","last_unstale":"2024-05-04T02:48:39.273557+0000","last_undegraded":"2024-05-04T02:48:39.273557+0000","last_fullsized":"2024-05-04T02:48:39.273557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'80","last_scrub_stamp":"2024-05-04T02:48:39.273478+0000","last_deep_scrub":"25'80","last_deep_scrub_stamp":"2024-05-04T02:48:39.273478+0000","last_clean_scrub_stamp":"2024-05-04T02:48:39.273478+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:51:55.734989+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":4426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"25'78","reported_seq":120,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:35.343698+0000","last_change":"2024-05-04T02:48:35.343744+0000","last_active":"2024-05-04T02:48:35.343698+0000","last_peered":"2024-05-04T02:48:35.343698+0000","last_clean":"2024-05-04T02:48:35.343698+0000","last_became_active":"2024-05-04T02:20:15.300707+0000","last_became_peered":"2024-05-04T02:20:15.300707+0000","last_unstale":"2024-05-04T02:48:35.343698+0000","last_undegraded":"2024-05-04T02:48:35.343698+0000","last_fullsized":"2024-05-04T02:48:35.343698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'78","last_scrub_stamp":"2024-05-04T02:48:35.343576+0000","last_deep_scrub":"25'78","last_deep_scrub_stamp":"2024-05-04T02:48:35.343576+0000","last_clean_scrub_stamp":"2024-05-04T02:48:35.343576+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:19:07.538480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":4257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"25'87","reported_seq":129,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:30.997207+0000","last_change":"2024-05-04T02:48:30.997257+0000","last_active":"2024-05-04T02:48:30.997207+0000","last_peered":"2024-05-04T02:48:30.997207+0000","last_clean":"2024-05-04T02:48:30.997207+0000","last_became_active":"2024-05-04T02:20:15.291766+0000","last_became_peered":"2024-05-04T02:20:15.291766+0000","last_unstale":"2024-05-04T02:48:30.997207+0000","last_undegraded":"2024-05-04T02:48:30.997207+0000","last_fullsized":"2024-05-04T02:48:30.997207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'87","last_scrub_stamp":"2024-05-04T02:48:30.997083+0000","last_deep_scrub":"25'87","last_deep_scrub_stamp":"2024-05-04T02:48:30.997083+0000","last_clean_scrub_stamp":"2024-05-04T02:48:30.997083+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:30:09.921309+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":5570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"25'65","reported_seq":107,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:31.240337+0000","last_change":"2024-05-04T02:48:31.240368+0000","last_active":"2024-05-04T02:48:31.240337+0000","last_peered":"2024-05-04T02:48:31.240337+0000","last_clean":"2024-05-04T02:48:31.240337+0000","last_became_active":"2024-05-04T02:20:15.297568+0000","last_became_peered":"2024-05-04T02:20:15.297568+0000","last_unstale":"2024-05-04T02:48:31.240337+0000","last_undegraded":"2024-05-04T02:48:31.240337+0000","last_fullsized":"2024-05-04T02:48:31.240337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'65","last_scrub_stamp":"2024-05-04T02:48:31.240262+0000","last_deep_scrub":"25'65","last_deep_scrub_stamp":"2024-05-04T02:48:31.240262+0000","last_clean_scrub_stamp":"2024-05-04T02:48:31.240262+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:49:50.164054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":4387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"25'89","reported_seq":131,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:38.995549+0000","last_change":"2024-05-04T02:48:38.995577+0000","last_active":"2024-05-04T02:48:38.995549+0000","last_peered":"2024-05-04T02:48:38.995549+0000","last_clean":"2024-05-04T02:48:38.995549+0000","last_became_active":"2024-05-04T02:20:15.302743+0000","last_became_peered":"2024-05-04T02:20:15.302743+0000","last_unstale":"2024-05-04T02:48:38.995549+0000","last_undegraded":"2024-05-04T02:48:38.995549+0000","last_fullsized":"2024-05-04T02:48:38.995549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'89","last_scrub_stamp":"2024-05-04T02:48:38.995452+0000","last_deep_scrub":"25'89","last_deep_scrub_stamp":"2024-05-04T02:48:38.995452+0000","last_clean_scrub_stamp":"2024-05-04T02:48:38.995452+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:48:21.893712+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":75,"num_write_kb":8052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"25'110","reported_seq":152,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:32.107196+0000","last_change":"2024-05-04T02:48:32.107252+0000","last_active":"2024-05-04T02:48:32.107196+0000","last_peered":"2024-05-04T02:48:32.107196+0000","last_clean":"2024-05-04T02:48:32.107196+0000","last_became_active":"2024-05-04T02:20:15.300709+0000","last_became_peered":"2024-05-04T02:20:15.300709+0000","last_unstale":"2024-05-04T02:48:32.107196+0000","last_undegraded":"2024-05-04T02:48:32.107196+0000","last_fullsized":"2024-05-04T02:48:32.107196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'110","last_scrub_stamp":"2024-05-04T02:48:32.107072+0000","last_deep_scrub":"25'110","last_deep_scrub_stamp":"2024-05-04T02:48:32.107072+0000","last_clean_scrub_stamp":"2024-05-04T02:48:32.107072+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:40:08.369243+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":93,"num_write_kb":9218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"25'64","reported_seq":106,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:37.306186+0000","last_change":"2024-05-04T02:48:37.306225+0000","last_active":"2024-05-04T02:48:37.306186+0000","last_peered":"2024-05-04T02:48:37.306186+0000","last_clean":"2024-05-04T02:48:37.306186+0000","last_became_active":"2024-05-04T02:20:15.300848+0000","last_became_peered":"2024-05-04T02:20:15.300848+0000","last_unstale":"2024-05-04T02:48:37.306186+0000","last_undegraded":"2024-05-04T02:48:37.306186+0000","last_fullsized":"2024-05-04T02:48:37.306186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'64","last_scrub_stamp":"2024-05-04T02:48:37.306071+0000","last_deep_scrub":"25'64","last_deep_scrub_stamp":"2024-05-04T02:48:37.306071+0000","last_clean_scrub_stamp":"2024-05-04T02:48:37.306071+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:18:43.808053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":2229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"25'75","reported_seq":117,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:37.603918+0000","last_change":"2024-05-04T02:48:37.603961+0000","last_active":"2024-05-04T02:48:37.603918+0000","last_peered":"2024-05-04T02:48:37.603918+0000","last_clean":"2024-05-04T02:48:37.603918+0000","last_became_active":"2024-05-04T02:20:15.301879+0000","last_became_peered":"2024-05-04T02:20:15.301879+0000","last_unstale":"2024-05-04T02:48:37.603918+0000","last_undegraded":"2024-05-04T02:48:37.603918+0000","last_fullsized":"2024-05-04T02:48:37.603918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'75","last_scrub_stamp":"2024-05-04T02:48:37.603807+0000","last_deep_scrub":"25'75","last_deep_scrub_stamp":"2024-05-04T02:48:37.603807+0000","last_clean_scrub_stamp":"2024-05-04T02:48:37.603807+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:27:30.651448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":4046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"25'55","reported_seq":87,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:32.984882+0000","last_change":"2024-05-04T02:48:32.984882+0000","last_active":"2024-05-04T02:48:32.984882+0000","last_peered":"2024-05-04T02:48:32.984882+0000","last_clean":"2024-05-04T02:48:32.984882+0000","last_became_active":"2024-05-04T02:20:53.115499+0000","last_became_peered":"2024-05-04T02:20:53.115499+0000","last_unstale":"2024-05-04T02:48:32.984882+0000","last_undegraded":"2024-05-04T02:48:32.984882+0000","last_fullsized":"2024-05-04T02:48:32.984882+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'55","last_scrub_stamp":"2024-05-04T02:48:32.984760+0000","last_deep_scrub":"25'55","last_deep_scrub_stamp":"2024-05-04T02:48:32.984760+0000","last_clean_scrub_stamp":"2024-05-04T02:48:32.984760+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:50:38.901172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":4120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"25'84","reported_seq":127,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:36.557361+0000","last_change":"2024-05-04T02:48:36.557389+0000","last_active":"2024-05-04T02:48:36.557361+0000","last_peered":"2024-05-04T02:48:36.557361+0000","last_clean":"2024-05-04T02:48:36.557361+0000","last_became_active":"2024-05-04T02:20:15.301363+0000","last_became_peered":"2024-05-04T02:20:15.301363+0000","last_unstale":"2024-05-04T02:48:36.557361+0000","last_undegraded":"2024-05-04T02:48:36.557361+0000","last_fullsized":"2024-05-04T02:48:36.557361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'84","last_scrub_stamp":"2024-05-04T02:48:36.557265+0000","last_deep_scrub":"25'84","last_deep_scrub_stamp":"2024-05-04T02:48:36.557265+0000","last_clean_scrub_stamp":"2024-05-04T02:48:36.557265+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:18:45.744169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":4697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"25'75","reported_seq":118,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:37.029508+0000","last_change":"2024-05-04T02:48:37.029555+0000","last_active":"2024-05-04T02:48:37.029508+0000","last_peered":"2024-05-04T02:48:37.029508+0000","last_clean":"2024-05-04T02:48:37.029508+0000","last_became_active":"2024-05-04T02:20:15.295577+0000","last_became_peered":"2024-05-04T02:20:15.295577+0000","last_unstale":"2024-05-04T02:48:37.029508+0000","last_undegraded":"2024-05-04T02:48:37.029508+0000","last_fullsized":"2024-05-04T02:48:37.029508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'75","last_scrub_stamp":"2024-05-04T02:48:37.029387+0000","last_deep_scrub":"25'75","last_deep_scrub_stamp":"2024-05-04T02:48:37.029387+0000","last_clean_scrub_stamp":"2024-05-04T02:48:37.029387+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:31:26.170341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":3524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"25'87","reported_seq":130,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:36.022080+0000","last_change":"2024-05-04T02:48:36.022104+0000","last_active":"2024-05-04T02:48:36.022080+0000","last_peered":"2024-05-04T02:48:36.022080+0000","last_clean":"2024-05-04T02:48:36.022080+0000","last_became_active":"2024-05-04T02:20:15.299230+0000","last_became_peered":"2024-05-04T02:20:15.299230+0000","last_unstale":"2024-05-04T02:48:36.022080+0000","last_undegraded":"2024-05-04T02:48:36.022080+0000","last_fullsized":"2024-05-04T02:48:36.022080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'87","last_scrub_stamp":"2024-05-04T02:48:36.022002+0000","last_deep_scrub":"25'87","last_deep_scrub_stamp":"2024-05-04T02:48:36.022002+0000","last_clean_scrub_stamp":"2024-05-04T02:48:36.022002+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:23:24.893540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":4545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"25'51","reported_seq":94,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:38.605455+0000","last_change":"2024-05-04T02:48:38.605514+0000","last_active":"2024-05-04T02:48:38.605455+0000","last_peered":"2024-05-04T02:48:38.605455+0000","last_clean":"2024-05-04T02:48:38.605455+0000","last_became_active":"2024-05-04T02:20:15.302456+0000","last_became_peered":"2024-05-04T02:20:15.302456+0000","last_unstale":"2024-05-04T02:48:38.605455+0000","last_undegraded":"2024-05-04T02:48:38.605455+0000","last_fullsized":"2024-05-04T02:48:38.605455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'51","last_scrub_stamp":"2024-05-04T02:48:38.605344+0000","last_deep_scrub":"25'51","last_deep_scrub_stamp":"2024-05-04T02:48:38.605344+0000","last_clean_scrub_stamp":"2024-05-04T02:48:38.605344+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:19:10.800248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":7049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"25'65","reported_seq":108,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:29.160044+0000","last_change":"2024-05-04T02:48:29.160073+0000","last_active":"2024-05-04T02:48:29.160044+0000","last_peered":"2024-05-04T02:48:29.160044+0000","last_clean":"2024-05-04T02:48:29.160044+0000","last_became_active":"2024-05-04T02:20:15.296235+0000","last_became_peered":"2024-05-04T02:20:15.296235+0000","last_unstale":"2024-05-04T02:48:29.160044+0000","last_undegraded":"2024-05-04T02:48:29.160044+0000","last_fullsized":"2024-05-04T02:48:29.160044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'65","last_scrub_stamp":"2024-05-04T02:48:29.159965+0000","last_deep_scrub":"25'65","last_deep_scrub_stamp":"2024-05-04T02:48:29.159965+0000","last_clean_scrub_stamp":"2024-05-04T02:48:29.159965+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:07:45.599162+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":6740,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"25'135","reported_seq":167,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:34.020936+0000","last_change":"2024-05-04T02:48:34.020961+0000","last_active":"2024-05-04T02:48:34.020936+0000","last_peered":"2024-05-04T02:48:34.020936+0000","last_clean":"2024-05-04T02:48:34.020936+0000","last_became_active":"2024-05-04T02:20:53.116069+0000","last_became_peered":"2024-05-04T02:20:53.116069+0000","last_unstale":"2024-05-04T02:48:34.020936+0000","last_undegraded":"2024-05-04T02:48:34.020936+0000","last_fullsized":"2024-05-04T02:48:34.020936+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'135","last_scrub_stamp":"2024-05-04T02:48:34.020861+0000","last_deep_scrub":"25'135","last_deep_scrub_stamp":"2024-05-04T02:48:34.020861+0000","last_clean_scrub_stamp":"2024-05-04T02:48:34.020861+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:40:22.797861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":121,"num_write_kb":7251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"25'77","reported_seq":120,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:31.947461+0000","last_change":"2024-05-04T02:48:31.947487+0000","last_active":"2024-05-04T02:48:31.947461+0000","last_peered":"2024-05-04T02:48:31.947461+0000","last_clean":"2024-05-04T02:48:31.947461+0000","last_became_active":"2024-05-04T02:20:15.301424+0000","last_became_peered":"2024-05-04T02:20:15.301424+0000","last_unstale":"2024-05-04T02:48:31.947461+0000","last_undegraded":"2024-05-04T02:48:31.947461+0000","last_fullsized":"2024-05-04T02:48:31.947461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'77","last_scrub_stamp":"2024-05-04T02:48:31.947378+0000","last_deep_scrub":"25'77","last_deep_scrub_stamp":"2024-05-04T02:48:31.947378+0000","last_clean_scrub_stamp":"2024-05-04T02:48:31.947378+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:15:37.622831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":8003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"25'86","reported_seq":129,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:35.009500+0000","last_change":"2024-05-04T02:48:35.009525+0000","last_active":"2024-05-04T02:48:35.009500+0000","last_peered":"2024-05-04T02:48:35.009500+0000","last_clean":"2024-05-04T02:48:35.009500+0000","last_became_active":"2024-05-04T02:20:15.292840+0000","last_became_peered":"2024-05-04T02:20:15.292840+0000","last_unstale":"2024-05-04T02:48:35.009500+0000","last_undegraded":"2024-05-04T02:48:35.009500+0000","last_fullsized":"2024-05-04T02:48:35.009500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'86","last_scrub_stamp":"2024-05-04T02:48:35.009424+0000","last_deep_scrub":"25'86","last_deep_scrub_stamp":"2024-05-04T02:48:35.009424+0000","last_clean_scrub_stamp":"2024-05-04T02:48:35.009424+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:23:40.893262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":6858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"25'66","reported_seq":107,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:32.787654+0000","last_change":"2024-05-04T02:48:32.787679+0000","last_active":"2024-05-04T02:48:32.787654+0000","last_peered":"2024-05-04T02:48:32.787654+0000","last_clean":"2024-05-04T02:48:32.787654+0000","last_became_active":"2024-05-04T02:20:15.297415+0000","last_became_peered":"2024-05-04T02:20:15.297415+0000","last_unstale":"2024-05-04T02:48:32.787654+0000","last_undegraded":"2024-05-04T02:48:32.787654+0000","last_fullsized":"2024-05-04T02:48:32.787654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'66","last_scrub_stamp":"2024-05-04T02:48:32.787560+0000","last_deep_scrub":"25'66","last_deep_scrub_stamp":"2024-05-04T02:48:32.787560+0000","last_clean_scrub_stamp":"2024-05-04T02:48:32.787560+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:05:34.942851+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":6149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"25'713","reported_seq":756,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:27.353209+0000","last_change":"2024-05-04T02:48:27.353238+0000","last_active":"2024-05-04T02:48:27.353209+0000","last_peered":"2024-05-04T02:48:27.353209+0000","last_clean":"2024-05-04T02:48:27.353209+0000","last_became_active":"2024-05-04T02:20:14.289651+0000","last_became_peered":"2024-05-04T02:20:14.289651+0000","last_unstale":"2024-05-04T02:48:27.353209+0000","last_undegraded":"2024-05-04T02:48:27.353209+0000","last_fullsized":"2024-05-04T02:48:27.353209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'713","last_scrub_stamp":"2024-05-04T02:48:27.353125+0000","last_deep_scrub":"25'713","last_deep_scrub_stamp":"2024-05-04T02:48:27.353125+0000","last_clean_scrub_stamp":"2024-05-04T02:48:27.353125+0000","objects_scrubbed":1,"log_size":713,"log_dups_size":0,"ondisk_log_size":713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:59:59.743644+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":710,"num_write_kb":4451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"25'81","reported_seq":122,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:34.101092+0000","last_change":"2024-05-04T02:48:34.101116+0000","last_active":"2024-05-04T02:48:34.101092+0000","last_peered":"2024-05-04T02:48:34.101092+0000","last_clean":"2024-05-04T02:48:34.101092+0000","last_became_active":"2024-05-04T02:20:15.305597+0000","last_became_peered":"2024-05-04T02:20:15.305597+0000","last_unstale":"2024-05-04T02:48:34.101092+0000","last_undegraded":"2024-05-04T02:48:34.101092+0000","last_fullsized":"2024-05-04T02:48:34.101092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'81","last_scrub_stamp":"2024-05-04T02:48:34.101010+0000","last_deep_scrub":"25'81","last_deep_scrub_stamp":"2024-05-04T02:48:34.101010+0000","last_clean_scrub_stamp":"2024-05-04T02:48:34.101010+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:07:45.342827+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":5085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"25'610","reported_seq":653,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:30.013693+0000","last_change":"2024-05-04T02:48:30.013720+0000","last_active":"2024-05-04T02:48:30.013693+0000","last_peered":"2024-05-04T02:48:30.013693+0000","last_clean":"2024-05-04T02:48:30.013693+0000","last_became_active":"2024-05-04T02:20:14.358394+0000","last_became_peered":"2024-05-04T02:20:14.358394+0000","last_unstale":"2024-05-04T02:48:30.013693+0000","last_undegraded":"2024-05-04T02:48:30.013693+0000","last_fullsized":"2024-05-04T02:48:30.013693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'610","last_scrub_stamp":"2024-05-04T02:48:30.013620+0000","last_deep_scrub":"25'610","last_deep_scrub_stamp":"2024-05-04T02:48:30.013620+0000","last_clean_scrub_stamp":"2024-05-04T02:48:30.013620+0000","objects_scrubbed":1,"log_size":610,"log_dups_size":0,"ondisk_log_size":610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:27:20.462339+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":604,"num_write_kb":4430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"25'3","reported_seq":46,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:29.408338+0000","last_change":"2024-05-04T02:48:29.408382+0000","last_active":"2024-05-04T02:48:29.408338+0000","last_peered":"2024-05-04T02:48:29.408338+0000","last_clean":"2024-05-04T02:48:29.408338+0000","last_became_active":"2024-05-04T02:20:14.355988+0000","last_became_peered":"2024-05-04T02:20:14.355988+0000","last_unstale":"2024-05-04T02:48:29.408338+0000","last_undegraded":"2024-05-04T02:48:29.408338+0000","last_fullsized":"2024-05-04T02:48:29.408338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'3","last_scrub_stamp":"2024-05-04T02:48:29.408250+0000","last_deep_scrub":"25'3","last_deep_scrub_stamp":"2024-05-04T02:48:29.408250+0000","last_clean_scrub_stamp":"2024-05-04T02:48:29.408250+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:03:45.957652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"25'73","reported_seq":114,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:33.480426+0000","last_change":"2024-05-04T02:48:33.480458+0000","last_active":"2024-05-04T02:48:33.480426+0000","last_peered":"2024-05-04T02:48:33.480426+0000","last_clean":"2024-05-04T02:48:33.480426+0000","last_became_active":"2024-05-04T02:20:15.295222+0000","last_became_peered":"2024-05-04T02:20:15.295222+0000","last_unstale":"2024-05-04T02:48:33.480426+0000","last_undegraded":"2024-05-04T02:48:33.480426+0000","last_fullsized":"2024-05-04T02:48:33.480426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'73","last_scrub_stamp":"2024-05-04T02:48:33.480312+0000","last_deep_scrub":"25'73","last_deep_scrub_stamp":"2024-05-04T02:48:33.480312+0000","last_clean_scrub_stamp":"2024-05-04T02:48:33.480312+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:47:46.487713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":4655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"25'4","reported_seq":47,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:31.382367+0000","last_change":"2024-05-04T02:48:31.382403+0000","last_active":"2024-05-04T02:48:31.382367+0000","last_peered":"2024-05-04T02:48:31.382367+0000","last_clean":"2024-05-04T02:48:31.382367+0000","last_became_active":"2024-05-04T02:20:14.290893+0000","last_became_peered":"2024-05-04T02:20:14.290893+0000","last_unstale":"2024-05-04T02:48:31.382367+0000","last_undegraded":"2024-05-04T02:48:31.382367+0000","last_fullsized":"2024-05-04T02:48:31.382367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'4","last_scrub_stamp":"2024-05-04T02:48:31.382273+0000","last_deep_scrub":"25'4","last_deep_scrub_stamp":"2024-05-04T02:48:31.382273+0000","last_clean_scrub_stamp":"2024-05-04T02:48:31.382273+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:43:28.316669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"25'86","reported_seq":127,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:31.956962+0000","last_change":"2024-05-04T02:48:31.956987+0000","last_active":"2024-05-04T02:48:31.956962+0000","last_peered":"2024-05-04T02:48:31.956962+0000","last_clean":"2024-05-04T02:48:31.956962+0000","last_became_active":"2024-05-04T02:20:15.291704+0000","last_became_peered":"2024-05-04T02:20:15.291704+0000","last_unstale":"2024-05-04T02:48:31.956962+0000","last_undegraded":"2024-05-04T02:48:31.956962+0000","last_fullsized":"2024-05-04T02:48:31.956962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'86","last_scrub_stamp":"2024-05-04T02:48:31.956886+0000","last_deep_scrub":"25'86","last_deep_scrub_stamp":"2024-05-04T02:48:31.956886+0000","last_clean_scrub_stamp":"2024-05-04T02:48:31.956886+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:33:01.599344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":67,"num_write_kb":4969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"25'5","reported_seq":48,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:31.991828+0000","last_change":"2024-05-04T02:48:31.991854+0000","last_active":"2024-05-04T02:48:31.991828+0000","last_peered":"2024-05-04T02:48:31.991828+0000","last_clean":"2024-05-04T02:48:31.991828+0000","last_became_active":"2024-05-04T02:20:14.357940+0000","last_became_peered":"2024-05-04T02:20:14.357940+0000","last_unstale":"2024-05-04T02:48:31.991828+0000","last_undegraded":"2024-05-04T02:48:31.991828+0000","last_fullsized":"2024-05-04T02:48:31.991828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5","last_scrub_stamp":"2024-05-04T02:48:31.991751+0000","last_deep_scrub":"25'5","last_deep_scrub_stamp":"2024-05-04T02:48:31.991751+0000","last_clean_scrub_stamp":"2024-05-04T02:48:31.991751+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:32:06.607530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"25'92","reported_seq":133,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:38.257180+0000","last_change":"2024-05-04T02:48:38.257207+0000","last_active":"2024-05-04T02:48:38.257180+0000","last_peered":"2024-05-04T02:48:38.257180+0000","last_clean":"2024-05-04T02:48:38.257180+0000","last_became_active":"2024-05-04T02:20:15.300374+0000","last_became_peered":"2024-05-04T02:20:15.300374+0000","last_unstale":"2024-05-04T02:48:38.257180+0000","last_undegraded":"2024-05-04T02:48:38.257180+0000","last_fullsized":"2024-05-04T02:48:38.257180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'92","last_scrub_stamp":"2024-05-04T02:48:38.257093+0000","last_deep_scrub":"25'92","last_deep_scrub_stamp":"2024-05-04T02:48:38.257093+0000","last_clean_scrub_stamp":"2024-05-04T02:48:38.257093+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:08:41.039110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":5924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"25'5","reported_seq":48,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:33.410849+0000","last_change":"2024-05-04T02:48:33.410897+0000","last_active":"2024-05-04T02:48:33.410849+0000","last_peered":"2024-05-04T02:48:33.410849+0000","last_clean":"2024-05-04T02:48:33.410849+0000","last_became_active":"2024-05-04T02:20:14.358625+0000","last_became_peered":"2024-05-04T02:20:14.358625+0000","last_unstale":"2024-05-04T02:48:33.410849+0000","last_undegraded":"2024-05-04T02:48:33.410849+0000","last_fullsized":"2024-05-04T02:48:33.410849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5","last_scrub_stamp":"2024-05-04T02:48:33.410717+0000","last_deep_scrub":"25'5","last_deep_scrub_stamp":"2024-05-04T02:48:33.410717+0000","last_clean_scrub_stamp":"2024-05-04T02:48:33.410717+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:15:02.761856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"25'59","reported_seq":100,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:35.120388+0000","last_change":"2024-05-04T02:48:35.120413+0000","last_active":"2024-05-04T02:48:35.120388+0000","last_peered":"2024-05-04T02:48:35.120388+0000","last_clean":"2024-05-04T02:48:35.120388+0000","last_became_active":"2024-05-04T02:20:15.306572+0000","last_became_peered":"2024-05-04T02:20:15.306572+0000","last_unstale":"2024-05-04T02:48:35.120388+0000","last_undegraded":"2024-05-04T02:48:35.120388+0000","last_fullsized":"2024-05-04T02:48:35.120388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'59","last_scrub_stamp":"2024-05-04T02:48:35.120312+0000","last_deep_scrub":"25'59","last_deep_scrub_stamp":"2024-05-04T02:48:35.120312+0000","last_clean_scrub_stamp":"2024-05-04T02:48:35.120312+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:44:29.336702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":3639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"25'610","reported_seq":653,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:29.991567+0000","last_change":"2024-05-04T02:48:29.991594+0000","last_active":"2024-05-04T02:48:29.991567+0000","last_peered":"2024-05-04T02:48:29.991567+0000","last_clean":"2024-05-04T02:48:29.991567+0000","last_became_active":"2024-05-04T02:20:14.292564+0000","last_became_peered":"2024-05-04T02:20:14.292564+0000","last_unstale":"2024-05-04T02:48:29.991567+0000","last_undegraded":"2024-05-04T02:48:29.991567+0000","last_fullsized":"2024-05-04T02:48:29.991567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'610","last_scrub_stamp":"2024-05-04T02:48:29.991482+0000","last_deep_scrub":"25'610","last_deep_scrub_stamp":"2024-05-04T02:48:29.991482+0000","last_clean_scrub_stamp":"2024-05-04T02:48:29.991482+0000","objects_scrubbed":2,"log_size":610,"log_dups_size":0,"ondisk_log_size":610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:16:11.120180+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":607,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"25'71","reported_seq":113,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:33.798900+0000","last_change":"2024-05-04T02:48:33.798929+0000","last_active":"2024-05-04T02:48:33.798900+0000","last_peered":"2024-05-04T02:48:33.798900+0000","last_clean":"2024-05-04T02:48:33.798900+0000","last_became_active":"2024-05-04T02:20:15.298018+0000","last_became_peered":"2024-05-04T02:20:15.298018+0000","last_unstale":"2024-05-04T02:48:33.798900+0000","last_undegraded":"2024-05-04T02:48:33.798900+0000","last_fullsized":"2024-05-04T02:48:33.798900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'71","last_scrub_stamp":"2024-05-04T02:48:33.798820+0000","last_deep_scrub":"25'71","last_deep_scrub_stamp":"2024-05-04T02:48:33.798820+0000","last_clean_scrub_stamp":"2024-05-04T02:48:33.798820+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:56:33.848832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":3497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"25'833","reported_seq":877,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:34.033665+0000","last_change":"2024-05-04T02:48:34.033697+0000","last_active":"2024-05-04T02:48:34.033665+0000","last_peered":"2024-05-04T02:48:34.033665+0000","last_clean":"2024-05-04T02:48:34.033665+0000","last_became_active":"2024-05-04T02:20:14.359886+0000","last_became_peered":"2024-05-04T02:20:14.359886+0000","last_unstale":"2024-05-04T02:48:34.033665+0000","last_undegraded":"2024-05-04T02:48:34.033665+0000","last_fullsized":"2024-05-04T02:48:34.033665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'833","last_scrub_stamp":"2024-05-04T02:48:34.033595+0000","last_deep_scrub":"25'833","last_deep_scrub_stamp":"2024-05-04T02:48:34.033595+0000","last_clean_scrub_stamp":"2024-05-04T02:48:34.033595+0000","objects_scrubbed":4,"log_size":833,"log_dups_size":0,"ondisk_log_size":833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:16:15.162293+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":827,"num_write_kb":4536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"25'64","reported_seq":110,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:47.183198+0000","last_change":"2024-05-04T02:48:47.183224+0000","last_active":"2024-05-04T02:48:47.183198+0000","last_peered":"2024-05-04T02:48:47.183198+0000","last_clean":"2024-05-04T02:48:47.183198+0000","last_became_active":"2024-05-04T02:20:53.116761+0000","last_became_peered":"2024-05-04T02:20:53.116761+0000","last_unstale":"2024-05-04T02:48:47.183198+0000","last_undegraded":"2024-05-04T02:48:47.183198+0000","last_fullsized":"2024-05-04T02:48:47.183198+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'64","last_scrub_stamp":"2024-05-04T02:48:47.183108+0000","last_deep_scrub":"25'64","last_deep_scrub_stamp":"2024-05-04T02:48:47.183108+0000","last_clean_scrub_stamp":"2024-05-04T02:48:47.183108+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:42:48.700793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":3872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"25'11","reported_seq":55,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:25.067875+0000","last_change":"2024-05-04T02:48:25.067902+0000","last_active":"2024-05-04T02:48:25.067875+0000","last_peered":"2024-05-04T02:48:25.067875+0000","last_clean":"2024-05-04T02:48:25.067875+0000","last_became_active":"2024-05-04T02:20:14.274604+0000","last_became_peered":"2024-05-04T02:20:14.274604+0000","last_unstale":"2024-05-04T02:48:25.067875+0000","last_undegraded":"2024-05-04T02:48:25.067875+0000","last_fullsized":"2024-05-04T02:48:25.067875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'11","last_scrub_stamp":"2024-05-04T02:48:25.067792+0000","last_deep_scrub":"25'11","last_deep_scrub_stamp":"2024-05-04T02:48:25.067792+0000","last_clean_scrub_stamp":"2024-05-04T02:48:25.067792+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:38:57.277782+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"25'79","reported_seq":121,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:31.154219+0000","last_change":"2024-05-04T02:48:31.154265+0000","last_active":"2024-05-04T02:48:31.154219+0000","last_peered":"2024-05-04T02:48:31.154219+0000","last_clean":"2024-05-04T02:48:31.154219+0000","last_became_active":"2024-05-04T02:20:15.300052+0000","last_became_peered":"2024-05-04T02:20:15.300052+0000","last_unstale":"2024-05-04T02:48:31.154219+0000","last_undegraded":"2024-05-04T02:48:31.154219+0000","last_fullsized":"2024-05-04T02:48:31.154219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'79","last_scrub_stamp":"2024-05-04T02:48:31.154087+0000","last_deep_scrub":"25'79","last_deep_scrub_stamp":"2024-05-04T02:48:31.154087+0000","last_clean_scrub_stamp":"2024-05-04T02:48:31.154087+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:37:41.297077+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":4963,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"25'6","reported_seq":50,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:30.423759+0000","last_change":"2024-05-04T02:48:30.423784+0000","last_active":"2024-05-04T02:48:30.423759+0000","last_peered":"2024-05-04T02:48:30.423759+0000","last_clean":"2024-05-04T02:48:30.423759+0000","last_became_active":"2024-05-04T02:20:14.289826+0000","last_became_peered":"2024-05-04T02:20:14.289826+0000","last_unstale":"2024-05-04T02:48:30.423759+0000","last_undegraded":"2024-05-04T02:48:30.423759+0000","last_fullsized":"2024-05-04T02:48:30.423759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6","last_scrub_stamp":"2024-05-04T02:48:30.423687+0000","last_deep_scrub":"25'6","last_deep_scrub_stamp":"2024-05-04T02:48:30.423687+0000","last_clean_scrub_stamp":"2024-05-04T02:48:30.423687+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:51:34.451382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"25'96","reported_seq":138,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:43.175466+0000","last_change":"2024-05-04T02:48:43.175494+0000","last_active":"2024-05-04T02:48:43.175466+0000","last_peered":"2024-05-04T02:48:43.175466+0000","last_clean":"2024-05-04T02:48:43.175466+0000","last_became_active":"2024-05-04T02:20:15.302963+0000","last_became_peered":"2024-05-04T02:20:15.302963+0000","last_unstale":"2024-05-04T02:48:43.175466+0000","last_undegraded":"2024-05-04T02:48:43.175466+0000","last_fullsized":"2024-05-04T02:48:43.175466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'96","last_scrub_stamp":"2024-05-04T02:48:43.175384+0000","last_deep_scrub":"25'96","last_deep_scrub_stamp":"2024-05-04T02:48:43.175384+0000","last_clean_scrub_stamp":"2024-05-04T02:48:43.175384+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:14:16.187424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72,"num_write_kb":14780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"25'5","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:30.962313+0000","last_change":"2024-05-04T02:48:30.962362+0000","last_active":"2024-05-04T02:48:30.962313+0000","last_peered":"2024-05-04T02:48:30.962313+0000","last_clean":"2024-05-04T02:48:30.962313+0000","last_became_active":"2024-05-04T02:20:14.358494+0000","last_became_peered":"2024-05-04T02:20:14.358494+0000","last_unstale":"2024-05-04T02:48:30.962313+0000","last_undegraded":"2024-05-04T02:48:30.962313+0000","last_fullsized":"2024-05-04T02:48:30.962313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5","last_scrub_stamp":"2024-05-04T02:48:30.962224+0000","last_deep_scrub":"25'5","last_deep_scrub_stamp":"2024-05-04T02:48:30.962224+0000","last_clean_scrub_stamp":"2024-05-04T02:48:30.962224+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:54:53.338243+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"25'51","reported_seq":93,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:35.986422+0000","last_change":"2024-05-04T02:48:35.986449+0000","last_active":"2024-05-04T02:48:35.986422+0000","last_peered":"2024-05-04T02:48:35.986422+0000","last_clean":"2024-05-04T02:48:35.986422+0000","last_became_active":"2024-05-04T02:20:15.294400+0000","last_became_peered":"2024-05-04T02:20:15.294400+0000","last_unstale":"2024-05-04T02:48:35.986422+0000","last_undegraded":"2024-05-04T02:48:35.986422+0000","last_fullsized":"2024-05-04T02:48:35.986422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'51","last_scrub_stamp":"2024-05-04T02:48:35.986343+0000","last_deep_scrub":"25'51","last_deep_scrub_stamp":"2024-05-04T02:48:35.986343+0000","last_clean_scrub_stamp":"2024-05-04T02:48:35.986343+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:33:05.628801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":2930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"25'16","reported_seq":60,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:26.997820+0000","last_change":"2024-05-04T02:48:26.997886+0000","last_active":"2024-05-04T02:48:26.997820+0000","last_peered":"2024-05-04T02:48:26.997820+0000","last_clean":"2024-05-04T02:48:26.997820+0000","last_became_active":"2024-05-04T02:20:14.269238+0000","last_became_peered":"2024-05-04T02:20:14.269238+0000","last_unstale":"2024-05-04T02:48:26.997820+0000","last_undegraded":"2024-05-04T02:48:26.997820+0000","last_fullsized":"2024-05-04T02:48:26.997820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'16","last_scrub_stamp":"2024-05-04T02:48:26.997726+0000","last_deep_scrub":"25'16","last_deep_scrub_stamp":"2024-05-04T02:48:26.997726+0000","last_clean_scrub_stamp":"2024-05-04T02:48:26.997726+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:21:24.249644+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"25'64","reported_seq":106,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:46.189365+0000","last_change":"2024-05-04T02:48:46.189390+0000","last_active":"2024-05-04T02:48:46.189365+0000","last_peered":"2024-05-04T02:48:46.189365+0000","last_clean":"2024-05-04T02:48:46.189365+0000","last_became_active":"2024-05-04T02:20:15.302736+0000","last_became_peered":"2024-05-04T02:20:15.302736+0000","last_unstale":"2024-05-04T02:48:46.189365+0000","last_undegraded":"2024-05-04T02:48:46.189365+0000","last_fullsized":"2024-05-04T02:48:46.189365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'64","last_scrub_stamp":"2024-05-04T02:48:46.189282+0000","last_deep_scrub":"25'64","last_deep_scrub_stamp":"2024-05-04T02:48:46.189282+0000","last_clean_scrub_stamp":"2024-05-04T02:48:46.189282+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:07:29.625184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":3572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'6","reported_seq":50,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:28.709408+0000","last_change":"2024-05-04T02:48:28.709441+0000","last_active":"2024-05-04T02:48:28.709408+0000","last_peered":"2024-05-04T02:48:28.709408+0000","last_clean":"2024-05-04T02:48:28.709408+0000","last_became_active":"2024-05-04T02:20:14.271883+0000","last_became_peered":"2024-05-04T02:20:14.271883+0000","last_unstale":"2024-05-04T02:48:28.709408+0000","last_undegraded":"2024-05-04T02:48:28.709408+0000","last_fullsized":"2024-05-04T02:48:28.709408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6","last_scrub_stamp":"2024-05-04T02:48:28.709327+0000","last_deep_scrub":"25'6","last_deep_scrub_stamp":"2024-05-04T02:48:28.709327+0000","last_clean_scrub_stamp":"2024-05-04T02:48:28.709327+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:11:53.616458+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"25'35","reported_seq":77,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:42.184747+0000","last_change":"2024-05-04T02:48:42.184774+0000","last_active":"2024-05-04T02:48:42.184747+0000","last_peered":"2024-05-04T02:48:42.184747+0000","last_clean":"2024-05-04T02:48:42.184747+0000","last_became_active":"2024-05-04T02:20:15.301880+0000","last_became_peered":"2024-05-04T02:20:15.301880+0000","last_unstale":"2024-05-04T02:48:42.184747+0000","last_undegraded":"2024-05-04T02:48:42.184747+0000","last_fullsized":"2024-05-04T02:48:42.184747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'35","last_scrub_stamp":"2024-05-04T02:48:42.184663+0000","last_deep_scrub":"25'35","last_deep_scrub_stamp":"2024-05-04T02:48:42.184663+0000","last_clean_scrub_stamp":"2024-05-04T02:48:42.184663+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:27:27.483989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":1775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'5","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:30.010414+0000","last_change":"2024-05-04T02:48:30.010462+0000","last_active":"2024-05-04T02:48:30.010414+0000","last_peered":"2024-05-04T02:48:30.010414+0000","last_clean":"2024-05-04T02:48:30.010414+0000","last_became_active":"2024-05-04T02:20:14.290132+0000","last_became_peered":"2024-05-04T02:20:14.290132+0000","last_unstale":"2024-05-04T02:48:30.010414+0000","last_undegraded":"2024-05-04T02:48:30.010414+0000","last_fullsized":"2024-05-04T02:48:30.010414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5","last_scrub_stamp":"2024-05-04T02:48:30.010299+0000","last_deep_scrub":"25'5","last_deep_scrub_stamp":"2024-05-04T02:48:30.010299+0000","last_clean_scrub_stamp":"2024-05-04T02:48:30.010299+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:04:10.909702+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"25'56","reported_seq":98,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:41.135706+0000","last_change":"2024-05-04T02:48:41.135733+0000","last_active":"2024-05-04T02:48:41.135706+0000","last_peered":"2024-05-04T02:48:41.135706+0000","last_clean":"2024-05-04T02:48:41.135706+0000","last_became_active":"2024-05-04T02:20:15.301798+0000","last_became_peered":"2024-05-04T02:20:15.301798+0000","last_unstale":"2024-05-04T02:48:41.135706+0000","last_undegraded":"2024-05-04T02:48:41.135706+0000","last_fullsized":"2024-05-04T02:48:41.135706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'56","last_scrub_stamp":"2024-05-04T02:48:41.135628+0000","last_deep_scrub":"25'56","last_deep_scrub_stamp":"2024-05-04T02:48:41.135628+0000","last_clean_scrub_stamp":"2024-05-04T02:48:41.135628+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:28:33.527308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":3906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"25'2","reported_seq":46,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:27.044115+0000","last_change":"2024-05-04T02:48:27.044165+0000","last_active":"2024-05-04T02:48:27.044115+0000","last_peered":"2024-05-04T02:48:27.044115+0000","last_clean":"2024-05-04T02:48:27.044115+0000","last_became_active":"2024-05-04T02:20:14.274609+0000","last_became_peered":"2024-05-04T02:20:14.274609+0000","last_unstale":"2024-05-04T02:48:27.044115+0000","last_undegraded":"2024-05-04T02:48:27.044115+0000","last_fullsized":"2024-05-04T02:48:27.044115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-05-04T02:48:27.043997+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-05-04T02:48:27.043997+0000","last_clean_scrub_stamp":"2024-05-04T02:48:27.043997+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:54:49.420016+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"25'84","reported_seq":126,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:40.286224+0000","last_change":"2024-05-04T02:48:40.286250+0000","last_active":"2024-05-04T02:48:40.286224+0000","last_peered":"2024-05-04T02:48:40.286224+0000","last_clean":"2024-05-04T02:48:40.286224+0000","last_became_active":"2024-05-04T02:20:15.301880+0000","last_became_peered":"2024-05-04T02:20:15.301880+0000","last_unstale":"2024-05-04T02:48:40.286224+0000","last_undegraded":"2024-05-04T02:48:40.286224+0000","last_fullsized":"2024-05-04T02:48:40.286224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'84","last_scrub_stamp":"2024-05-04T02:48:40.286133+0000","last_deep_scrub":"25'84","last_deep_scrub_stamp":"2024-05-04T02:48:40.286133+0000","last_clean_scrub_stamp":"2024-05-04T02:48:40.286133+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:43:10.451669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70,"num_write_kb":6433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"25'2","reported_seq":46,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:28.976531+0000","last_change":"2024-05-04T02:48:28.976558+0000","last_active":"2024-05-04T02:48:28.976531+0000","last_peered":"2024-05-04T02:48:28.976531+0000","last_clean":"2024-05-04T02:48:28.976531+0000","last_became_active":"2024-05-04T02:20:14.287992+0000","last_became_peered":"2024-05-04T02:20:14.287992+0000","last_unstale":"2024-05-04T02:48:28.976531+0000","last_undegraded":"2024-05-04T02:48:28.976531+0000","last_fullsized":"2024-05-04T02:48:28.976531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-05-04T02:48:28.976446+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-05-04T02:48:28.976446+0000","last_clean_scrub_stamp":"2024-05-04T02:48:28.976446+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:56:46.362493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"25'61","reported_seq":103,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:45.218703+0000","last_change":"2024-05-04T02:48:45.218747+0000","last_active":"2024-05-04T02:48:45.218703+0000","last_peered":"2024-05-04T02:48:45.218703+0000","last_clean":"2024-05-04T02:48:45.218703+0000","last_became_active":"2024-05-04T02:20:15.303601+0000","last_became_peered":"2024-05-04T02:20:15.303601+0000","last_unstale":"2024-05-04T02:48:45.218703+0000","last_undegraded":"2024-05-04T02:48:45.218703+0000","last_fullsized":"2024-05-04T02:48:45.218703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'61","last_scrub_stamp":"2024-05-04T02:48:45.218584+0000","last_deep_scrub":"25'61","last_deep_scrub_stamp":"2024-05-04T02:48:45.218584+0000","last_clean_scrub_stamp":"2024-05-04T02:48:45.218584+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:28:35.606825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":2391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"25'74","reported_seq":143,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:32.200640+0000","last_change":"2024-05-04T02:48:32.200673+0000","last_active":"2024-05-04T02:48:32.200640+0000","last_peered":"2024-05-04T02:48:32.200640+0000","last_clean":"2024-05-04T02:48:32.200640+0000","last_became_active":"2024-05-04T02:20:02.918859+0000","last_became_peered":"2024-05-04T02:20:02.918859+0000","last_unstale":"2024-05-04T02:48:32.200640+0000","last_undegraded":"2024-05-04T02:48:32.200640+0000","last_fullsized":"2024-05-04T02:48:32.200640+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'74","last_scrub_stamp":"2024-05-04T02:48:32.200566+0000","last_deep_scrub":"25'74","last_deep_scrub_stamp":"2024-05-04T02:48:32.200566+0000","last_clean_scrub_stamp":"2024-05-04T02:48:32.200566+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:43:25.005262+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"25'1","reported_seq":46,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:29.453470+0000","last_change":"2024-05-04T02:48:29.453495+0000","last_active":"2024-05-04T02:48:29.453470+0000","last_peered":"2024-05-04T02:48:29.453470+0000","last_clean":"2024-05-04T02:48:29.453470+0000","last_became_active":"2024-05-04T02:20:14.289597+0000","last_became_peered":"2024-05-04T02:20:14.289597+0000","last_unstale":"2024-05-04T02:48:29.453470+0000","last_undegraded":"2024-05-04T02:48:29.453470+0000","last_fullsized":"2024-05-04T02:48:29.453470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-05-04T02:48:29.453384+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-05-04T02:48:29.453384+0000","last_clean_scrub_stamp":"2024-05-04T02:48:29.453384+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:23:18.324922+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"25'46","reported_seq":89,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:40.667574+0000","last_change":"2024-05-04T02:48:40.667605+0000","last_active":"2024-05-04T02:48:40.667574+0000","last_peered":"2024-05-04T02:48:40.667574+0000","last_clean":"2024-05-04T02:48:40.667574+0000","last_became_active":"2024-05-04T02:20:15.306640+0000","last_became_peered":"2024-05-04T02:20:15.306640+0000","last_unstale":"2024-05-04T02:48:40.667574+0000","last_undegraded":"2024-05-04T02:48:40.667574+0000","last_fullsized":"2024-05-04T02:48:40.667574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'46","last_scrub_stamp":"2024-05-04T02:48:40.667484+0000","last_deep_scrub":"25'46","last_deep_scrub_stamp":"2024-05-04T02:48:40.667484+0000","last_clean_scrub_stamp":"2024-05-04T02:48:40.667484+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:36:40.579592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":2916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"25'363","reported_seq":409,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:34.244227+0000","last_change":"2024-05-04T02:48:34.244256+0000","last_active":"2024-05-04T02:48:34.244227+0000","last_peered":"2024-05-04T02:48:34.244227+0000","last_clean":"2024-05-04T02:48:34.244227+0000","last_became_active":"2024-05-04T02:20:14.291044+0000","last_became_peered":"2024-05-04T02:20:14.291044+0000","last_unstale":"2024-05-04T02:48:34.244227+0000","last_undegraded":"2024-05-04T02:48:34.244227+0000","last_fullsized":"2024-05-04T02:48:34.244227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'363","last_scrub_stamp":"2024-05-04T02:48:34.244126+0000","last_deep_scrub":"25'363","last_deep_scrub_stamp":"2024-05-04T02:48:34.244126+0000","last_clean_scrub_stamp":"2024-05-04T02:48:34.244126+0000","objects_scrubbed":1,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:27:27.291767+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3804637,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":357,"num_write_kb":3904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"25'52","reported_seq":95,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:33.074483+0000","last_change":"2024-05-04T02:48:33.074532+0000","last_active":"2024-05-04T02:48:33.074483+0000","last_peered":"2024-05-04T02:48:33.074483+0000","last_clean":"2024-05-04T02:48:33.074483+0000","last_became_active":"2024-05-04T02:20:15.305512+0000","last_became_peered":"2024-05-04T02:20:15.305512+0000","last_unstale":"2024-05-04T02:48:33.074483+0000","last_undegraded":"2024-05-04T02:48:33.074483+0000","last_fullsized":"2024-05-04T02:48:33.074483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'52","last_scrub_stamp":"2024-05-04T02:48:33.074376+0000","last_deep_scrub":"25'52","last_deep_scrub_stamp":"2024-05-04T02:48:33.074376+0000","last_clean_scrub_stamp":"2024-05-04T02:48:33.074376+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:31:19.704666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":2895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"25'849","reported_seq":1735,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:28.001545+0000","last_change":"2024-05-04T02:48:28.001571+0000","last_active":"2024-05-04T02:48:28.001545+0000","last_peered":"2024-05-04T02:48:28.001545+0000","last_clean":"2024-05-04T02:48:28.001545+0000","last_became_active":"2024-05-04T02:20:14.287335+0000","last_became_peered":"2024-05-04T02:20:14.287335+0000","last_unstale":"2024-05-04T02:48:28.001545+0000","last_undegraded":"2024-05-04T02:48:28.001545+0000","last_fullsized":"2024-05-04T02:48:28.001545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'849","last_scrub_stamp":"2024-05-04T02:48:28.001477+0000","last_deep_scrub":"25'849","last_deep_scrub_stamp":"2024-05-04T02:48:28.001477+0000","last_clean_scrub_stamp":"2024-05-04T02:48:28.001477+0000","objects_scrubbed":1,"log_size":849,"log_dups_size":0,"ondisk_log_size":849,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:02:23.155893+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":181194,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":841,"num_read_kb":897,"num_write":844,"num_write_kb":899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"25'71","reported_seq":115,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:33.922413+0000","last_change":"2024-05-04T02:48:33.922440+0000","last_active":"2024-05-04T02:48:33.922413+0000","last_peered":"2024-05-04T02:48:33.922413+0000","last_clean":"2024-05-04T02:48:33.922413+0000","last_became_active":"2024-05-04T02:20:15.297010+0000","last_became_peered":"2024-05-04T02:20:15.297010+0000","last_unstale":"2024-05-04T02:48:33.922413+0000","last_undegraded":"2024-05-04T02:48:33.922413+0000","last_fullsized":"2024-05-04T02:48:33.922413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'71","last_scrub_stamp":"2024-05-04T02:48:33.922328+0000","last_deep_scrub":"25'71","last_deep_scrub_stamp":"2024-05-04T02:48:33.922328+0000","last_clean_scrub_stamp":"2024-05-04T02:48:33.922328+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:32:35.921185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":1942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"25'5","reported_seq":50,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:32.369390+0000","last_change":"2024-05-04T02:48:32.369435+0000","last_active":"2024-05-04T02:48:32.369390+0000","last_peered":"2024-05-04T02:48:32.369390+0000","last_clean":"2024-05-04T02:48:32.369390+0000","last_became_active":"2024-05-04T02:20:14.292595+0000","last_became_peered":"2024-05-04T02:20:14.292595+0000","last_unstale":"2024-05-04T02:48:32.369390+0000","last_undegraded":"2024-05-04T02:48:32.369390+0000","last_fullsized":"2024-05-04T02:48:32.369390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5","last_scrub_stamp":"2024-05-04T02:48:32.369296+0000","last_deep_scrub":"25'5","last_deep_scrub_stamp":"2024-05-04T02:48:32.369296+0000","last_clean_scrub_stamp":"2024-05-04T02:48:32.369296+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:28:41.741808+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"25'85","reported_seq":128,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:30.767252+0000","last_change":"2024-05-04T02:48:30.767279+0000","last_active":"2024-05-04T02:48:30.767252+0000","last_peered":"2024-05-04T02:48:30.767252+0000","last_clean":"2024-05-04T02:48:30.767252+0000","last_became_active":"2024-05-04T02:20:15.296075+0000","last_became_peered":"2024-05-04T02:20:15.296075+0000","last_unstale":"2024-05-04T02:48:30.767252+0000","last_undegraded":"2024-05-04T02:48:30.767252+0000","last_fullsized":"2024-05-04T02:48:30.767252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'85","last_scrub_stamp":"2024-05-04T02:48:30.767170+0000","last_deep_scrub":"25'85","last_deep_scrub_stamp":"2024-05-04T02:48:30.767170+0000","last_clean_scrub_stamp":"2024-05-04T02:48:30.767170+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:34:54.473302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76,"num_write_kb":6268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"25'3","reported_seq":48,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:26.023169+0000","last_change":"2024-05-04T02:48:26.023195+0000","last_active":"2024-05-04T02:48:26.023169+0000","last_peered":"2024-05-04T02:48:26.023169+0000","last_clean":"2024-05-04T02:48:26.023169+0000","last_became_active":"2024-05-04T02:20:14.253513+0000","last_became_peered":"2024-05-04T02:20:14.253513+0000","last_unstale":"2024-05-04T02:48:26.023169+0000","last_undegraded":"2024-05-04T02:48:26.023169+0000","last_fullsized":"2024-05-04T02:48:26.023169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'3","last_scrub_stamp":"2024-05-04T02:48:26.023077+0000","last_deep_scrub":"25'3","last_deep_scrub_stamp":"2024-05-04T02:48:26.023077+0000","last_clean_scrub_stamp":"2024-05-04T02:48:26.023077+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:40:14.800077+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"25'68","reported_seq":111,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:34.367493+0000","last_change":"2024-05-04T02:48:34.367534+0000","last_active":"2024-05-04T02:48:34.367493+0000","last_peered":"2024-05-04T02:48:34.367493+0000","last_clean":"2024-05-04T02:48:34.367493+0000","last_became_active":"2024-05-04T02:20:15.300251+0000","last_became_peered":"2024-05-04T02:20:15.300251+0000","last_unstale":"2024-05-04T02:48:34.367493+0000","last_undegraded":"2024-05-04T02:48:34.367493+0000","last_fullsized":"2024-05-04T02:48:34.367493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'68","last_scrub_stamp":"2024-05-04T02:48:34.367372+0000","last_deep_scrub":"25'68","last_deep_scrub_stamp":"2024-05-04T02:48:34.367372+0000","last_clean_scrub_stamp":"2024-05-04T02:48:34.367372+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:58:38.334270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":2367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"25'2","reported_seq":47,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:33.193319+0000","last_change":"2024-05-04T02:48:33.193351+0000","last_active":"2024-05-04T02:48:33.193319+0000","last_peered":"2024-05-04T02:48:33.193319+0000","last_clean":"2024-05-04T02:48:33.193319+0000","last_became_active":"2024-05-04T02:20:14.290952+0000","last_became_peered":"2024-05-04T02:20:14.290952+0000","last_unstale":"2024-05-04T02:48:33.193319+0000","last_undegraded":"2024-05-04T02:48:33.193319+0000","last_fullsized":"2024-05-04T02:48:33.193319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-05-04T02:48:33.193244+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-05-04T02:48:33.193244+0000","last_clean_scrub_stamp":"2024-05-04T02:48:33.193244+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T14:15:02.544383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"25'68","reported_seq":111,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:32.943758+0000","last_change":"2024-05-04T02:48:32.943795+0000","last_active":"2024-05-04T02:48:32.943758+0000","last_peered":"2024-05-04T02:48:32.943758+0000","last_clean":"2024-05-04T02:48:32.943758+0000","last_became_active":"2024-05-04T02:20:15.296562+0000","last_became_peered":"2024-05-04T02:20:15.296562+0000","last_unstale":"2024-05-04T02:48:32.943758+0000","last_undegraded":"2024-05-04T02:48:32.943758+0000","last_fullsized":"2024-05-04T02:48:32.943758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'68","last_scrub_stamp":"2024-05-04T02:48:32.943672+0000","last_deep_scrub":"25'68","last_deep_scrub_stamp":"2024-05-04T02:48:32.943672+0000","last_clean_scrub_stamp":"2024-05-04T02:48:32.943672+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:31:22.084627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":2660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"25'1353","reported_seq":1398,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:30.962058+0000","last_change":"2024-05-04T02:48:30.962089+0000","last_active":"2024-05-04T02:48:30.962058+0000","last_peered":"2024-05-04T02:48:30.962058+0000","last_clean":"2024-05-04T02:48:30.962058+0000","last_became_active":"2024-05-04T02:20:14.358621+0000","last_became_peered":"2024-05-04T02:20:14.358621+0000","last_unstale":"2024-05-04T02:48:30.962058+0000","last_undegraded":"2024-05-04T02:48:30.962058+0000","last_fullsized":"2024-05-04T02:48:30.962058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1353","last_scrub_stamp":"2024-05-04T02:48:30.961971+0000","last_deep_scrub":"25'1353","last_deep_scrub_stamp":"2024-05-04T02:48:30.961971+0000","last_clean_scrub_stamp":"2024-05-04T02:48:30.961971+0000","objects_scrubbed":1,"log_size":1353,"log_dups_size":0,"ondisk_log_size":1353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:23:36.845809+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3394,"num_write_kb":1205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"25'74","reported_seq":117,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:35.548670+0000","last_change":"2024-05-04T02:48:35.548697+0000","last_active":"2024-05-04T02:48:35.548670+0000","last_peered":"2024-05-04T02:48:35.548670+0000","last_clean":"2024-05-04T02:48:35.548670+0000","last_became_active":"2024-05-04T02:20:15.299678+0000","last_became_peered":"2024-05-04T02:20:15.299678+0000","last_unstale":"2024-05-04T02:48:35.548670+0000","last_undegraded":"2024-05-04T02:48:35.548670+0000","last_fullsized":"2024-05-04T02:48:35.548670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'74","last_scrub_stamp":"2024-05-04T02:48:35.548586+0000","last_deep_scrub":"25'74","last_deep_scrub_stamp":"2024-05-04T02:48:35.548586+0000","last_clean_scrub_stamp":"2024-05-04T02:48:35.548586+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:43:28.353282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":5134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"25'7","reported_seq":52,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:32.989279+0000","last_change":"2024-05-04T02:48:32.989306+0000","last_active":"2024-05-04T02:48:32.989279+0000","last_peered":"2024-05-04T02:48:32.989279+0000","last_clean":"2024-05-04T02:48:32.989279+0000","last_became_active":"2024-05-04T02:20:14.358524+0000","last_became_peered":"2024-05-04T02:20:14.358524+0000","last_unstale":"2024-05-04T02:48:32.989279+0000","last_undegraded":"2024-05-04T02:48:32.989279+0000","last_fullsized":"2024-05-04T02:48:32.989279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'7","last_scrub_stamp":"2024-05-04T02:48:32.989205+0000","last_deep_scrub":"25'7","last_deep_scrub_stamp":"2024-05-04T02:48:32.989205+0000","last_clean_scrub_stamp":"2024-05-04T02:48:32.989205+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:40:12.136448+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"25'73","reported_seq":116,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:28.131878+0000","last_change":"2024-05-04T02:48:28.131878+0000","last_active":"2024-05-04T02:48:28.131878+0000","last_peered":"2024-05-04T02:48:28.131878+0000","last_clean":"2024-05-04T02:48:28.131878+0000","last_became_active":"2024-05-04T02:20:15.293602+0000","last_became_peered":"2024-05-04T02:20:15.293602+0000","last_unstale":"2024-05-04T02:48:28.131878+0000","last_undegraded":"2024-05-04T02:48:28.131878+0000","last_fullsized":"2024-05-04T02:48:28.131878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'73","last_scrub_stamp":"2024-05-04T02:48:28.131693+0000","last_deep_scrub":"25'73","last_deep_scrub_stamp":"2024-05-04T02:48:28.131693+0000","last_clean_scrub_stamp":"2024-05-04T02:48:28.131693+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:33:47.960266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":2324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"25'6","reported_seq":51,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:35.226727+0000","last_change":"2024-05-04T02:48:35.226753+0000","last_active":"2024-05-04T02:48:35.226727+0000","last_peered":"2024-05-04T02:48:35.226727+0000","last_clean":"2024-05-04T02:48:35.226727+0000","last_became_active":"2024-05-04T02:20:14.291068+0000","last_became_peered":"2024-05-04T02:20:14.291068+0000","last_unstale":"2024-05-04T02:48:35.226727+0000","last_undegraded":"2024-05-04T02:48:35.226727+0000","last_fullsized":"2024-05-04T02:48:35.226727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'6","last_scrub_stamp":"2024-05-04T02:48:35.226647+0000","last_deep_scrub":"25'6","last_deep_scrub_stamp":"2024-05-04T02:48:35.226647+0000","last_clean_scrub_stamp":"2024-05-04T02:48:35.226647+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:19:07.421551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"25'72","reported_seq":115,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:29.737124+0000","last_change":"2024-05-04T02:48:29.737177+0000","last_active":"2024-05-04T02:48:29.737124+0000","last_peered":"2024-05-04T02:48:29.737124+0000","last_clean":"2024-05-04T02:48:29.737124+0000","last_became_active":"2024-05-04T02:20:15.247583+0000","last_became_peered":"2024-05-04T02:20:15.247583+0000","last_unstale":"2024-05-04T02:48:29.737124+0000","last_undegraded":"2024-05-04T02:48:29.737124+0000","last_fullsized":"2024-05-04T02:48:29.737124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'72","last_scrub_stamp":"2024-05-04T02:48:29.736991+0000","last_deep_scrub":"25'72","last_deep_scrub_stamp":"2024-05-04T02:48:29.736991+0000","last_clean_scrub_stamp":"2024-05-04T02:48:29.736991+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:28:55.144297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65,"num_write_kb":6637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"25'3","reported_seq":48,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:28.963198+0000","last_change":"2024-05-04T02:48:28.963224+0000","last_active":"2024-05-04T02:48:28.963198+0000","last_peered":"2024-05-04T02:48:28.963198+0000","last_clean":"2024-05-04T02:48:28.963198+0000","last_became_active":"2024-05-04T02:20:14.289360+0000","last_became_peered":"2024-05-04T02:20:14.289360+0000","last_unstale":"2024-05-04T02:48:28.963198+0000","last_undegraded":"2024-05-04T02:48:28.963198+0000","last_fullsized":"2024-05-04T02:48:28.963198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'3","last_scrub_stamp":"2024-05-04T02:48:28.963113+0000","last_deep_scrub":"25'3","last_deep_scrub_stamp":"2024-05-04T02:48:28.963113+0000","last_clean_scrub_stamp":"2024-05-04T02:48:28.963113+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:40:08.110356+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"25'64","reported_seq":107,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:34.521433+0000","last_change":"2024-05-04T02:48:34.521486+0000","last_active":"2024-05-04T02:48:34.521433+0000","last_peered":"2024-05-04T02:48:34.521433+0000","last_clean":"2024-05-04T02:48:34.521433+0000","last_became_active":"2024-05-04T02:20:15.296330+0000","last_became_peered":"2024-05-04T02:20:15.296330+0000","last_unstale":"2024-05-04T02:48:34.521433+0000","last_undegraded":"2024-05-04T02:48:34.521433+0000","last_fullsized":"2024-05-04T02:48:34.521433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'64","last_scrub_stamp":"2024-05-04T02:48:34.521323+0000","last_deep_scrub":"25'64","last_deep_scrub_stamp":"2024-05-04T02:48:34.521323+0000","last_clean_scrub_stamp":"2024-05-04T02:48:34.521323+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:51:38.549018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":4339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":45,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:28.000047+0000","last_change":"2024-05-04T02:48:28.000087+0000","last_active":"2024-05-04T02:48:28.000047+0000","last_peered":"2024-05-04T02:48:28.000047+0000","last_clean":"2024-05-04T02:48:28.000047+0000","last_became_active":"2024-05-04T02:20:14.288769+0000","last_became_peered":"2024-05-04T02:20:14.288769+0000","last_unstale":"2024-05-04T02:48:28.000047+0000","last_undegraded":"2024-05-04T02:48:28.000047+0000","last_fullsized":"2024-05-04T02:48:28.000047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-04T02:48:27.999913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-04T02:48:27.999913+0000","last_clean_scrub_stamp":"2024-05-04T02:48:27.999913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:32:02.615692+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"25'89","reported_seq":131,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:32.455706+0000","last_change":"2024-05-04T02:48:32.455736+0000","last_active":"2024-05-04T02:48:32.455706+0000","last_peered":"2024-05-04T02:48:32.455706+0000","last_clean":"2024-05-04T02:48:32.455706+0000","last_became_active":"2024-05-04T02:20:15.295128+0000","last_became_peered":"2024-05-04T02:20:15.295128+0000","last_unstale":"2024-05-04T02:48:32.455706+0000","last_undegraded":"2024-05-04T02:48:32.455706+0000","last_fullsized":"2024-05-04T02:48:32.455706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'89","last_scrub_stamp":"2024-05-04T02:48:32.455604+0000","last_deep_scrub":"25'89","last_deep_scrub_stamp":"2024-05-04T02:48:32.455604+0000","last_clean_scrub_stamp":"2024-05-04T02:48:32.455604+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:56:18.655433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":78,"num_write_kb":2421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"25'557","reported_seq":601,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:37.164355+0000","last_change":"2024-05-04T02:48:37.164386+0000","last_active":"2024-05-04T02:48:37.164355+0000","last_peered":"2024-05-04T02:48:37.164355+0000","last_clean":"2024-05-04T02:48:37.164355+0000","last_became_active":"2024-05-04T02:20:14.293862+0000","last_became_peered":"2024-05-04T02:20:14.293862+0000","last_unstale":"2024-05-04T02:48:37.164355+0000","last_undegraded":"2024-05-04T02:48:37.164355+0000","last_fullsized":"2024-05-04T02:48:37.164355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'557","last_scrub_stamp":"2024-05-04T02:48:37.164283+0000","last_deep_scrub":"25'557","last_deep_scrub_stamp":"2024-05-04T02:48:37.164283+0000","last_clean_scrub_stamp":"2024-05-04T02:48:37.164283+0000","objects_scrubbed":2,"log_size":557,"log_dups_size":0,"ondisk_log_size":557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T11:36:37.076391+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":549,"num_write_kb":4370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"25'73","reported_seq":116,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:38.008779+0000","last_change":"2024-05-04T02:48:38.008806+0000","last_active":"2024-05-04T02:48:38.008779+0000","last_peered":"2024-05-04T02:48:38.008779+0000","last_clean":"2024-05-04T02:48:38.008779+0000","last_became_active":"2024-05-04T02:20:15.296544+0000","last_became_peered":"2024-05-04T02:20:15.296544+0000","last_unstale":"2024-05-04T02:48:38.008779+0000","last_undegraded":"2024-05-04T02:48:38.008779+0000","last_fullsized":"2024-05-04T02:48:38.008779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'73","last_scrub_stamp":"2024-05-04T02:48:38.008688+0000","last_deep_scrub":"25'73","last_deep_scrub_stamp":"2024-05-04T02:48:38.008688+0000","last_clean_scrub_stamp":"2024-05-04T02:48:38.008688+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:23:18.915185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":62,"num_write_kb":1715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"25'89","reported_seq":130,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:41.319647+0000","last_change":"2024-05-04T02:48:41.319691+0000","last_active":"2024-05-04T02:48:41.319647+0000","last_peered":"2024-05-04T02:48:41.319647+0000","last_clean":"2024-05-04T02:48:41.319647+0000","last_became_active":"2024-05-04T02:20:15.305941+0000","last_became_peered":"2024-05-04T02:20:15.305941+0000","last_unstale":"2024-05-04T02:48:41.319647+0000","last_undegraded":"2024-05-04T02:48:41.319647+0000","last_fullsized":"2024-05-04T02:48:41.319647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'89","last_scrub_stamp":"2024-05-04T02:48:41.319551+0000","last_deep_scrub":"25'89","last_deep_scrub_stamp":"2024-05-04T02:48:41.319551+0000","last_clean_scrub_stamp":"2024-05-04T02:48:41.319551+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:20:47.511403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66,"num_write_kb":3718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"25'5","reported_seq":48,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:36.185741+0000","last_change":"2024-05-04T02:48:36.185770+0000","last_active":"2024-05-04T02:48:36.185741+0000","last_peered":"2024-05-04T02:48:36.185741+0000","last_clean":"2024-05-04T02:48:36.185741+0000","last_became_active":"2024-05-04T02:20:14.293788+0000","last_became_peered":"2024-05-04T02:20:14.293788+0000","last_unstale":"2024-05-04T02:48:36.185741+0000","last_undegraded":"2024-05-04T02:48:36.185741+0000","last_fullsized":"2024-05-04T02:48:36.185741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'5","last_scrub_stamp":"2024-05-04T02:48:36.185650+0000","last_deep_scrub":"25'5","last_deep_scrub_stamp":"2024-05-04T02:48:36.185650+0000","last_clean_scrub_stamp":"2024-05-04T02:48:36.185650+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:01:30.213921+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"25'52","reported_seq":93,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:42.322952+0000","last_change":"2024-05-04T02:48:42.322976+0000","last_active":"2024-05-04T02:48:42.322952+0000","last_peered":"2024-05-04T02:48:42.322952+0000","last_clean":"2024-05-04T02:48:42.322952+0000","last_became_active":"2024-05-04T02:20:15.306050+0000","last_became_peered":"2024-05-04T02:20:15.306050+0000","last_unstale":"2024-05-04T02:48:42.322952+0000","last_undegraded":"2024-05-04T02:48:42.322952+0000","last_fullsized":"2024-05-04T02:48:42.322952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'52","last_scrub_stamp":"2024-05-04T02:48:42.322864+0000","last_deep_scrub":"25'52","last_deep_scrub_stamp":"2024-05-04T02:48:42.322864+0000","last_clean_scrub_stamp":"2024-05-04T02:48:42.322864+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T13:28:14.614809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":4810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"25'1267","reported_seq":1310,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:38.160121+0000","last_change":"2024-05-04T02:48:38.160184+0000","last_active":"2024-05-04T02:48:38.160121+0000","last_peered":"2024-05-04T02:48:38.160121+0000","last_clean":"2024-05-04T02:48:38.160121+0000","last_became_active":"2024-05-04T02:20:14.357368+0000","last_became_peered":"2024-05-04T02:20:14.357368+0000","last_unstale":"2024-05-04T02:48:38.160121+0000","last_undegraded":"2024-05-04T02:48:38.160121+0000","last_fullsized":"2024-05-04T02:48:38.160121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1267","last_scrub_stamp":"2024-05-04T02:48:38.160033+0000","last_deep_scrub":"25'1267","last_deep_scrub_stamp":"2024-05-04T02:48:38.160033+0000","last_clean_scrub_stamp":"2024-05-04T02:48:38.160033+0000","objects_scrubbed":3,"log_size":1267,"log_dups_size":0,"ondisk_log_size":1267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:51:54.621544+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1255,"num_write_kb":8902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"25'94","reported_seq":142,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:36.153240+0000","last_change":"2024-05-04T02:48:36.153265+0000","last_active":"2024-05-04T02:48:36.153240+0000","last_peered":"2024-05-04T02:48:36.153240+0000","last_clean":"2024-05-04T02:48:36.153240+0000","last_became_active":"2024-05-04T02:20:53.106867+0000","last_became_peered":"2024-05-04T02:20:53.106867+0000","last_unstale":"2024-05-04T02:48:36.153240+0000","last_undegraded":"2024-05-04T02:48:36.153240+0000","last_fullsized":"2024-05-04T02:48:36.153240+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'94","last_scrub_stamp":"2024-05-04T02:48:36.153161+0000","last_deep_scrub":"25'94","last_deep_scrub_stamp":"2024-05-04T02:48:36.153161+0000","last_clean_scrub_stamp":"2024-05-04T02:48:36.153161+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:14:28.390608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":82,"num_write_kb":7905,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"25'741","reported_seq":787,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:28.379565+0000","last_change":"2024-05-04T02:48:28.379594+0000","last_active":"2024-05-04T02:48:28.379565+0000","last_peered":"2024-05-04T02:48:28.379565+0000","last_clean":"2024-05-04T02:48:28.379565+0000","last_became_active":"2024-05-04T02:20:14.291331+0000","last_became_peered":"2024-05-04T02:20:14.291331+0000","last_unstale":"2024-05-04T02:48:28.379565+0000","last_undegraded":"2024-05-04T02:48:28.379565+0000","last_fullsized":"2024-05-04T02:48:28.379565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'741","last_scrub_stamp":"2024-05-04T02:48:28.379462+0000","last_deep_scrub":"25'741","last_deep_scrub_stamp":"2024-05-04T02:48:28.379462+0000","last_clean_scrub_stamp":"2024-05-04T02:48:28.379462+0000","objects_scrubbed":1,"log_size":741,"log_dups_size":0,"ondisk_log_size":741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:10:17.837877+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":732,"num_write_kb":4528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"25'50","reported_seq":94,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:30.394187+0000","last_change":"2024-05-04T02:48:30.394238+0000","last_active":"2024-05-04T02:48:30.394187+0000","last_peered":"2024-05-04T02:48:30.394187+0000","last_clean":"2024-05-04T02:48:30.394187+0000","last_became_active":"2024-05-04T02:20:15.294026+0000","last_became_peered":"2024-05-04T02:20:15.294026+0000","last_unstale":"2024-05-04T02:48:30.394187+0000","last_undegraded":"2024-05-04T02:48:30.394187+0000","last_fullsized":"2024-05-04T02:48:30.394187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'50","last_scrub_stamp":"2024-05-04T02:48:30.394102+0000","last_deep_scrub":"25'50","last_deep_scrub_stamp":"2024-05-04T02:48:30.394102+0000","last_clean_scrub_stamp":"2024-05-04T02:48:30.394102+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T12:39:44.098146+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":3304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"25'591","reported_seq":636,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-04T02:48:26.096786+0000","last_change":"2024-05-04T02:48:26.096854+0000","last_active":"2024-05-04T02:48:26.096786+0000","last_peered":"2024-05-04T02:48:26.096786+0000","last_clean":"2024-05-04T02:48:26.096786+0000","last_became_active":"2024-05-04T02:20:14.291313+0000","last_became_peered":"2024-05-04T02:20:14.291313+0000","last_unstale":"2024-05-04T02:48:26.096786+0000","last_undegraded":"2024-05-04T02:48:26.096786+0000","last_fullsized":"2024-05-04T02:48:26.096786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'591","last_scrub_stamp":"2024-05-04T02:48:26.096694+0000","last_deep_scrub":"25'591","last_deep_scrub_stamp":"2024-05-04T02:48:26.096694+0000","last_clean_scrub_stamp":"2024-05-04T02:48:26.096694+0000","objects_scrubbed":3,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:01:43.904683+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":585,"num_write_kb":4378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3751,"num_write_kb":293548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4679,"ondisk_log_size":4679,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":37541733,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":841,"num_read_kb":897,"num_write":10490,"num_write_kb":42216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":48889856,"data_stored":75083466,"data_compressed":7496204,"data_compressed_allocated":11345920,"data_compressed_original":37601280,"omap_allocated":0,"internal_metadata":0},"log_size":8589,"ondisk_log_size":8589,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":65100,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509794,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64824,"kb_used_data":15600,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94307016,"statfs":{"total":96636764160,"available":96570384384,"internally_reserved":0,"allocated":15974400,"data_stored":25463912,"data_compressed":2642721,"data_compressed_allocated":3952640,"data_compressed_original":13611008,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509794,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60228,"kb_used_data":11004,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94311612,"statfs":{"total":96636764160,"available":96575090688,"internally_reserved":0,"allocated":11268096,"data_stored":16874693,"data_compressed":1601255,"data_compressed_allocated":2412544,"data_compressed_original":8187904,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509794,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35592,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336248,"statfs":{"total":96636764160,"available":96600317952,"internally_reserved":0,"allocated":262144,"data_stored":96895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509794,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58680,"kb_used_data":9456,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94313160,"statfs":{"total":96636764160,"available":96576675840,"internally_reserved":0,"allocated":9682944,"data_stored":12861583,"data_compressed":1022835,"data_compressed_allocated":1699840,"data_compressed_original":5050368,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509794,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35768,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336072,"statfs":{"total":96636764160,"available":96600137728,"internally_reserved":0,"allocated":442368,"data_stored":277999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509794,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29248,"kb_used_data":2232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342592,"statfs":{"total":96636764160,"available":96606814208,"internally_reserved":0,"allocated":2285568,"data_stored":3901602,"data_compressed":519116,"data_compressed_allocated":720896,"data_compressed_original":2506752,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542499,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44836,"kb_used_data":5340,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94327004,"statfs":{"total":96636764160,"available":96590852096,"internally_reserved":0,"allocated":5468160,"data_stored":8485539,"data_compressed":908476,"data_compressed_allocated":1347584,"data_compressed_original":4538368,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575202,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32584,"kb_used_data":5568,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94339256,"statfs":{"total":96636764160,"available":96603398144,"internally_reserved":0,"allocated":5701632,"data_stored":9076419,"data_compressed":866901,"data_compressed_allocated":1302528,"data_compressed_original":4853760,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32550,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32550,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5378048,"data_stored":8389246,"data_compressed":834351,"data_compressed_allocated":1257472,"data_compressed_original":4280320,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2027520,"data_stored":3804797,"data_compressed":519116,"data_compressed_allocated":720896,"data_compressed_original":2506752,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":184320,"data_stored":181194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9424896,"data_stored":12764778,"data_compressed":1022835,"data_compressed_allocated":1699840,"data_compressed_original":5050368,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5210112,"data_stored":8388734,"data_compressed":908476,"data_compressed_allocated":1347584,"data_compressed_original":4538368,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":11010048,"data_stored":16777888,"data_compressed":1601255,"data_compressed_allocated":2412544,"data_compressed_original":8187904,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":15650816,"data_stored":24776739,"data_compressed":2610171,"data_compressed_allocated":3907584,"data_compressed_original":13037568,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-04T02:49:12.852 DEBUG:teuthology.orchestra.run.smithi001:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-05-04T02:49:13.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.000+0000 7f166c39d640 1 Processor -- start 2024-05-04T02:49:13.002 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.000+0000 7f166c39d640 1 -- start start 2024-05-04T02:49:13.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.001+0000 7f166c39d640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f16640cdcf0 0x7f166406d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:49:13.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.001+0000 7f166c39d640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f166415c4a0 0x7f166415c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:49:13.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.001+0000 7f166c39d640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f166415cdf0 0x7f166415fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:49:13.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.001+0000 7f166c39d640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f16640cd3b0 con 0x7f166415c4a0 2024-05-04T02:49:13.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.001+0000 7f166c39d640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f16640b74b0 con 0x7f166415cdf0 2024-05-04T02:49:13.003 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.001+0000 7f166c39d640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f166406d1a0 con 0x7f16640cdcf0 2024-05-04T02:49:13.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.002+0000 7f1669938640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f166415c4a0 0x7f166415c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:49:13.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.002+0000 7f166a93a640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f166415cdf0 0x7f166415fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:49:13.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.002+0000 7f166a139640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f16640cdcf0 0x7f166406d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:49:13.004 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.002+0000 7f1669938640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f166415c4a0 0x7f166415c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37710/0 (socket says 172.21.15.1:37710) 2024-05-04T02:49:13.005 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.002+0000 7f1669938640 1 -- 172.21.15.1:0/3738082191 learned_addr learned my addr 172.21.15.1:0/3738082191 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:49:13.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.005+0000 7f1669938640 1 -- 172.21.15.1:0/3738082191 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f16640cdcf0 msgr2=0x7f166406d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:49:13.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.005+0000 7f1669938640 1 --2- 172.21.15.1:0/3738082191 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f16640cdcf0 0x7f166406d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:13.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.005+0000 7f1669938640 1 -- 172.21.15.1:0/3738082191 >> v2:172.21.15.107:3300/0 conn(0x7f166415cdf0 msgr2=0x7f166415fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:49:13.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.005+0000 7f1669938640 1 --2- 172.21.15.1:0/3738082191 >> v2:172.21.15.107:3300/0 conn(0x7f166415cdf0 0x7f166415fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:13.007 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.005+0000 7f1669938640 1 -- 172.21.15.1:0/3738082191 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f166406d480 con 0x7f166415c4a0 2024-05-04T02:49:13.009 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.007+0000 7f1669938640 1 --2- 172.21.15.1:0/3738082191 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f166415c4a0 0x7f166415c8b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f166408fa30 tx=0x7f165402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ff4bb84f8b3a5e0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:49:13.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.011+0000 7f1669137640 1 -- 172.21.15.1:0/3738082191 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1654037070 con 0x7f166415c4a0 2024-05-04T02:49:13.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.011+0000 7f1669137640 1 -- 172.21.15.1:0/3738082191 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1654032440 con 0x7f166415c4a0 2024-05-04T02:49:13.013 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.011+0000 7f1669137640 1 -- 172.21.15.1:0/3738082191 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1654032810 con 0x7f166415c4a0 2024-05-04T02:49:13.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.012+0000 7f166c39d640 1 -- 172.21.15.1:0/3738082191 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f166415c4a0 msgr2=0x7f166415c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:49:13.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.012+0000 7f166c39d640 1 --2- 172.21.15.1:0/3738082191 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f166415c4a0 0x7f166415c8b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f166408fa30 tx=0x7f165402a270 comp rx=0 tx=0).stop 2024-05-04T02:49:13.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.012+0000 7f166c39d640 1 -- 172.21.15.1:0/3738082191 shutdown_connections 2024-05-04T02:49:13.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.012+0000 7f166c39d640 1 --2- 172.21.15.1:0/3738082191 >> v2:172.21.15.107:3300/0 conn(0x7f166415cdf0 0x7f166415fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:13.014 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.012+0000 7f166c39d640 1 --2- 172.21.15.1:0/3738082191 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f166415c4a0 0x7f166415c8b0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:13.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.012+0000 7f166c39d640 1 --2- 172.21.15.1:0/3738082191 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f16640cdcf0 0x7f166406d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:13.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.012+0000 7f166c39d640 1 -- 172.21.15.1:0/3738082191 >> 172.21.15.1:0/3738082191 conn(0x7f16640ce960 msgr2=0x7f166408cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:49:13.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.012+0000 7f166c39d640 1 -- 172.21.15.1:0/3738082191 shutdown_connections 2024-05-04T02:49:13.015 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.012+0000 7f166c39d640 1 -- 172.21.15.1:0/3738082191 wait complete. 2024-05-04T02:49:13.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.014+0000 7f166c39d640 1 Processor -- start 2024-05-04T02:49:13.016 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.014+0000 7f166c39d640 1 -- start start 2024-05-04T02:49:13.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.015+0000 7f166c39d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16640cdcf0 0x7f16641574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:49:13.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.015+0000 7f166c39d640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f166415c4a0 0x7f16641513a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:49:13.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.015+0000 7f166c39d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f166415cdf0 0x7f1664158620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:49:13.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.015+0000 7f166c39d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f16640b7790 con 0x7f16640cdcf0 2024-05-04T02:49:13.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.015+0000 7f166c39d640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f166415d200 con 0x7f166415cdf0 2024-05-04T02:49:13.017 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.015+0000 7f166c39d640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f16640cd7c0 con 0x7f166415c4a0 2024-05-04T02:49:13.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.016+0000 7f166a139640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16640cdcf0 0x7f16641574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:49:13.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.016+0000 7f166a139640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16640cdcf0 0x7f16641574e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37718/0 (socket says 172.21.15.1:37718) 2024-05-04T02:49:13.018 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.016+0000 7f166a139640 1 -- 172.21.15.1:0/499044235 learned_addr learned my addr 172.21.15.1:0/499044235 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:49:13.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.016+0000 7f1669938640 1 --2- 172.21.15.1:0/499044235 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f166415c4a0 0x7f16641513a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:49:13.019 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.016+0000 7f166a93a640 1 --2- 172.21.15.1:0/499044235 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f166415cdf0 0x7f1664158620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:49:13.022 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.020+0000 7f166a139640 1 -- 172.21.15.1:0/499044235 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f166415c4a0 msgr2=0x7f16641513a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:49:13.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.020+0000 7f166a139640 1 --2- 172.21.15.1:0/499044235 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f166415c4a0 0x7f16641513a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:13.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.020+0000 7f166a139640 1 -- 172.21.15.1:0/499044235 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f166415cdf0 msgr2=0x7f1664158620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:49:13.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.020+0000 7f166a139640 1 --2- 172.21.15.1:0/499044235 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f166415cdf0 0x7f1664158620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:13.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.020+0000 7f166a139640 1 -- 172.21.15.1:0/499044235 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1664153490 con 0x7f16640cdcf0 2024-05-04T02:49:13.023 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.020+0000 7f1669938640 1 --2- 172.21.15.1:0/499044235 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f166415c4a0 0x7f16641513a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-04T02:49:13.025 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.023+0000 7f166a139640 1 --2- 172.21.15.1:0/499044235 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16640cdcf0 0x7f16641574e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f166000e8d0 tx=0x7f166000ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:49:13.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.027+0000 7f165affd640 1 -- 172.21.15.1:0/499044235 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1660017070 con 0x7f16640cdcf0 2024-05-04T02:49:13.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.027+0000 7f165affd640 1 -- 172.21.15.1:0/499044235 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f166000c940 con 0x7f16640cdcf0 2024-05-04T02:49:13.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.027+0000 7f165affd640 1 -- 172.21.15.1:0/499044235 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f166000cd30 con 0x7f16640cdcf0 2024-05-04T02:49:13.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.027+0000 7f166c39d640 1 -- 172.21.15.1:0/499044235 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16641518e0 con 0x7f16640cdcf0 2024-05-04T02:49:13.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.028+0000 7f166c39d640 1 -- 172.21.15.1:0/499044235 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1664156ce0 con 0x7f16640cdcf0 2024-05-04T02:49:13.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.028+0000 7f166c39d640 1 -- 172.21.15.1:0/499044235 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1664069c60 con 0x7f16640cdcf0 2024-05-04T02:49:13.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.053+0000 7f165affd640 1 -- 172.21.15.1:0/499044235 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f166001a070 con 0x7f16640cdcf0 2024-05-04T02:49:13.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.053+0000 7f165affd640 1 --2- 172.21.15.1:0/499044235 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f1648076350 0x7f1648078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:49:13.055 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.054+0000 7f1669938640 1 --2- 172.21.15.1:0/499044235 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f1648076350 0x7f1648078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:49:13.056 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.054+0000 7f1669938640 1 --2- 172.21.15.1:0/499044235 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f1648076350 0x7f1648078860 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1654034000 tx=0x7f165402e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:49:13.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.364+0000 7f165affd640 1 -- 172.21.15.1:0/499044235 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5854+0+0 (secure 0 0 0) 0x7f166005d090 con 0x7f16640cdcf0 2024-05-04T02:49:13.366 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.364+0000 7f165affd640 1 -- 172.21.15.1:0/499044235 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1660060e00 con 0x7f16640cdcf0 2024-05-04T02:49:13.561 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.559+0000 7f166c39d640 1 -- 172.21.15.1:0/499044235 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f16641525d0 con 0x7f16640cdcf0 2024-05-04T02:49:13.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.686+0000 7f165affd640 1 -- 172.21.15.1:0/499044235 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) ==== 123+0+0 (secure 0 0 0) 0x7f1660065100 con 0x7f16640cdcf0 2024-05-04T02:49:13.688 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.686+0000 7f165affd640 1 -- 172.21.15.1:0/499044235 <== mon.0 v2:172.21.15.1:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f1660060910 con 0x7f16640cdcf0 2024-05-04T02:49:13.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.688+0000 7f166c39d640 1 -- 172.21.15.1:0/499044235 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f1648076350 msgr2=0x7f1648078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:49:13.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.688+0000 7f166c39d640 1 --2- 172.21.15.1:0/499044235 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f1648076350 0x7f1648078860 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1654034000 tx=0x7f165402e000 comp rx=0 tx=0).stop 2024-05-04T02:49:13.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.689+0000 7f166c39d640 1 -- 172.21.15.1:0/499044235 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16640cdcf0 msgr2=0x7f16641574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:49:13.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.689+0000 7f166c39d640 1 --2- 172.21.15.1:0/499044235 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16640cdcf0 0x7f16641574e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f166000e8d0 tx=0x7f166000ed90 comp rx=0 tx=0).stop 2024-05-04T02:49:13.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.689+0000 7f166c39d640 1 -- 172.21.15.1:0/499044235 shutdown_connections 2024-05-04T02:49:13.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.689+0000 7f166c39d640 1 --2- 172.21.15.1:0/499044235 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f1648076350 0x7f1648078860 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:13.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.689+0000 7f166c39d640 1 --2- 172.21.15.1:0/499044235 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f166415cdf0 0x7f1664158620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:13.691 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.689+0000 7f166c39d640 1 --2- 172.21.15.1:0/499044235 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f166415c4a0 0x7f16641513a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:13.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.689+0000 7f166c39d640 1 --2- 172.21.15.1:0/499044235 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f16640cdcf0 0x7f16641574e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:13.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.689+0000 7f166c39d640 1 -- 172.21.15.1:0/499044235 >> 172.21.15.1:0/499044235 conn(0x7f16640ce960 msgr2=0x7f16640c7720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:49:13.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.689+0000 7f166c39d640 1 -- 172.21.15.1:0/499044235 shutdown_connections 2024-05-04T02:49:13.692 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.689+0000 7f166c39d640 1 -- 172.21.15.1:0/499044235 wait complete. 2024-05-04T02:49:13.702 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-04T02:49:13.702 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-04T02:49:13.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.819+0000 7fe314586640 1 Processor -- start 2024-05-04T02:49:13.821 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.819+0000 7fe314586640 1 -- start start 2024-05-04T02:49:13.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.821+0000 7fe314586640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe30c0cab70 0x7fe30c1422c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:49:13.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.821+0000 7fe314586640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fe30c0ce590 0x7fe30c0ce9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:49:13.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.821+0000 7fe314586640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe30c0c3830 con 0x7fe30c15c9e0 2024-05-04T02:49:13.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.821+0000 7fe314586640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fe30c0c3b10 con 0x7fe30c0ce590 2024-05-04T02:49:13.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.821+0000 7fe314586640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe30c0c3df0 con 0x7fe30c0cab70 2024-05-04T02:49:13.823 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.822+0000 7fe312b23640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7fe30c15c9e0 0x7fe30c15cdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:46978/0 (socket says 172.21.15.1:46978) 2024-05-04T02:49:13.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.822+0000 7fe312b23640 1 -- 172.21.15.1:0/392977201 learned_addr learned my addr 172.21.15.1:0/392977201 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-05-04T02:49:13.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.822+0000 7fe312322640 1 --2- 172.21.15.1:0/392977201 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe30c0cab70 0x7fe30c1422c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:49:13.824 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.822+0000 7fe311b21640 1 --2- 172.21.15.1:0/392977201 >> v2:172.21.15.107:3300/0 conn(0x7fe30c0ce590 0x7fe30c0ce9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:49:13.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.824+0000 7fe311320640 1 -- 172.21.15.1:0/392977201 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2685076851 0 0) 0x7fe30c0c3830 con 0x7fe30c15c9e0 2024-05-04T02:49:13.826 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.824+0000 7fe311320640 1 -- 172.21.15.1:0/392977201 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe2f8003520 con 0x7fe30c15c9e0 2024-05-04T02:49:13.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.825+0000 7fe312322640 1 -- 172.21.15.1:0/392977201 >> v2:172.21.15.107:3300/0 conn(0x7fe30c0ce590 msgr2=0x7fe30c0ce9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:49:13.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.825+0000 7fe312322640 1 --2- 172.21.15.1:0/392977201 >> v2:172.21.15.107:3300/0 conn(0x7fe30c0ce590 0x7fe30c0ce9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:13.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.825+0000 7fe312322640 1 -- 172.21.15.1:0/392977201 >> v1:172.21.15.1:6789/0 conn(0x7fe30c15c9e0 legacy=0x7fe30c15cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:49:13.827 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.825+0000 7fe312322640 1 -- 172.21.15.1:0/392977201 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe30c0c40d0 con 0x7fe30c0cab70 2024-05-04T02:49:13.829 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.827+0000 7fe312322640 1 --2- 172.21.15.1:0/392977201 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe30c0cab70 0x7fe30c1422c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe3080097a0 tx=0x7fe30802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9c08772b6fad290 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:49:13.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.831+0000 7fe311320640 1 -- 172.21.15.1:0/392977201 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe308037070 con 0x7fe30c0cab70 2024-05-04T02:49:13.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.831+0000 7fe311320640 1 -- 172.21.15.1:0/392977201 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fe30802ae50 con 0x7fe30c0cab70 2024-05-04T02:49:13.833 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.831+0000 7fe311320640 1 -- 172.21.15.1:0/392977201 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe308032680 con 0x7fe30c0cab70 2024-05-04T02:49:13.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.832+0000 7fe314586640 1 -- 172.21.15.1:0/392977201 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe30c0cab70 msgr2=0x7fe30c1422c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:49:13.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.832+0000 7fe314586640 1 --2- 172.21.15.1:0/392977201 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe30c0cab70 0x7fe30c1422c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe3080097a0 tx=0x7fe30802a100 comp rx=0 tx=0).stop 2024-05-04T02:49:13.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.832+0000 7fe314586640 1 -- 172.21.15.1:0/392977201 shutdown_connections 2024-05-04T02:49:13.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.832+0000 7fe314586640 1 --2- 172.21.15.1:0/392977201 >> v2:172.21.15.107:3300/0 conn(0x7fe30c0ce590 0x7fe30c0ce9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:13.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.832+0000 7fe314586640 1 --2- 172.21.15.1:0/392977201 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe30c0cab70 0x7fe30c1422c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:13.834 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.832+0000 7fe314586640 1 -- 172.21.15.1:0/392977201 >> 172.21.15.1:0/392977201 conn(0x7fe30c0725c0 msgr2=0x7fe30c0729d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:49:13.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.832+0000 7fe314586640 1 -- 172.21.15.1:0/392977201 shutdown_connections 2024-05-04T02:49:13.835 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.832+0000 7fe314586640 1 -- 172.21.15.1:0/392977201 wait complete. 2024-05-04T02:49:13.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.834+0000 7fe314586640 1 Processor -- start 2024-05-04T02:49:13.836 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.834+0000 7fe314586640 1 -- start start 2024-05-04T02:49:13.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.835+0000 7fe314586640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe30c0cab70 0x7fe30c1f5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:49:13.837 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.835+0000 7fe314586640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe30c0ce590 0x7fe30c0c5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:49:13.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.835+0000 7fe314586640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe30c15c9e0 0x7fe30c0c6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:49:13.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.835+0000 7fe314586640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe30c06f3c0 con 0x7fe30c0ce590 2024-05-04T02:49:13.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.835+0000 7fe314586640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe30c06f240 con 0x7fe30c0cab70 2024-05-04T02:49:13.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.835+0000 7fe314586640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe30c06f540 con 0x7fe30c15c9e0 2024-05-04T02:49:13.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.836+0000 7fe311b21640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe30c0ce590 0x7fe30c0c5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:49:13.838 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.836+0000 7fe312b23640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe30c15c9e0 0x7fe30c0c6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:49:13.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.836+0000 7fe311b21640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe30c0ce590 0x7fe30c0c5be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37720/0 (socket says 172.21.15.1:37720) 2024-05-04T02:49:13.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.836+0000 7fe311b21640 1 -- 172.21.15.1:0/1667433942 learned_addr learned my addr 172.21.15.1:0/1667433942 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:49:13.839 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.836+0000 7fe312322640 1 --2- 172.21.15.1:0/1667433942 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe30c0cab70 0x7fe30c1f5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:49:13.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.840+0000 7fe311b21640 1 -- 172.21.15.1:0/1667433942 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe30c15c9e0 msgr2=0x7fe30c0c6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:49:13.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.840+0000 7fe311b21640 1 --2- 172.21.15.1:0/1667433942 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe30c15c9e0 0x7fe30c0c6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:13.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.840+0000 7fe311b21640 1 -- 172.21.15.1:0/1667433942 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe30c0cab70 msgr2=0x7fe30c1f5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:49:13.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.840+0000 7fe311b21640 1 --2- 172.21.15.1:0/1667433942 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe30c0cab70 0x7fe30c1f5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:13.842 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.840+0000 7fe311b21640 1 -- 172.21.15.1:0/1667433942 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe30c1f6420 con 0x7fe30c0ce590 2024-05-04T02:49:13.845 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.843+0000 7fe311b21640 1 --2- 172.21.15.1:0/1667433942 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe30c0ce590 0x7fe30c0c5be0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc00e840 tx=0x7fe2fc00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:49:13.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.853+0000 7fe302ffd640 1 -- 172.21.15.1:0/1667433942 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc017070 con 0x7fe30c0ce590 2024-05-04T02:49:13.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.853+0000 7fe302ffd640 1 -- 172.21.15.1:0/1667433942 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fe2fc00c6d0 con 0x7fe30c0ce590 2024-05-04T02:49:13.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.853+0000 7fe302ffd640 1 -- 172.21.15.1:0/1667433942 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc00cae0 con 0x7fe30c0ce590 2024-05-04T02:49:13.855 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.853+0000 7fe314586640 1 -- 172.21.15.1:0/1667433942 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe30c1e60c0 con 0x7fe30c0ce590 2024-05-04T02:49:13.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.853+0000 7fe314586640 1 -- 172.21.15.1:0/1667433942 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe30c1e6680 con 0x7fe30c0ce590 2024-05-04T02:49:13.856 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:13.854+0000 7fe314586640 1 -- 172.21.15.1:0/1667433942 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe30c06dda0 con 0x7fe30c0ce590 2024-05-04T02:49:14.162 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:14.160+0000 7fe302ffd640 1 -- 172.21.15.1:0/1667433942 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe2fc01a070 con 0x7fe30c0ce590 2024-05-04T02:49:14.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:14.161+0000 7fe302ffd640 1 --2- 172.21.15.1:0/1667433942 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fe2f00762d0 0x7fe2f00787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:49:14.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:14.161+0000 7fe312322640 1 --2- 172.21.15.1:0/1667433942 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fe2f00762d0 0x7fe2f00787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:49:14.163 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:14.162+0000 7fe312322640 1 --2- 172.21.15.1:0/1667433942 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fe2f00762d0 0x7fe2f00787e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe308034000 tx=0x7fe30802e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:49:14.178 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:14.176+0000 7fe302ffd640 1 -- 172.21.15.1:0/1667433942 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5854+0+0 (secure 0 0 0) 0x7fe2fc05d110 con 0x7fe30c0ce590 2024-05-04T02:49:14.179 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:14.177+0000 7fe302ffd640 1 -- 172.21.15.1:0/1667433942 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe30c06dda0 con 0x7fe30c0ce590 2024-05-04T02:49:14.413 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:14.409+0000 7fe314586640 1 -- 172.21.15.1:0/1667433942 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe30c1f5840 con 0x7fe30c0ce590 2024-05-04T02:49:14.444 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:14.442+0000 7fe302ffd640 1 -- 172.21.15.1:0/1667433942 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+6818 (secure 0 0 0) 0x7fe2fc060f10 con 0x7fe30c0ce590 2024-05-04T02:49:14.444 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:49:14.445 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4214,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/2012070226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":2012070226},{"type":"v1","addr":"172.21.15.107:6837","nonce":2012070226}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4217,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/779417024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":779417024},{"type":"v1","addr":"172.21.15.107:6836","nonce":779417024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4223,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/4178520860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":4178520860},{"type":"v1","addr":"172.21.15.1:6837","nonce":4178520860}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4273,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6833/410847489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":410847489},{"type":"v1","addr":"172.21.15.1:6833","nonce":410847489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/1145100080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":1145100080},{"type":"v1","addr":"172.21.15.1:6835","nonce":1145100080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-04T02:20:15.309997+0000","modified":"2024-05-04T02:20:21.184612+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.107:6839/1807033208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":1807033208},{"type":"v1","addr":"172.21.15.107:6839","nonce":1807033208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4285,"qdb_cluster":[4285]},"id":1}]} 2024-05-04T02:49:14.445 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 7 2024-05-04T02:49:14.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:14.444+0000 7fe314586640 1 -- 172.21.15.1:0/1667433942 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fe2f00762d0 msgr2=0x7fe2f00787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:49:14.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:14.444+0000 7fe314586640 1 --2- 172.21.15.1:0/1667433942 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fe2f00762d0 0x7fe2f00787e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe308034000 tx=0x7fe30802e000 comp rx=0 tx=0).stop 2024-05-04T02:49:14.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:14.444+0000 7fe314586640 1 -- 172.21.15.1:0/1667433942 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe30c0ce590 msgr2=0x7fe30c0c5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:49:14.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:14.444+0000 7fe314586640 1 --2- 172.21.15.1:0/1667433942 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe30c0ce590 0x7fe30c0c5be0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc00e840 tx=0x7fe2fc00ed00 comp rx=0 tx=0).stop 2024-05-04T02:49:14.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:14.444+0000 7fe314586640 1 -- 172.21.15.1:0/1667433942 shutdown_connections 2024-05-04T02:49:14.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:14.444+0000 7fe314586640 1 --2- 172.21.15.1:0/1667433942 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fe2f00762d0 0x7fe2f00787e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:14.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:14.444+0000 7fe314586640 1 --2- 172.21.15.1:0/1667433942 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe30c15c9e0 0x7fe30c0c6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:14.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:14.444+0000 7fe314586640 1 --2- 172.21.15.1:0/1667433942 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe30c0ce590 0x7fe30c0c5be0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:14.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:14.444+0000 7fe314586640 1 --2- 172.21.15.1:0/1667433942 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe30c0cab70 0x7fe30c1f5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:14.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:14.445+0000 7fe314586640 1 -- 172.21.15.1:0/1667433942 >> 172.21.15.1:0/1667433942 conn(0x7fe30c0725c0 msgr2=0x7fe30c06d690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:49:14.447 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:14.445+0000 7fe314586640 1 -- 172.21.15.1:0/1667433942 shutdown_connections 2024-05-04T02:49:14.448 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:14.445+0000 7fe314586640 1 -- 172.21.15.1:0/1667433942 wait complete. 2024-05-04T02:49:14.459 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-04T02:49:14.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:14.569+0000 7f814bfee640 1 Processor -- start 2024-05-04T02:49:14.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:14.569+0000 7f814bfee640 1 -- start start 2024-05-04T02:49:14.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:14.570+0000 7f814bfee640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f81440cdc20 0x7f814406c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:49:14.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:14.570+0000 7f814bfee640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81440c69e0 con 0x7f8144164df0 2024-05-04T02:49:14.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:14.570+0000 7f814bfee640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8144160740 con 0x7f81440c6f70 2024-05-04T02:49:14.572 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:14.570+0000 7f814bfee640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f8144160a20 con 0x7f81440cdc20 2024-05-04T02:49:14.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:14.571+0000 7f8149d8a640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f81440cdc20 0x7f814406c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:49:14.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:14.571+0000 7f8149589640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f81440c6f70 0x7f81440ccea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.1:57714/0 (socket says 172.21.15.1:57714) 2024-05-04T02:49:14.573 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:14.571+0000 7f8149589640 1 -- 172.21.15.1:0/2465496511 learned_addr learned my addr 172.21.15.1:0/2465496511 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-05-04T02:49:14.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:14.574+0000 7f8148d88640 1 -- 172.21.15.1:0/2465496511 <== mon.1 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 548340279 0 0) 0x7f8144160740 con 0x7f81440c6f70 2024-05-04T02:49:14.576 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:14.574+0000 7f8148d88640 1 -- 172.21.15.1:0/2465496511 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8130003520 con 0x7f81440c6f70 2024-05-04T02:49:14.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:14.576+0000 7f8149d8a640 1 -- 172.21.15.1:0/2465496511 >> v1:172.21.15.107:6789/0 conn(0x7f81440c6f70 legacy=0x7f81440ccea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:49:14.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:14.576+0000 7f8149d8a640 1 -- 172.21.15.1:0/2465496511 >> v1:172.21.15.1:6789/0 conn(0x7f8144164df0 legacy=0x7f8144167210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:49:14.578 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:14.576+0000 7f8149d8a640 1 -- 172.21.15.1:0/2465496511 --> v2:172.21.15.1:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81440c77f0 con 0x7f81440cdc20 2024-05-04T02:49:14.582 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:14.580+0000 7f8149d8a640 1 --2- 172.21.15.1:0/2465496511 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81440cdc20 0x7f814406c6f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f81400097a0 tx=0x7f814002a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78be7ba160552548 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:49:14.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:14.584+0000 7f8148d88640 1 -- 172.21.15.1:0/2465496511 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8140037070 con 0x7f81440cdc20 2024-05-04T02:49:14.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:14.584+0000 7f8148d88640 1 -- 172.21.15.1:0/2465496511 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f8140032640 con 0x7f81440cdc20 2024-05-04T02:49:14.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:14.584+0000 7f8148d88640 1 -- 172.21.15.1:0/2465496511 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8140032a30 con 0x7f81440cdc20 2024-05-04T02:49:14.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:14.585+0000 7f814bfee640 1 -- 172.21.15.1:0/2465496511 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81440cdc20 msgr2=0x7f814406c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:49:14.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:14.585+0000 7f814bfee640 1 --2- 172.21.15.1:0/2465496511 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81440cdc20 0x7f814406c6f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f81400097a0 tx=0x7f814002a2c0 comp rx=0 tx=0).stop 2024-05-04T02:49:14.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:14.585+0000 7f814bfee640 1 -- 172.21.15.1:0/2465496511 shutdown_connections 2024-05-04T02:49:14.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:14.585+0000 7f814bfee640 1 --2- 172.21.15.1:0/2465496511 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81440cdc20 0x7f814406c6f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:14.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:14.585+0000 7f814bfee640 1 -- 172.21.15.1:0/2465496511 >> 172.21.15.1:0/2465496511 conn(0x7f814408e210 msgr2=0x7f81440d1960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:49:14.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:14.585+0000 7f814bfee640 1 -- 172.21.15.1:0/2465496511 shutdown_connections 2024-05-04T02:49:14.587 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:14.585+0000 7f814bfee640 1 -- 172.21.15.1:0/2465496511 wait complete. 2024-05-04T02:49:14.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:14.587+0000 7f814bfee640 1 Processor -- start 2024-05-04T02:49:14.589 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:14.587+0000 7f814bfee640 1 -- start start 2024-05-04T02:49:14.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:14.588+0000 7f814bfee640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81440c6f70 0x7f81441f2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:49:14.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:14.588+0000 7f814bfee640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81440cdc20 0x7f814414f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:49:14.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:14.588+0000 7f814bfee640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8144164df0 0x7f81441618f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:49:14.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:14.588+0000 7f814bfee640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f81440c8090 con 0x7f81440cdc20 2024-05-04T02:49:14.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:14.588+0000 7f814bfee640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f81440c7db0 con 0x7f8144164df0 2024-05-04T02:49:14.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:14.588+0000 7f814bfee640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f8144160450 con 0x7f81440c6f70 2024-05-04T02:49:14.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:14.589+0000 7f8149589640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81440cdc20 0x7f814414f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:49:14.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:14.589+0000 7f814a58b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8144164df0 0x7f81441618f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:49:14.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:14.589+0000 7f8149589640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81440cdc20 0x7f814414f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37744/0 (socket says 172.21.15.1:37744) 2024-05-04T02:49:14.591 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:14.589+0000 7f8149d8a640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81440c6f70 0x7f81441f2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:49:14.592 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:14.589+0000 7f8149589640 1 -- 172.21.15.1:0/2197527162 learned_addr learned my addr 172.21.15.1:0/2197527162 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:49:14.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:14.593+0000 7f8149589640 1 -- 172.21.15.1:0/2197527162 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81440c6f70 msgr2=0x7f81441f2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:49:14.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:14.593+0000 7f8149589640 1 --2- 172.21.15.1:0/2197527162 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81440c6f70 0x7f81441f2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:14.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:14.593+0000 7f8149589640 1 -- 172.21.15.1:0/2197527162 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8144164df0 msgr2=0x7f81441618f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:49:14.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:14.593+0000 7f8149589640 1 --2- 172.21.15.1:0/2197527162 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8144164df0 0x7f81441618f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:14.595 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:14.593+0000 7f8149589640 1 -- 172.21.15.1:0/2197527162 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81440b59e0 con 0x7f81440cdc20 2024-05-04T02:49:14.597 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:14.596+0000 7f8149589640 1 --2- 172.21.15.1:0/2197527162 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81440cdc20 0x7f814414f670 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f813400c400 tx=0x7f813400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:49:14.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:14.600+0000 7f813a7fc640 1 -- 172.21.15.1:0/2197527162 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8134017070 con 0x7f81440cdc20 2024-05-04T02:49:14.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:14.600+0000 7f813a7fc640 1 -- 172.21.15.1:0/2197527162 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f8134005d00 con 0x7f81440cdc20 2024-05-04T02:49:14.602 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:14.600+0000 7f813a7fc640 1 -- 172.21.15.1:0/2197527162 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8134007330 con 0x7f81440cdc20 2024-05-04T02:49:14.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:14.600+0000 7f814bfee640 1 -- 172.21.15.1:0/2197527162 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81441f34c0 con 0x7f81440cdc20 2024-05-04T02:49:14.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:14.600+0000 7f814bfee640 1 -- 172.21.15.1:0/2197527162 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8144152c60 con 0x7f81440cdc20 2024-05-04T02:49:14.603 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:14.601+0000 7f814bfee640 1 -- 172.21.15.1:0/2197527162 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8144069bc0 con 0x7f81440cdc20 2024-05-04T02:49:14.901 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:14.899+0000 7f813a7fc640 1 -- 172.21.15.1:0/2197527162 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f813401a070 con 0x7f81440cdc20 2024-05-04T02:49:14.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:14.900+0000 7f813a7fc640 1 --2- 172.21.15.1:0/2197527162 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f8128076320 0x7f8128078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:49:14.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:14.900+0000 7f8149d8a640 1 --2- 172.21.15.1:0/2197527162 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f8128076320 0x7f8128078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:49:14.902 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:14.901+0000 7f8149d8a640 1 --2- 172.21.15.1:0/2197527162 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f8128076320 0x7f8128078830 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8140034000 tx=0x7f814002e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:49:14.917 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:14.915+0000 7f813a7fc640 1 -- 172.21.15.1:0/2197527162 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5854+0+0 (secure 0 0 0) 0x7f813405c350 con 0x7f81440cdc20 2024-05-04T02:49:14.918 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:14.915+0000 7f813a7fc640 1 -- 172.21.15.1:0/2197527162 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8134021020 con 0x7f81440cdc20 2024-05-04T02:49:15.148 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.146+0000 7f814bfee640 1 -- 172.21.15.1:0/2197527162 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f81440cd780 con 0x7f81440cdc20 2024-05-04T02:49:15.182 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.180+0000 7f813a7fc640 1 -- 172.21.15.1:0/2197527162 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+6818 (secure 0 0 0) 0x7f81340600c0 con 0x7f81440cdc20 2024-05-04T02:49:15.182 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:49:15.182 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4214,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/2012070226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":2012070226},{"type":"v1","addr":"172.21.15.107:6837","nonce":2012070226}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4217,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/779417024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":779417024},{"type":"v1","addr":"172.21.15.107:6836","nonce":779417024}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4223,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6837/4178520860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6836","nonce":4178520860},{"type":"v1","addr":"172.21.15.1:6837","nonce":4178520860}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4273,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6833/410847489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6832","nonce":410847489},{"type":"v1","addr":"172.21.15.1:6833","nonce":410847489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.1:6835/1145100080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6834","nonce":1145100080},{"type":"v1","addr":"172.21.15.1:6835","nonce":1145100080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-04T02:20:15.309997+0000","modified":"2024-05-04T02:20:21.184612+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.107:6839/1807033208","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6838","nonce":1807033208},{"type":"v1","addr":"172.21.15.107:6839","nonce":1807033208}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4285,"qdb_cluster":[4285]},"id":1}]} 2024-05-04T02:49:15.183 INFO:teuthology.orchestra.run.smithi001.stderr:dumped fsmap epoch 7 2024-05-04T02:49:15.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.182+0000 7f814bfee640 1 -- 172.21.15.1:0/2197527162 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f8128076320 msgr2=0x7f8128078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:49:15.184 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.182+0000 7f814bfee640 1 --2- 172.21.15.1:0/2197527162 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f8128076320 0x7f8128078830 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8140034000 tx=0x7f814002e000 comp rx=0 tx=0).stop 2024-05-04T02:49:15.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.182+0000 7f814bfee640 1 -- 172.21.15.1:0/2197527162 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81440cdc20 msgr2=0x7f814414f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:49:15.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.182+0000 7f814bfee640 1 --2- 172.21.15.1:0/2197527162 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81440cdc20 0x7f814414f670 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f813400c400 tx=0x7f813400c8c0 comp rx=0 tx=0).stop 2024-05-04T02:49:15.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.182+0000 7f814bfee640 1 -- 172.21.15.1:0/2197527162 shutdown_connections 2024-05-04T02:49:15.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.182+0000 7f814bfee640 1 --2- 172.21.15.1:0/2197527162 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f8128076320 0x7f8128078830 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:15.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.182+0000 7f814bfee640 1 --2- 172.21.15.1:0/2197527162 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f8144164df0 0x7f81441618f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:15.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.182+0000 7f814bfee640 1 --2- 172.21.15.1:0/2197527162 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f81440cdc20 0x7f814414f670 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:15.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.182+0000 7f814bfee640 1 --2- 172.21.15.1:0/2197527162 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f81440c6f70 0x7f81441f2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:15.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.182+0000 7f814bfee640 1 -- 172.21.15.1:0/2197527162 >> 172.21.15.1:0/2197527162 conn(0x7f814408e210 msgr2=0x7f814415d870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:49:15.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.182+0000 7f814bfee640 1 -- 172.21.15.1:0/2197527162 shutdown_connections 2024-05-04T02:49:15.185 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.182+0000 7f814bfee640 1 -- 172.21.15.1:0/2197527162 wait complete. 2024-05-04T02:49:15.197 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-04T02:49:15.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.307+0000 7f6970b0d640 1 Processor -- start 2024-05-04T02:49:15.309 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.307+0000 7f6970b0d640 1 -- start start 2024-05-04T02:49:15.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.308+0000 7f6970b0d640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f696c0c6f70 0x7f696c0ccea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:49:15.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.308+0000 7f6970b0d640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f696c0cd3e0 0x7f696c166e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:49:15.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.308+0000 7f6970b0d640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f696c0c69e0 con 0x7f696c0cdc20 2024-05-04T02:49:15.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.308+0000 7f6970b0d640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7f696c160a20 con 0x7f696c0cd3e0 2024-05-04T02:49:15.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.308+0000 7f6970b0d640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f696c160740 con 0x7f696c0c6f70 2024-05-04T02:49:15.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.309+0000 7f6963fff640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f696c0c6f70 0x7f696c0ccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:49:15.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.309+0000 7f696ad9d640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7f696c0cd3e0 0x7f696c166e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:49:15.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.309+0000 7f6963fff640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f696c0c6f70 0x7f696c0ccea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.1:36876/0 (socket says 172.21.15.1:36876) 2024-05-04T02:49:15.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.309+0000 7f696a59c640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f696c0cdc20 0x7f696c06c6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:47010/0 (socket says 172.21.15.1:47010) 2024-05-04T02:49:15.311 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.309+0000 7f6963fff640 1 -- 172.21.15.1:0/334226229 learned_addr learned my addr 172.21.15.1:0/334226229 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:49:15.313 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.312+0000 7f6963fff640 1 -- 172.21.15.1:0/334226229 >> v2:172.21.15.1:3300/0 conn(0x7f696c0cd3e0 msgr2=0x7f696c166e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:49:15.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.312+0000 7f6963fff640 1 --2- 172.21.15.1:0/334226229 >> v2:172.21.15.1:3300/0 conn(0x7f696c0cd3e0 0x7f696c166e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:15.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.312+0000 7f6963fff640 1 -- 172.21.15.1:0/334226229 >> v1:172.21.15.1:6789/0 conn(0x7f696c0cdc20 legacy=0x7f696c06c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:49:15.314 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.312+0000 7f6963fff640 1 -- 172.21.15.1:0/334226229 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f696c0c77f0 con 0x7f696c0c6f70 2024-05-04T02:49:15.316 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.314+0000 7f6963fff640 1 --2- 172.21.15.1:0/334226229 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f696c0c6f70 0x7f696c0ccea0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6954009870 tx=0x7f695402a300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c66dd2e18ec82cb server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:49:15.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.318+0000 7f6969d9b640 1 -- 172.21.15.1:0/334226229 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6954037070 con 0x7f696c0c6f70 2024-05-04T02:49:15.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.318+0000 7f6969d9b640 1 -- 172.21.15.1:0/334226229 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f695402ae50 con 0x7f696c0c6f70 2024-05-04T02:49:15.320 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.318+0000 7f6969d9b640 1 -- 172.21.15.1:0/334226229 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6954032880 con 0x7f696c0c6f70 2024-05-04T02:49:15.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.319+0000 7f6970b0d640 1 -- 172.21.15.1:0/334226229 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f696c0c6f70 msgr2=0x7f696c0ccea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:49:15.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.319+0000 7f6970b0d640 1 --2- 172.21.15.1:0/334226229 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f696c0c6f70 0x7f696c0ccea0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6954009870 tx=0x7f695402a300 comp rx=0 tx=0).stop 2024-05-04T02:49:15.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.319+0000 7f6970b0d640 1 -- 172.21.15.1:0/334226229 shutdown_connections 2024-05-04T02:49:15.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.319+0000 7f6970b0d640 1 --2- 172.21.15.1:0/334226229 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f696c0c6f70 0x7f696c0ccea0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:15.321 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.319+0000 7f6970b0d640 1 --2- 172.21.15.1:0/334226229 >> v2:172.21.15.1:3300/0 conn(0x7f696c0cd3e0 0x7f696c166e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:15.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.319+0000 7f6970b0d640 1 -- 172.21.15.1:0/334226229 >> 172.21.15.1:0/334226229 conn(0x7f696c08e210 msgr2=0x7f696c0d1960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:49:15.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.319+0000 7f6970b0d640 1 -- 172.21.15.1:0/334226229 shutdown_connections 2024-05-04T02:49:15.322 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.319+0000 7f6970b0d640 1 -- 172.21.15.1:0/334226229 wait complete. 2024-05-04T02:49:15.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.321+0000 7f6970b0d640 1 Processor -- start 2024-05-04T02:49:15.323 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.321+0000 7f6970b0d640 1 -- start start 2024-05-04T02:49:15.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.322+0000 7f6970b0d640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f696c0c6f70 0x7f696c1f2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:49:15.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.322+0000 7f6970b0d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f696c0cd3e0 0x7f696c1e93c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:49:15.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.322+0000 7f6970b0d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f696c0cdc20 0x7f696c14a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:49:15.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.322+0000 7f6970b0d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f696c0c8090 con 0x7f696c0cdc20 2024-05-04T02:49:15.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.322+0000 7f6970b0d640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f696c0c7db0 con 0x7f696c0cd3e0 2024-05-04T02:49:15.324 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.322+0000 7f6970b0d640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f696c160450 con 0x7f696c0c6f70 2024-05-04T02:49:15.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.323+0000 7f696ad9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f696c0cdc20 0x7f696c14a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:49:15.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.323+0000 7f696a59c640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f696c0c6f70 0x7f696c1f2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:49:15.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.323+0000 7f6963fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f696c0cd3e0 0x7f696c1e93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:49:15.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.323+0000 7f696ad9d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f696c0cdc20 0x7f696c14a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37768/0 (socket says 172.21.15.1:37768) 2024-05-04T02:49:15.325 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.323+0000 7f696ad9d640 1 -- 172.21.15.1:0/2015124172 learned_addr learned my addr 172.21.15.1:0/2015124172 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:49:15.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.327+0000 7f696ad9d640 1 -- 172.21.15.1:0/2015124172 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f696c0c6f70 msgr2=0x7f696c1f2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:49:15.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.327+0000 7f696ad9d640 1 --2- 172.21.15.1:0/2015124172 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f696c0c6f70 0x7f696c1f2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:15.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.327+0000 7f696ad9d640 1 -- 172.21.15.1:0/2015124172 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f696c0cd3e0 msgr2=0x7f696c1e93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:49:15.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.327+0000 7f696ad9d640 1 --2- 172.21.15.1:0/2015124172 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f696c0cd3e0 0x7f696c1e93c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:15.329 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.327+0000 7f696ad9d640 1 -- 172.21.15.1:0/2015124172 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f696c1f2e40 con 0x7f696c0cdc20 2024-05-04T02:49:15.331 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.330+0000 7f696ad9d640 1 --2- 172.21.15.1:0/2015124172 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f696c0cdc20 0x7f696c14a490 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f696400efc0 tx=0x7f696400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:49:15.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.334+0000 7f6962ffd640 1 -- 172.21.15.1:0/2015124172 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6964018020 con 0x7f696c0cdc20 2024-05-04T02:49:15.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.334+0000 7f6962ffd640 1 -- 172.21.15.1:0/2015124172 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f6964014480 con 0x7f696c0cdc20 2024-05-04T02:49:15.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.334+0000 7f6962ffd640 1 -- 172.21.15.1:0/2015124172 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6964009e60 con 0x7f696c0cdc20 2024-05-04T02:49:15.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.334+0000 7f6970b0d640 1 -- 172.21.15.1:0/2015124172 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f696c152110 con 0x7f696c0cdc20 2024-05-04T02:49:15.336 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.334+0000 7f6970b0d640 1 -- 172.21.15.1:0/2015124172 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f696c1526d0 con 0x7f696c0cdc20 2024-05-04T02:49:15.337 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.335+0000 7f6970b0d640 1 -- 172.21.15.1:0/2015124172 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f696c1f2690 con 0x7f696c0cdc20 2024-05-04T02:49:15.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.359+0000 7f6962ffd640 1 -- 172.21.15.1:0/2015124172 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6964005d10 con 0x7f696c0cdc20 2024-05-04T02:49:15.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.360+0000 7f6962ffd640 1 --2- 172.21.15.1:0/2015124172 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f694c076350 0x7f694c078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:49:15.361 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.360+0000 7f696a59c640 1 --2- 172.21.15.1:0/2015124172 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f694c076350 0x7f694c078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:49:15.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.360+0000 7f696a59c640 1 --2- 172.21.15.1:0/2015124172 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f694c076350 0x7f694c078860 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f695c000f60 tx=0x7f695c000bc0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:49:15.365 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.363+0000 7f6962ffd640 1 -- 172.21.15.1:0/2015124172 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5854+0+0 (secure 0 0 0) 0x7f696405dd40 con 0x7f696c0cdc20 2024-05-04T02:49:15.658 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.655+0000 7f6962ffd640 1 -- 172.21.15.1:0/2015124172 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f696c1f2690 con 0x7f696c0cdc20 2024-05-04T02:49:15.859 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.857+0000 7f6970b0d640 1 -- 172.21.15.1:0/2015124172 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f696c15a150 con 0x7f696c0cdc20 2024-05-04T02:49:15.900 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.898+0000 7f6962ffd640 1 -- 172.21.15.1:0/2015124172 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+16842 (secure 0 0 0) 0x7f6964022030 con 0x7f696c0cdc20 2024-05-04T02:49:15.901 INFO:teuthology.orchestra.run.smithi001.stdout: 2024-05-04T02:49:15.901 INFO:teuthology.orchestra.run.smithi001.stdout:{"epoch":25,"fsid":"b45b4a9a-b84c-4a66-907b-43f0ca45e7c0","created":"2024-05-04T02:19:44.555410+0000","modified":"2024-05-04T02:20:52.916817+0000","last_up_change":"2024-05-04T02:20:00.162760+0000","last_in_change":"2024-05-04T02:19:50.811018+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-04T02:19:59.664283+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-04T02:20:12.783217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-04T02:20:13.872502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d8ad7964-7bd6-4ba9-ae4f-b55d7566b18c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6800","nonce":2338132980},{"type":"v1","addr":"172.21.15.1:6801","nonce":2338132980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6802","nonce":2338132980},{"type":"v1","addr":"172.21.15.1:6803","nonce":2338132980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6806","nonce":2338132980},{"type":"v1","addr":"172.21.15.1:6807","nonce":2338132980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6804","nonce":2338132980},{"type":"v1","addr":"172.21.15.1:6805","nonce":2338132980}]},"public_addr":"172.21.15.1:6801/2338132980","cluster_addr":"172.21.15.1:6803/2338132980","heartbeat_back_addr":"172.21.15.1:6807/2338132980","heartbeat_front_addr":"172.21.15.1:6805/2338132980","state":["exists","up"]},{"osd":1,"uuid":"ce155f6d-7e0c-47c8-a0e0-fb53ff0c7726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6816","nonce":459131368},{"type":"v1","addr":"172.21.15.1:6817","nonce":459131368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6818","nonce":459131368},{"type":"v1","addr":"172.21.15.1:6819","nonce":459131368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6822","nonce":459131368},{"type":"v1","addr":"172.21.15.1:6823","nonce":459131368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6820","nonce":459131368},{"type":"v1","addr":"172.21.15.1:6821","nonce":459131368}]},"public_addr":"172.21.15.1:6817/459131368","cluster_addr":"172.21.15.1:6819/459131368","heartbeat_back_addr":"172.21.15.1:6823/459131368","heartbeat_front_addr":"172.21.15.1:6821/459131368","state":["exists","up"]},{"osd":2,"uuid":"7847c281-5da0-4d7d-b888-7f49d99a50b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6808","nonce":3463851105},{"type":"v1","addr":"172.21.15.1:6809","nonce":3463851105}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6810","nonce":3463851105},{"type":"v1","addr":"172.21.15.1:6811","nonce":3463851105}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6814","nonce":3463851105},{"type":"v1","addr":"172.21.15.1:6815","nonce":3463851105}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6812","nonce":3463851105},{"type":"v1","addr":"172.21.15.1:6813","nonce":3463851105}]},"public_addr":"172.21.15.1:6809/3463851105","cluster_addr":"172.21.15.1:6811/3463851105","heartbeat_back_addr":"172.21.15.1:6815/3463851105","heartbeat_front_addr":"172.21.15.1:6813/3463851105","state":["exists","up"]},{"osd":3,"uuid":"26386eba-d106-4abe-8d6b-7dccdd106cb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6824","nonce":3859721636},{"type":"v1","addr":"172.21.15.1:6825","nonce":3859721636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6826","nonce":3859721636},{"type":"v1","addr":"172.21.15.1:6827","nonce":3859721636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6830","nonce":3859721636},{"type":"v1","addr":"172.21.15.1:6831","nonce":3859721636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.1:6828","nonce":3859721636},{"type":"v1","addr":"172.21.15.1:6829","nonce":3859721636}]},"public_addr":"172.21.15.1:6825/3859721636","cluster_addr":"172.21.15.1:6827/3859721636","heartbeat_back_addr":"172.21.15.1:6831/3859721636","heartbeat_front_addr":"172.21.15.1:6829/3859721636","state":["exists","up"]},{"osd":4,"uuid":"2ba3d1b3-c5fa-4ff4-bf5d-772e77d79c59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":2335597098},{"type":"v1","addr":"172.21.15.107:6803","nonce":2335597098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":2335597098},{"type":"v1","addr":"172.21.15.107:6805","nonce":2335597098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":2335597098},{"type":"v1","addr":"172.21.15.107:6810","nonce":2335597098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":2335597098},{"type":"v1","addr":"172.21.15.107:6807","nonce":2335597098}]},"public_addr":"172.21.15.107:6803/2335597098","cluster_addr":"172.21.15.107:6805/2335597098","heartbeat_back_addr":"172.21.15.107:6810/2335597098","heartbeat_front_addr":"172.21.15.107:6807/2335597098","state":["exists","up"]},{"osd":5,"uuid":"c42646eb-6e14-4b42-a7a3-54f99f1662bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":1274544305},{"type":"v1","addr":"172.21.15.107:6819","nonce":1274544305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":1274544305},{"type":"v1","addr":"172.21.15.107:6821","nonce":1274544305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":1274544305},{"type":"v1","addr":"172.21.15.107:6825","nonce":1274544305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":1274544305},{"type":"v1","addr":"172.21.15.107:6823","nonce":1274544305}]},"public_addr":"172.21.15.107:6819/1274544305","cluster_addr":"172.21.15.107:6821/1274544305","heartbeat_back_addr":"172.21.15.107:6825/1274544305","heartbeat_front_addr":"172.21.15.107:6823/1274544305","state":["exists","up"]},{"osd":6,"uuid":"a8a2dbb8-0107-4b8e-93c3-5fa7e6af15a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6809","nonce":941385299},{"type":"v1","addr":"172.21.15.107:6811","nonce":941385299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":941385299},{"type":"v1","addr":"172.21.15.107:6813","nonce":941385299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6816","nonce":941385299},{"type":"v1","addr":"172.21.15.107:6817","nonce":941385299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":941385299},{"type":"v1","addr":"172.21.15.107:6815","nonce":941385299}]},"public_addr":"172.21.15.107:6811/941385299","cluster_addr":"172.21.15.107:6813/941385299","heartbeat_back_addr":"172.21.15.107:6817/941385299","heartbeat_front_addr":"172.21.15.107:6815/941385299","state":["exists","up"]},{"osd":7,"uuid":"3b9bdc70-8831-4df9-8d50-362aa0f02aed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":1723298539},{"type":"v1","addr":"172.21.15.107:6827","nonce":1723298539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":1723298539},{"type":"v1","addr":"172.21.15.107:6829","nonce":1723298539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6832","nonce":1723298539},{"type":"v1","addr":"172.21.15.107:6833","nonce":1723298539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":1723298539},{"type":"v1","addr":"172.21.15.107:6831","nonce":1723298539}]},"public_addr":"172.21.15.107:6827/1723298539","cluster_addr":"172.21.15.107:6829/1723298539","heartbeat_back_addr":"172.21.15.107:6833/1723298539","heartbeat_front_addr":"172.21.15.107:6831/1723298539","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T02:19:56.277538+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T02:19:56.402984+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T02:19:56.374787+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T02:19:56.461914+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T02:19:56.384856+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T02:19:56.469958+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T02:19:56.489376+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-04T02:19:56.393205+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.15","mappings":[{"from":3,"to":1}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.3f","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-04T02:49:15.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.901+0000 7f6970b0d640 1 -- 172.21.15.1:0/2015124172 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f694c076350 msgr2=0x7f694c078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:49:15.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.901+0000 7f6970b0d640 1 --2- 172.21.15.1:0/2015124172 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f694c076350 0x7f694c078860 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f695c000f60 tx=0x7f695c000bc0 comp rx=0 tx=0).stop 2024-05-04T02:49:15.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.901+0000 7f6970b0d640 1 -- 172.21.15.1:0/2015124172 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f696c0cdc20 msgr2=0x7f696c14a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:49:15.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.901+0000 7f6970b0d640 1 --2- 172.21.15.1:0/2015124172 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f696c0cdc20 0x7f696c14a490 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f696400efc0 tx=0x7f696400c490 comp rx=0 tx=0).stop 2024-05-04T02:49:15.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.901+0000 7f6970b0d640 1 -- 172.21.15.1:0/2015124172 shutdown_connections 2024-05-04T02:49:15.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.901+0000 7f6970b0d640 1 --2- 172.21.15.1:0/2015124172 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f694c076350 0x7f694c078860 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:15.903 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.901+0000 7f6970b0d640 1 --2- 172.21.15.1:0/2015124172 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f696c0cdc20 0x7f696c14a490 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:15.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.901+0000 7f6970b0d640 1 --2- 172.21.15.1:0/2015124172 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f696c0cd3e0 0x7f696c1e93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:15.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.901+0000 7f6970b0d640 1 --2- 172.21.15.1:0/2015124172 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f696c0c6f70 0x7f696c1f2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:15.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.901+0000 7f6970b0d640 1 -- 172.21.15.1:0/2015124172 >> 172.21.15.1:0/2015124172 conn(0x7f696c08e210 msgr2=0x7f696c0cbfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:49:15.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.901+0000 7f6970b0d640 1 -- 172.21.15.1:0/2015124172 shutdown_connections 2024-05-04T02:49:15.904 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:15.901+0000 7f6970b0d640 1 -- 172.21.15.1:0/2015124172 wait complete. 2024-05-04T02:49:15.915 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-04T02:49:16.028 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.027+0000 7f11c030d640 1 Processor -- start 2024-05-04T02:49:16.029 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.027+0000 7f11c030d640 1 -- start start 2024-05-04T02:49:16.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.028+0000 7f11c030d640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f11b81546d0 0x7f11b815ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:49:16.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.028+0000 7f11c030d640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f11b80cb4d0 0x7f11b80cb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:49:16.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.028+0000 7f11c030d640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11b815d6e0 con 0x7f11b80b5170 2024-05-04T02:49:16.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.028+0000 7f11c030d640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f11b80cbe20 con 0x7f11b80cb4d0 2024-05-04T02:49:16.030 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.028+0000 7f11c030d640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f11b815b370 con 0x7f11b81546d0 2024-05-04T02:49:16.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.029+0000 7f11bd8a8640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f11b81546d0 0x7f11b815ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:49:16.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.029+0000 7f11be8aa640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f11b80cb4d0 0x7f11b80cb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:49:16.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.029+0000 7f11bd8a8640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f11b81546d0 0x7f11b815ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.1:36898/0 (socket says 172.21.15.1:36898) 2024-05-04T02:49:16.031 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.029+0000 7f11bd8a8640 1 -- 172.21.15.1:0/3688866037 learned_addr learned my addr 172.21.15.1:0/3688866037 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:49:16.034 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.033+0000 7f11bd8a8640 1 -- 172.21.15.1:0/3688866037 >> v2:172.21.15.107:3300/0 conn(0x7f11b80cb4d0 msgr2=0x7f11b80cb8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:49:16.034 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.033+0000 7f11bd8a8640 1 --2- 172.21.15.1:0/3688866037 >> v2:172.21.15.107:3300/0 conn(0x7f11b80cb4d0 0x7f11b80cb8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:16.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.033+0000 7f11bd8a8640 1 -- 172.21.15.1:0/3688866037 >> v1:172.21.15.107:6789/0 conn(0x7f11b80b5170 legacy=0x7f11b80702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:49:16.035 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.033+0000 7f11bd8a8640 1 -- 172.21.15.1:0/3688866037 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11b80ca190 con 0x7f11b81546d0 2024-05-04T02:49:16.037 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.035+0000 7f11bd8a8640 1 --2- 172.21.15.1:0/3688866037 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f11b81546d0 0x7f11b815ae30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f11a8009870 tx=0x7f11a802a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33e9cb67a4ab7af7 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:49:16.041 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.039+0000 7f11bd0a7640 1 -- 172.21.15.1:0/3688866037 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a8037070 con 0x7f11b81546d0 2024-05-04T02:49:16.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.040+0000 7f11bd0a7640 1 -- 172.21.15.1:0/3688866037 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f11a8032440 con 0x7f11b81546d0 2024-05-04T02:49:16.042 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.040+0000 7f11bd0a7640 1 -- 172.21.15.1:0/3688866037 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a8032830 con 0x7f11b81546d0 2024-05-04T02:49:16.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.040+0000 7f11c030d640 1 -- 172.21.15.1:0/3688866037 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f11b81546d0 msgr2=0x7f11b815ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:49:16.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.040+0000 7f11c030d640 1 --2- 172.21.15.1:0/3688866037 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f11b81546d0 0x7f11b815ae30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f11a8009870 tx=0x7f11a802a1c0 comp rx=0 tx=0).stop 2024-05-04T02:49:16.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.040+0000 7f11c030d640 1 -- 172.21.15.1:0/3688866037 shutdown_connections 2024-05-04T02:49:16.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.040+0000 7f11c030d640 1 --2- 172.21.15.1:0/3688866037 >> v2:172.21.15.107:3300/0 conn(0x7f11b80cb4d0 0x7f11b80cb8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:16.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.040+0000 7f11c030d640 1 --2- 172.21.15.1:0/3688866037 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f11b81546d0 0x7f11b815ae30 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:16.043 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.040+0000 7f11c030d640 1 -- 172.21.15.1:0/3688866037 >> 172.21.15.1:0/3688866037 conn(0x7f11b80cf6e0 msgr2=0x7f11b80cfaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:49:16.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.040+0000 7f11c030d640 1 -- 172.21.15.1:0/3688866037 shutdown_connections 2024-05-04T02:49:16.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.040+0000 7f11c030d640 1 -- 172.21.15.1:0/3688866037 wait complete. 2024-05-04T02:49:16.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.042+0000 7f11c030d640 1 Processor -- start 2024-05-04T02:49:16.044 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.042+0000 7f11c030d640 1 -- start start 2024-05-04T02:49:16.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.043+0000 7f11c030d640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f11b80b5170 0x7f11b81f2660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:49:16.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.043+0000 7f11c030d640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f11b80cb4d0 0x7f11b806f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:49:16.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.043+0000 7f11c030d640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f11b81546d0 0x7f11b8150a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:49:16.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.043+0000 7f11c030d640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f11b80ca9f0 con 0x7f11b80cb4d0 2024-05-04T02:49:16.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.043+0000 7f11c030d640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f11b80ca710 con 0x7f11b80b5170 2024-05-04T02:49:16.045 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.043+0000 7f11c030d640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f11b80cacd0 con 0x7f11b81546d0 2024-05-04T02:49:16.046 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.044+0000 7f11bd8a8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f11b80cb4d0 0x7f11b806f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:49:16.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.044+0000 7f11be8aa640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f11b81546d0 0x7f11b8150a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:49:16.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.044+0000 7f11be0a9640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f11b80b5170 0x7f11b81f2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:49:16.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.044+0000 7f11bd8a8640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f11b80cb4d0 0x7f11b806f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37770/0 (socket says 172.21.15.1:37770) 2024-05-04T02:49:16.047 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.044+0000 7f11bd8a8640 1 -- 172.21.15.1:0/1955261781 learned_addr learned my addr 172.21.15.1:0/1955261781 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:49:16.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.049+0000 7f11bd8a8640 1 -- 172.21.15.1:0/1955261781 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f11b81546d0 msgr2=0x7f11b8150a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:49:16.050 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.049+0000 7f11bd8a8640 1 --2- 172.21.15.1:0/1955261781 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f11b81546d0 0x7f11b8150a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:16.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.049+0000 7f11bd8a8640 1 -- 172.21.15.1:0/1955261781 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f11b80b5170 msgr2=0x7f11b81f2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:49:16.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.049+0000 7f11bd8a8640 1 --2- 172.21.15.1:0/1955261781 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f11b80b5170 0x7f11b81f2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:16.051 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.049+0000 7f11bd8a8640 1 -- 172.21.15.1:0/1955261781 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11b81f2ba0 con 0x7f11b80cb4d0 2024-05-04T02:49:16.053 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.051+0000 7f11bd8a8640 1 --2- 172.21.15.1:0/1955261781 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f11b80cb4d0 0x7f11b806f2c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f11a8000c00 tx=0x7f11a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:49:16.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.055+0000 7f11aeffd640 1 -- 172.21.15.1:0/1955261781 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a8041020 con 0x7f11b80cb4d0 2024-05-04T02:49:16.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.056+0000 7f11aeffd640 1 -- 172.21.15.1:0/1955261781 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f11a80306c0 con 0x7f11b80cb4d0 2024-05-04T02:49:16.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.056+0000 7f11c030d640 1 -- 172.21.15.1:0/1955261781 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11b8155ff0 con 0x7f11b80cb4d0 2024-05-04T02:49:16.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.056+0000 7f11aeffd640 1 -- 172.21.15.1:0/1955261781 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a8037040 con 0x7f11b80cb4d0 2024-05-04T02:49:16.058 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.056+0000 7f11c030d640 1 -- 172.21.15.1:0/1955261781 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11b80c8320 con 0x7f11b80cb4d0 2024-05-04T02:49:16.059 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.057+0000 7f11c030d640 1 -- 172.21.15.1:0/1955261781 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11b80c3b80 con 0x7f11b80cb4d0 2024-05-04T02:49:16.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.356+0000 7f11aeffd640 1 -- 172.21.15.1:0/1955261781 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f11a8044020 con 0x7f11b80cb4d0 2024-05-04T02:49:16.358 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.356+0000 7f11aeffd640 1 --2- 172.21.15.1:0/1955261781 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f119c076320 0x7f119c078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:49:16.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.357+0000 7f11be0a9640 1 --2- 172.21.15.1:0/1955261781 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f119c076320 0x7f119c078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:49:16.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.357+0000 7f11be0a9640 1 --2- 172.21.15.1:0/1955261781 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f119c076320 0x7f119c078830 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f11b400b450 tx=0x7f11b400d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:49:16.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.372+0000 7f11aeffd640 1 -- 172.21.15.1:0/1955261781 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5854+0+0 (secure 0 0 0) 0x7f11a807d670 con 0x7f11b80cb4d0 2024-05-04T02:49:16.374 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.372+0000 7f11aeffd640 1 -- 172.21.15.1:0/1955261781 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f11a804b030 con 0x7f11b80cb4d0 2024-05-04T02:49:16.607 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.605+0000 7f11c030d640 1 -- 172.21.15.1:0/1955261781 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f11b8076740 con 0x7f11b80cb4d0 2024-05-04T02:49:16.732 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.730+0000 7f11aeffd640 1 -- 172.21.15.1:0/1955261781 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) ==== 161+0+0 (secure 0 0 0) 0x7f11a80813e0 con 0x7f11b80cb4d0 2024-05-04T02:49:16.732 INFO:teuthology.orchestra.run.smithi001.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-04T02:49:16.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.732+0000 7f11c030d640 1 -- 172.21.15.1:0/1955261781 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f119c076320 msgr2=0x7f119c078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:49:16.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.732+0000 7f11c030d640 1 --2- 172.21.15.1:0/1955261781 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f119c076320 0x7f119c078830 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f11b400b450 tx=0x7f11b400d040 comp rx=0 tx=0).stop 2024-05-04T02:49:16.734 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.732+0000 7f11c030d640 1 -- 172.21.15.1:0/1955261781 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f11b80cb4d0 msgr2=0x7f11b806f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:49:16.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.732+0000 7f11c030d640 1 --2- 172.21.15.1:0/1955261781 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f11b80cb4d0 0x7f11b806f2c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f11a8000c00 tx=0x7f11a80046c0 comp rx=0 tx=0).stop 2024-05-04T02:49:16.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.732+0000 7f11c030d640 1 -- 172.21.15.1:0/1955261781 shutdown_connections 2024-05-04T02:49:16.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.732+0000 7f11c030d640 1 --2- 172.21.15.1:0/1955261781 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f119c076320 0x7f119c078830 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:16.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.732+0000 7f11c030d640 1 --2- 172.21.15.1:0/1955261781 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f11b81546d0 0x7f11b8150a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:16.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.732+0000 7f11c030d640 1 --2- 172.21.15.1:0/1955261781 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f11b80cb4d0 0x7f11b806f2c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:16.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.732+0000 7f11c030d640 1 --2- 172.21.15.1:0/1955261781 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f11b80b5170 0x7f11b81f2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:16.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.732+0000 7f11c030d640 1 -- 172.21.15.1:0/1955261781 >> 172.21.15.1:0/1955261781 conn(0x7f11b80cf6e0 msgr2=0x7f11b80b47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:49:16.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.732+0000 7f11c030d640 1 -- 172.21.15.1:0/1955261781 shutdown_connections 2024-05-04T02:49:16.735 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.732+0000 7f11c030d640 1 -- 172.21.15.1:0/1955261781 wait complete. 2024-05-04T02:49:16.746 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-04T02:49:16.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.860+0000 7f4f820bd640 1 Processor -- start 2024-05-04T02:49:16.862 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.860+0000 7f4f820bd640 1 -- start start 2024-05-04T02:49:16.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.862+0000 7f4f820bd640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4f7c0b4640 0x7f4f7c06c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:49:16.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.862+0000 7f4f820bd640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f7c0c6970 con 0x7f4f7c0c7810 2024-05-04T02:49:16.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.862+0000 7f4f820bd640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f7c0c7380 con 0x7f4f7c0cdea0 2024-05-04T02:49:16.864 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.862+0000 7f4f820bd640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f4f7c0c7130 con 0x7f4f7c0b4640 2024-05-04T02:49:16.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.922+0000 7f4f7bfff640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7f4f7c0c7810 0x7f4f7c166da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:47022/0 (socket says 172.21.15.1:47022) 2024-05-04T02:49:16.924 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.922+0000 7f4f7bfff640 1 -- 172.21.15.1:0/1953792172 learned_addr learned my addr 172.21.15.1:0/1953792172 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-05-04T02:49:16.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.924+0000 7f4f7a7fc640 1 -- 172.21.15.1:0/1953792172 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3478905557 0 0) 0x7f4f7c0c6970 con 0x7f4f7c0c7810 2024-05-04T02:49:16.926 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.924+0000 7f4f7a7fc640 1 -- 172.21.15.1:0/1953792172 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f64003520 con 0x7f4f7c0c7810 2024-05-04T02:49:16.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.928+0000 7f4f7a7fc640 1 -- 172.21.15.1:0/1953792172 <== mon.0 v1:172.21.15.1:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 79020251 0 0) 0x7f4f64003520 con 0x7f4f7c0c7810 2024-05-04T02:49:16.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.929+0000 7f4f7a7fc640 1 -- 172.21.15.1:0/1953792172 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4f7c0b4640 msgr2=0x7f4f7c06c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:49:16.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.929+0000 7f4f7a7fc640 1 --2- 172.21.15.1:0/1953792172 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4f7c0b4640 0x7f4f7c06c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:16.931 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.929+0000 7f4f7a7fc640 1 -- 172.21.15.1:0/1953792172 >> v1:172.21.15.107:6789/0 conn(0x7f4f7c0cdea0 legacy=0x7f4f7c0c7d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:49:16.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.929+0000 7f4f7a7fc640 1 -- 172.21.15.1:0/1953792172 --> v1:172.21.15.1:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f7c15d040 con 0x7f4f7c0c7810 2024-05-04T02:49:16.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.929+0000 7f4f7a7fc640 1 -- 172.21.15.1:0/1953792172 <== mon.0 v1:172.21.15.1:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1418761865 0 0) 0x7f4f74001a70 con 0x7f4f7c0c7810 2024-05-04T02:49:16.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.929+0000 7f4f7a7fc640 1 -- 172.21.15.1:0/1953792172 >> v1:172.21.15.1:6789/0 conn(0x7f4f7c0c7810 legacy=0x7f4f7c166da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:49:16.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.929+0000 7f4f7a7fc640 1 --2- 172.21.15.1:0/1953792172 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4f7c0b4640 0x7f4f64003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:49:16.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.929+0000 7f4f7a7fc640 1 --2- 172.21.15.1:0/1953792172 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f64004170 0x7f4f64004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:49:16.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.929+0000 7f4f7a7fc640 1 --2- 172.21.15.1:0/1953792172 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f64004e90 0x7f4f6400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:49:16.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.929+0000 7f4f7a7fc640 1 -- 172.21.15.1:0/1953792172 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4f7c0c7130 con 0x7f4f64004e90 2024-05-04T02:49:16.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.929+0000 7f4f7a7fc640 1 -- 172.21.15.1:0/1953792172 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f4f64005660 con 0x7f4f64004170 2024-05-04T02:49:16.932 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.929+0000 7f4f7a7fc640 1 -- 172.21.15.1:0/1953792172 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f4f6400bf50 con 0x7f4f7c0b4640 2024-05-04T02:49:16.933 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.931+0000 7f4f7b7fe640 1 --2- 172.21.15.1:0/1953792172 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4f7c0b4640 0x7f4f64003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:49:16.934 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.932+0000 7f4f7bfff640 1 --2- 172.21.15.1:0/1953792172 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f64004e90 0x7f4f6400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:49:16.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.935+0000 7f4f7bfff640 1 -- 172.21.15.1:0/1953792172 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4f7c0b4640 msgr2=0x7f4f64003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:49:16.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.935+0000 7f4f7bfff640 1 --2- 172.21.15.1:0/1953792172 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4f7c0b4640 0x7f4f64003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:16.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.935+0000 7f4f7bfff640 1 -- 172.21.15.1:0/1953792172 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f64004170 msgr2=0x7f4f64004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:49:16.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.935+0000 7f4f7bfff640 1 --2- 172.21.15.1:0/1953792172 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f64004170 0x7f4f64004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:16.937 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.935+0000 7f4f7bfff640 1 -- 172.21.15.1:0/1953792172 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f64003520 con 0x7f4f64004e90 2024-05-04T02:49:16.939 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.938+0000 7f4f7bfff640 1 --2- 172.21.15.1:0/1953792172 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f64004e90 0x7f4f6400b9c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c074780 tx=0x7f4f64005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4de44aaed6367a15 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:49:16.943 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.942+0000 7f4f7a7fc640 1 -- 172.21.15.1:0/1953792172 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f7400a430 con 0x7f4f64004e90 2024-05-04T02:49:16.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.942+0000 7f4f7a7fc640 1 -- 172.21.15.1:0/1953792172 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f4f7402f070 con 0x7f4f64004e90 2024-05-04T02:49:16.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.942+0000 7f4f7a7fc640 1 -- 172.21.15.1:0/1953792172 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f7402bb80 con 0x7f4f64004e90 2024-05-04T02:49:16.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.942+0000 7f4f820bd640 1 -- 172.21.15.1:0/1953792172 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f64004e90 msgr2=0x7f4f6400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:49:16.944 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.942+0000 7f4f820bd640 1 --2- 172.21.15.1:0/1953792172 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f64004e90 0x7f4f6400b9c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c074780 tx=0x7f4f64005830 comp rx=0 tx=0).stop 2024-05-04T02:49:16.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.942+0000 7f4f7bfff640 1 -- 172.21.15.1:0/1953792172 reap_dead start 2024-05-04T02:49:16.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.943+0000 7f4f820bd640 1 -- 172.21.15.1:0/1953792172 shutdown_connections 2024-05-04T02:49:16.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.943+0000 7f4f820bd640 1 -- 172.21.15.1:0/1953792172 >> 172.21.15.1:0/1953792172 conn(0x7f4f7c0d18d0 msgr2=0x7f4f7c0d1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:49:16.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.943+0000 7f4f820bd640 1 -- 172.21.15.1:0/1953792172 shutdown_connections 2024-05-04T02:49:16.945 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.943+0000 7f4f820bd640 1 -- 172.21.15.1:0/1953792172 wait complete. 2024-05-04T02:49:16.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.944+0000 7f4f820bd640 1 Processor -- start 2024-05-04T02:49:16.946 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.945+0000 7f4f820bd640 1 -- start start 2024-05-04T02:49:16.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.946+0000 7f4f820bd640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4f7c15bfe0 0x7f4f7c0c99f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:49:16.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.946+0000 7f4f820bd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f7c0c9f30 0x7f4f7c14f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:49:16.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.946+0000 7f4f820bd640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f7c14f6f0 0x7f4f7c0ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:49:16.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.946+0000 7f4f820bd640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7f4f7c0c85f0 con 0x7f4f7c0c9f30 2024-05-04T02:49:16.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.946+0000 7f4f820bd640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f4f7c0c8470 con 0x7f4f7c14f6f0 2024-05-04T02:49:16.948 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.946+0000 7f4f820bd640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7f4f7c06c6f0 con 0x7f4f7c15bfe0 2024-05-04T02:49:16.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.947+0000 7f4f7bfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f7c14f6f0 0x7f4f7c0ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:49:16.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.947+0000 7f4f7b7fe640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4f7c15bfe0 0x7f4f7c0c99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:49:16.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.947+0000 7f4f7bfff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f7c14f6f0 0x7f4f7c0ca6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.1:38430/0 (socket says 172.21.15.1:38430) 2024-05-04T02:49:16.949 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.947+0000 7f4f7bfff640 1 -- 172.21.15.1:0/2346258694 learned_addr learned my addr 172.21.15.1:0/2346258694 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:49:16.951 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.949+0000 7f4f7affd640 1 --2- 172.21.15.1:0/2346258694 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f7c0c9f30 0x7f4f7c14f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:49:16.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.951+0000 7f4f7bfff640 1 -- 172.21.15.1:0/2346258694 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4f7c15bfe0 msgr2=0x7f4f7c0c99f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:49:16.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.951+0000 7f4f7bfff640 1 --2- 172.21.15.1:0/2346258694 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4f7c15bfe0 0x7f4f7c0c99f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:16.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.951+0000 7f4f7bfff640 1 -- 172.21.15.1:0/2346258694 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f7c0c9f30 msgr2=0x7f4f7c14f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:49:16.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.951+0000 7f4f7bfff640 1 --2- 172.21.15.1:0/2346258694 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f7c0c9f30 0x7f4f7c14f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:16.953 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.951+0000 7f4f7bfff640 1 -- 172.21.15.1:0/2346258694 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f7c1f3280 con 0x7f4f7c14f6f0 2024-05-04T02:49:16.955 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.953+0000 7f4f7bfff640 1 --2- 172.21.15.1:0/2346258694 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f7c14f6f0 0x7f4f7c0ca6b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4f7402b3b0 tx=0x7f4f7c0b55a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:49:16.957 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.956+0000 7f4f63fff640 1 -- 172.21.15.1:0/2346258694 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f74001f80 con 0x7f4f7c14f6f0 2024-05-04T02:49:16.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.956+0000 7f4f820bd640 1 -- 172.21.15.1:0/2346258694 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f7c0c8c30 con 0x7f4f7c14f6f0 2024-05-04T02:49:16.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.956+0000 7f4f820bd640 1 -- 172.21.15.1:0/2346258694 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f7c0c91f0 con 0x7f4f7c14f6f0 2024-05-04T02:49:16.958 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.957+0000 7f4f820bd640 1 -- 172.21.15.1:0/2346258694 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f7c06fff0 con 0x7f4f7c14f6f0 2024-05-04T02:49:16.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.957+0000 7f4f63fff640 1 -- 172.21.15.1:0/2346258694 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f4f7402f070 con 0x7f4f7c14f6f0 2024-05-04T02:49:16.959 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.957+0000 7f4f63fff640 1 -- 172.21.15.1:0/2346258694 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f74034470 con 0x7f4f7c14f6f0 2024-05-04T02:49:16.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.983+0000 7f4f63fff640 1 -- 172.21.15.1:0/2346258694 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4f74034610 con 0x7f4f7c14f6f0 2024-05-04T02:49:16.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.983+0000 7f4f63fff640 1 --2- 172.21.15.1:0/2346258694 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f4f680762d0 0x7f4f680787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:49:16.985 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.984+0000 7f4f7b7fe640 1 --2- 172.21.15.1:0/2346258694 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f4f680762d0 0x7f4f680787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:49:16.986 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:16.984+0000 7f4f7b7fe640 1 --2- 172.21.15.1:0/2346258694 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f4f680762d0 0x7f4f680787e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c0b41c0 tx=0x7f4f6c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:49:17.242 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:17.240+0000 7f4f63fff640 1 -- 172.21.15.1:0/2346258694 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5940+0+0 (secure 0 0 0) 0x7f4f740b5f50 con 0x7f4f7c14f6f0 2024-05-04T02:49:17.298 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:17.297+0000 7f4f63fff640 1 -- 172.21.15.1:0/2346258694 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4f7c06fff0 con 0x7f4f7c14f6f0 2024-05-04T02:49:17.551 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:17.549+0000 7f4f820bd640 1 -- 172.21.15.1:0/2346258694 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f4f7c076740 con 0x7f4f7c14f6f0 2024-05-04T02:49:18.130 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:18.129+0000 7f4f63fff640 1 -- 172.21.15.1:0/2346258694 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) ==== 104+0+0 (secure 0 0 0) 0x7f4f74046060 con 0x7f4f7c14f6f0 2024-05-04T02:49:18.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:18.130+0000 7f4f820bd640 1 -- 172.21.15.1:0/2346258694 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f4f680762d0 msgr2=0x7f4f680787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:49:18.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:18.130+0000 7f4f820bd640 1 --2- 172.21.15.1:0/2346258694 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f4f680762d0 0x7f4f680787e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c0b41c0 tx=0x7f4f6c009040 comp rx=0 tx=0).stop 2024-05-04T02:49:18.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:18.130+0000 7f4f820bd640 1 -- 172.21.15.1:0/2346258694 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f7c14f6f0 msgr2=0x7f4f7c0ca6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:49:18.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:18.130+0000 7f4f820bd640 1 --2- 172.21.15.1:0/2346258694 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f7c14f6f0 0x7f4f7c0ca6b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4f7402b3b0 tx=0x7f4f7c0b55a0 comp rx=0 tx=0).stop 2024-05-04T02:49:18.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:18.131+0000 7f4f820bd640 1 -- 172.21.15.1:0/2346258694 shutdown_connections 2024-05-04T02:49:18.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:18.131+0000 7f4f820bd640 1 --2- 172.21.15.1:0/2346258694 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7f4f680762d0 0x7f4f680787e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:18.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:18.131+0000 7f4f820bd640 1 --2- 172.21.15.1:0/2346258694 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4f7c14f6f0 0x7f4f7c0ca6b0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:18.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:18.131+0000 7f4f820bd640 1 --2- 172.21.15.1:0/2346258694 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7f4f7c0c9f30 0x7f4f7c14f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:18.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:18.131+0000 7f4f820bd640 1 --2- 172.21.15.1:0/2346258694 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7f4f7c15bfe0 0x7f4f7c0c99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:18.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:18.131+0000 7f4f820bd640 1 -- 172.21.15.1:0/2346258694 >> 172.21.15.1:0/2346258694 conn(0x7f4f7c0d18d0 msgr2=0x7f4f7c1e5850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:49:18.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:18.131+0000 7f4f820bd640 1 -- 172.21.15.1:0/2346258694 shutdown_connections 2024-05-04T02:49:18.133 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:18.131+0000 7f4f820bd640 1 -- 172.21.15.1:0/2346258694 wait complete. 2024-05-04T02:49:18.145 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-04T02:49:18.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:18.258+0000 7faa59bf3640 1 Processor -- start 2024-05-04T02:49:18.260 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:18.258+0000 7faa59bf3640 1 -- start start 2024-05-04T02:49:18.261 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:18.260+0000 7faa59bf3640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa5415e250 0x7faa540cb280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:49:18.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:18.260+0000 7faa59bf3640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7faa540b50e0 0x7faa5415b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:49:18.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:18.260+0000 7faa59bf3640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa540ca1e0 con 0x7faa540714c0 2024-05-04T02:49:18.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:18.260+0000 7faa59bf3640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7faa540cbfc0 con 0x7faa540b50e0 2024-05-04T02:49:18.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:18.260+0000 7faa59bf3640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7faa5415e800 con 0x7faa5415e250 2024-05-04T02:49:18.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:18.260+0000 7faa537fe640 1 --1- >> v1:172.21.15.1:6789/0 conn(0x7faa540714c0 0x7faa54154490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:47034/0 (socket says 172.21.15.1:47034) 2024-05-04T02:49:18.262 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:18.260+0000 7faa537fe640 1 -- 172.21.15.1:0/22217213 learned_addr learned my addr 172.21.15.1:0/22217213 (peer_addr_for_me v1:172.21.15.1:0/0) 2024-05-04T02:49:18.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:18.260+0000 7faa53fff640 1 --2- 172.21.15.1:0/22217213 >> v2:172.21.15.107:3300/0 conn(0x7faa540b50e0 0x7faa5415b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:49:18.263 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:18.261+0000 7faa52ffd640 1 --2- 172.21.15.1:0/22217213 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa5415e250 0x7faa540cb280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:49:18.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:18.263+0000 7faa527fc640 1 -- 172.21.15.1:0/22217213 <== mon.0 v1:172.21.15.1:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1041978548 0 0) 0x7faa540ca1e0 con 0x7faa540714c0 2024-05-04T02:49:18.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:18.263+0000 7faa527fc640 1 -- 172.21.15.1:0/22217213 --> v1:172.21.15.1:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa3c003520 con 0x7faa540714c0 2024-05-04T02:49:18.265 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:18.263+0000 7faa53fff640 1 -- 172.21.15.1:0/22217213 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa5415e250 msgr2=0x7faa540cb280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:49:18.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:18.263+0000 7faa53fff640 1 --2- 172.21.15.1:0/22217213 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa5415e250 0x7faa540cb280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:18.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:18.263+0000 7faa53fff640 1 -- 172.21.15.1:0/22217213 >> v1:172.21.15.1:6789/0 conn(0x7faa540714c0 legacy=0x7faa54154490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:49:18.266 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:18.263+0000 7faa53fff640 1 -- 172.21.15.1:0/22217213 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa540ca4c0 con 0x7faa540b50e0 2024-05-04T02:49:18.267 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:18.266+0000 7faa53fff640 1 --2- 172.21.15.1:0/22217213 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa540b50e0 0x7faa5415b740 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7faa4c009d90 tx=0x7faa4c02a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5180961edbfe9c29 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:49:18.271 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:18.271+0000 7faa527fc640 1 -- 172.21.15.1:0/22217213 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa4c007740 con 0x7faa540b50e0 2024-05-04T02:49:18.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:18.271+0000 7faa527fc640 1 -- 172.21.15.1:0/22217213 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7faa4c0078e0 con 0x7faa540b50e0 2024-05-04T02:49:18.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:18.271+0000 7faa527fc640 1 -- 172.21.15.1:0/22217213 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa4c007cd0 con 0x7faa540b50e0 2024-05-04T02:49:18.272 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:18.271+0000 7faa59bf3640 1 -- 172.21.15.1:0/22217213 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa540b50e0 msgr2=0x7faa5415b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:49:18.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:18.271+0000 7faa59bf3640 1 --2- 172.21.15.1:0/22217213 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa540b50e0 0x7faa5415b740 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7faa4c009d90 tx=0x7faa4c02a6f0 comp rx=0 tx=0).stop 2024-05-04T02:49:18.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:18.271+0000 7faa59bf3640 1 -- 172.21.15.1:0/22217213 shutdown_connections 2024-05-04T02:49:18.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:18.271+0000 7faa59bf3640 1 --2- 172.21.15.1:0/22217213 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa540b50e0 0x7faa5415b740 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:18.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:18.271+0000 7faa59bf3640 1 --2- 172.21.15.1:0/22217213 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa5415e250 0x7faa540cb280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:18.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:18.271+0000 7faa59bf3640 1 -- 172.21.15.1:0/22217213 >> 172.21.15.1:0/22217213 conn(0x7faa540cf6c0 msgr2=0x7faa540cfad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:49:18.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:18.271+0000 7faa59bf3640 1 -- 172.21.15.1:0/22217213 shutdown_connections 2024-05-04T02:49:18.273 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:18.271+0000 7faa59bf3640 1 -- 172.21.15.1:0/22217213 wait complete. 2024-05-04T02:49:18.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:18.272+0000 7faa59bf3640 1 Processor -- start 2024-05-04T02:49:18.274 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:18.273+0000 7faa59bf3640 1 -- start start 2024-05-04T02:49:18.275 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:18.274+0000 7faa59bf3640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa540714c0 0x7faa541f39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:49:18.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:18.274+0000 7faa59bf3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faa540b50e0 0x7faa540b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:49:18.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:18.274+0000 7faa59bf3640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa5415e250 0x7faa540ceb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:49:18.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:18.274+0000 7faa59bf3640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7faa540caa80 con 0x7faa540b50e0 2024-05-04T02:49:18.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:18.274+0000 7faa59bf3640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7faa540cadf0 con 0x7faa540714c0 2024-05-04T02:49:18.276 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:18.274+0000 7faa59bf3640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7faa540702a0 con 0x7faa5415e250 2024-05-04T02:49:18.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:18.274+0000 7faa52ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faa540b50e0 0x7faa540b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:49:18.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:18.274+0000 7faa537fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa540714c0 0x7faa541f39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:49:18.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:18.274+0000 7faa53fff640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa5415e250 0x7faa540ceb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:49:18.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:18.275+0000 7faa52ffd640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faa540b50e0 0x7faa540b48d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37794/0 (socket says 172.21.15.1:37794) 2024-05-04T02:49:18.277 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:18.275+0000 7faa52ffd640 1 -- 172.21.15.1:0/1211763809 learned_addr learned my addr 172.21.15.1:0/1211763809 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:49:18.280 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:18.279+0000 7faa537fe640 1 -- 172.21.15.1:0/1211763809 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa5415e250 msgr2=0x7faa540ceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:49:18.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:18.279+0000 7faa537fe640 1 --2- 172.21.15.1:0/1211763809 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa5415e250 0x7faa540ceb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:18.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:18.279+0000 7faa537fe640 1 -- 172.21.15.1:0/1211763809 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faa540b50e0 msgr2=0x7faa540b48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:49:18.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:18.279+0000 7faa537fe640 1 --2- 172.21.15.1:0/1211763809 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faa540b50e0 0x7faa540b48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:18.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:18.279+0000 7faa537fe640 1 -- 172.21.15.1:0/1211763809 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa541f2f70 con 0x7faa540714c0 2024-05-04T02:49:18.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:18.281+0000 7faa537fe640 1 --2- 172.21.15.1:0/1211763809 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa540714c0 0x7faa541f39f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7faa4400c390 tx=0x7faa4400c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:49:18.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:18.286+0000 7faa3bfff640 1 -- 172.21.15.1:0/1211763809 <== mon.1 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa44017070 con 0x7faa540714c0 2024-05-04T02:49:18.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:18.286+0000 7faa3bfff640 1 -- 172.21.15.1:0/1211763809 <== mon.1 v2:172.21.15.107:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7faa44005ce0 con 0x7faa540714c0 2024-05-04T02:49:18.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:18.286+0000 7faa3bfff640 1 -- 172.21.15.1:0/1211763809 <== mon.1 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa440072f0 con 0x7faa540714c0 2024-05-04T02:49:18.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:18.286+0000 7faa59bf3640 1 -- 172.21.15.1:0/1211763809 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa540c3d30 con 0x7faa540714c0 2024-05-04T02:49:18.287 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:18.286+0000 7faa59bf3640 1 -- 172.21.15.1:0/1211763809 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa541f31f0 con 0x7faa540714c0 2024-05-04T02:49:18.288 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:18.286+0000 7faa59bf3640 1 -- 172.21.15.1:0/1211763809 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa54069c60 con 0x7faa540714c0 2024-05-04T02:49:18.338 INFO:tasks.ceph.mds.d.smithi107.stderr:==00:00:29:17.058 39193== 2024-05-04T02:49:18.338 INFO:tasks.ceph.mds.d.smithi107.stderr:==00:00:29:17.058 39193== Exit program on first error (--exit-on-first-error=yes) 2024-05-04T02:49:18.448 INFO:tasks.ceph.mds.d.smithi107.stderr:daemon-helper: command failed with exit status 42 2024-05-04T02:49:18.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:18.568+0000 7faa3bfff640 1 -- 172.21.15.1:0/1211763809 <== mon.1 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7faa4401a070 con 0x7faa540714c0 2024-05-04T02:49:18.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:18.568+0000 7faa3bfff640 1 --2- 172.21.15.1:0/1211763809 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7faa40076320 0x7faa40078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:49:18.570 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:18.569+0000 7faa52ffd640 1 --2- 172.21.15.1:0/1211763809 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7faa40076320 0x7faa40078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:49:18.571 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:18.569+0000 7faa52ffd640 1 --2- 172.21.15.1:0/1211763809 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7faa40076320 0x7faa40078830 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7faa54147850 tx=0x7faa48009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:49:18.575 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:18.575+0000 7faa3bfff640 1 -- 172.21.15.1:0/1211763809 <== mon.1 v2:172.21.15.107:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5940+0+0 (secure 0 0 0) 0x7faa4405c2f0 con 0x7faa540714c0 2024-05-04T02:49:18.586 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:18.585+0000 7faa3bfff640 1 -- 172.21.15.1:0/1211763809 <== mon.1 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7faa44021020 con 0x7faa540714c0 2024-05-04T02:49:18.778 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:18.777+0000 7faa59bf3640 1 -- 172.21.15.1:0/1211763809 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7faa540c97c0 con 0x7faa540714c0 2024-05-04T02:49:19.218 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:19.217+0000 7faa3bfff640 1 -- 172.21.15.1:0/1211763809 <== mon.1 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v27) ==== 181+0+0 (secure 0 0 0) 0x7faa541f2f70 con 0x7faa540714c0 2024-05-04T02:49:19.218 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_metadata' removed 2024-05-04T02:49:19.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:19.218+0000 7faa59bf3640 1 -- 172.21.15.1:0/1211763809 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7faa40076320 msgr2=0x7faa40078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:49:19.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:19.218+0000 7faa59bf3640 1 --2- 172.21.15.1:0/1211763809 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7faa40076320 0x7faa40078830 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7faa54147850 tx=0x7faa48009190 comp rx=0 tx=0).stop 2024-05-04T02:49:19.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:19.218+0000 7faa59bf3640 1 -- 172.21.15.1:0/1211763809 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa540714c0 msgr2=0x7faa541f39f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:49:19.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:19.218+0000 7faa59bf3640 1 --2- 172.21.15.1:0/1211763809 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa540714c0 0x7faa541f39f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7faa4400c390 tx=0x7faa4400c850 comp rx=0 tx=0).stop 2024-05-04T02:49:19.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:19.218+0000 7faa59bf3640 1 -- 172.21.15.1:0/1211763809 shutdown_connections 2024-05-04T02:49:19.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:19.218+0000 7faa59bf3640 1 --2- 172.21.15.1:0/1211763809 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7faa40076320 0x7faa40078830 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:19.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:19.218+0000 7faa59bf3640 1 --2- 172.21.15.1:0/1211763809 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7faa5415e250 0x7faa540ceb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:19.220 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:19.218+0000 7faa59bf3640 1 --2- 172.21.15.1:0/1211763809 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7faa540b50e0 0x7faa540b48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:19.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:19.218+0000 7faa59bf3640 1 --2- 172.21.15.1:0/1211763809 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faa540714c0 0x7faa541f39f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:19.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:19.218+0000 7faa59bf3640 1 -- 172.21.15.1:0/1211763809 >> 172.21.15.1:0/1211763809 conn(0x7faa540cf6c0 msgr2=0x7faa5415d580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:49:19.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:19.218+0000 7faa59bf3640 1 -- 172.21.15.1:0/1211763809 shutdown_connections 2024-05-04T02:49:19.221 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:19.218+0000 7faa59bf3640 1 -- 172.21.15.1:0/1211763809 wait complete. 2024-05-04T02:49:19.232 DEBUG:teuthology.orchestra.run.smithi001:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-04T02:49:19.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:19.346+0000 7fe442c27640 1 Processor -- start 2024-05-04T02:49:19.348 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:19.346+0000 7fe442c27640 1 -- start start 2024-05-04T02:49:19.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:19.347+0000 7fe442c27640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe43c0cdcf0 0x7fe43c06d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:49:19.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:19.347+0000 7fe442c27640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe43c15c4a0 0x7fe43c15c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:49:19.349 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:19.347+0000 7fe442c27640 1 -- --> v1:172.21.15.1:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe43c0cd3b0 con 0x7fe43c15cdf0 2024-05-04T02:49:19.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:19.347+0000 7fe442c27640 1 -- --> v2:172.21.15.1:3300/0 -- mon_getmap magic: 0 -- 0x7fe43c0b74b0 con 0x7fe43c15c4a0 2024-05-04T02:49:19.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:19.347+0000 7fe442c27640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe43c06d1a0 con 0x7fe43c0cdcf0 2024-05-04T02:49:19.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:19.348+0000 7fe4409c3640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe43c0cdcf0 0x7fe43c06d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:49:19.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:19.348+0000 7fe43bfff640 1 --2- >> v2:172.21.15.1:3300/0 conn(0x7fe43c15c4a0 0x7fe43c15c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:49:19.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:19.348+0000 7fe4409c3640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe43c0cdcf0 0x7fe43c06d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3301/0 says I am v2:172.21.15.1:36958/0 (socket says 172.21.15.1:36958) 2024-05-04T02:49:19.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:19.348+0000 7fe4409c3640 1 -- 172.21.15.1:0/2036411741 learned_addr learned my addr 172.21.15.1:0/2036411741 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:49:19.350 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:19.348+0000 7fe4411c4640 1 --1- 172.21.15.1:0/2036411741 >> v1:172.21.15.1:6789/0 conn(0x7fe43c15cdf0 0x7fe43c15fa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.1:6789/0 says I am v1:172.21.15.1:47046/0 (socket says 172.21.15.1:47046) 2024-05-04T02:49:19.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:19.351+0000 7fe4409c3640 1 -- 172.21.15.1:0/2036411741 >> v2:172.21.15.1:3300/0 conn(0x7fe43c15c4a0 msgr2=0x7fe43c15c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-04T02:49:19.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:19.351+0000 7fe4409c3640 1 --2- 172.21.15.1:0/2036411741 >> v2:172.21.15.1:3300/0 conn(0x7fe43c15c4a0 0x7fe43c15c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:19.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:19.351+0000 7fe4409c3640 1 -- 172.21.15.1:0/2036411741 >> v1:172.21.15.1:6789/0 conn(0x7fe43c15cdf0 legacy=0x7fe43c15fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:49:19.353 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:19.351+0000 7fe4409c3640 1 -- 172.21.15.1:0/2036411741 --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe43c06d480 con 0x7fe43c0cdcf0 2024-05-04T02:49:19.355 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:19.353+0000 7fe4409c3640 1 --2- 172.21.15.1:0/2036411741 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe43c0cdcf0 0x7fe43c06d9a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe434009e50 tx=0x7fe43402a7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3ba3e7dc1d45690 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:49:19.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:19.357+0000 7fe43b7fe640 1 -- 172.21.15.1:0/2036411741 <== mon.2 v2:172.21.15.107:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe434036070 con 0x7fe43c0cdcf0 2024-05-04T02:49:19.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:19.357+0000 7fe43b7fe640 1 -- 172.21.15.1:0/2036411741 <== mon.2 v2:172.21.15.107:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fe434031600 con 0x7fe43c0cdcf0 2024-05-04T02:49:19.359 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:19.357+0000 7fe43b7fe640 1 -- 172.21.15.1:0/2036411741 <== mon.2 v2:172.21.15.107:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4340319f0 con 0x7fe43c0cdcf0 2024-05-04T02:49:19.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:19.358+0000 7fe442c27640 1 -- 172.21.15.1:0/2036411741 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe43c0cdcf0 msgr2=0x7fe43c06d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:49:19.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:19.358+0000 7fe442c27640 1 --2- 172.21.15.1:0/2036411741 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe43c0cdcf0 0x7fe43c06d9a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe434009e50 tx=0x7fe43402a7a0 comp rx=0 tx=0).stop 2024-05-04T02:49:19.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:19.358+0000 7fe442c27640 1 -- 172.21.15.1:0/2036411741 shutdown_connections 2024-05-04T02:49:19.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:19.358+0000 7fe442c27640 1 --2- 172.21.15.1:0/2036411741 >> v2:172.21.15.1:3300/0 conn(0x7fe43c15c4a0 0x7fe43c15c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:19.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:19.358+0000 7fe442c27640 1 --2- 172.21.15.1:0/2036411741 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe43c0cdcf0 0x7fe43c06d9a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:19.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:19.358+0000 7fe442c27640 1 -- 172.21.15.1:0/2036411741 >> 172.21.15.1:0/2036411741 conn(0x7fe43c0ce960 msgr2=0x7fe43c08cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:49:19.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:19.358+0000 7fe442c27640 1 -- 172.21.15.1:0/2036411741 shutdown_connections 2024-05-04T02:49:19.360 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:19.358+0000 7fe442c27640 1 -- 172.21.15.1:0/2036411741 wait complete. 2024-05-04T02:49:19.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:19.360+0000 7fe442c27640 1 Processor -- start 2024-05-04T02:49:19.362 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:19.360+0000 7fe442c27640 1 -- start start 2024-05-04T02:49:19.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:19.361+0000 7fe442c27640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe43c0cdcf0 0x7fe43c1e6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:49:19.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:19.361+0000 7fe442c27640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe43c15c4a0 0x7fe43c14eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:49:19.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:19.361+0000 7fe442c27640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe43c15cdf0 0x7fe43c14f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:49:19.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:19.361+0000 7fe442c27640 1 -- --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_getmap magic: 0 -- 0x7fe43c0b7790 con 0x7fe43c0cdcf0 2024-05-04T02:49:19.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:19.361+0000 7fe442c27640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe43c15d200 con 0x7fe43c15cdf0 2024-05-04T02:49:19.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:19.361+0000 7fe442c27640 1 -- --> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] -- mon_getmap magic: 0 -- 0x7fe43c0cd7c0 con 0x7fe43c15c4a0 2024-05-04T02:49:19.363 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:19.361+0000 7fe4409c3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe43c0cdcf0 0x7fe43c1e6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:49:19.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:19.362+0000 7fe43bfff640 1 --2- >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe43c15c4a0 0x7fe43c14eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:49:19.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:19.362+0000 7fe4409c3640 1 --2- >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe43c0cdcf0 0x7fe43c1e6f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.1:3300/0 says I am v2:172.21.15.1:37812/0 (socket says 172.21.15.1:37812) 2024-05-04T02:49:19.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:19.362+0000 7fe4409c3640 1 -- 172.21.15.1:0/3051018899 learned_addr learned my addr 172.21.15.1:0/3051018899 (peer_addr_for_me v2:172.21.15.1:0/0) 2024-05-04T02:49:19.364 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:19.362+0000 7fe4411c4640 1 --2- 172.21.15.1:0/3051018899 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe43c15cdf0 0x7fe43c14f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:49:19.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:19.366+0000 7fe4409c3640 1 -- 172.21.15.1:0/3051018899 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe43c15c4a0 msgr2=0x7fe43c14eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:49:19.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:19.366+0000 7fe4409c3640 1 --2- 172.21.15.1:0/3051018899 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe43c15c4a0 0x7fe43c14eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:19.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:19.366+0000 7fe4409c3640 1 -- 172.21.15.1:0/3051018899 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe43c15cdf0 msgr2=0x7fe43c14f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:49:19.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:19.366+0000 7fe4409c3640 1 --2- 172.21.15.1:0/3051018899 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe43c15cdf0 0x7fe43c14f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:19.368 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:19.366+0000 7fe4409c3640 1 -- 172.21.15.1:0/3051018899 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe43c1e7450 con 0x7fe43c0cdcf0 2024-05-04T02:49:19.370 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:19.368+0000 7fe4409c3640 1 --2- 172.21.15.1:0/3051018899 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe43c0cdcf0 0x7fe43c1e6f10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe434009e50 tx=0x7fe434004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:49:19.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:19.372+0000 7fe4397fa640 1 -- 172.21.15.1:0/3051018899 <== mon.0 v2:172.21.15.1:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe434036050 con 0x7fe43c0cdcf0 2024-05-04T02:49:19.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:19.372+0000 7fe4397fa640 1 -- 172.21.15.1:0/3051018899 <== mon.0 v2:172.21.15.1:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fe434042070 con 0x7fe43c0cdcf0 2024-05-04T02:49:19.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:19.372+0000 7fe4397fa640 1 -- 172.21.15.1:0/3051018899 <== mon.0 v2:172.21.15.1:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe434009510 con 0x7fe43c0cdcf0 2024-05-04T02:49:19.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:19.372+0000 7fe442c27640 1 -- 172.21.15.1:0/3051018899 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe43c150b40 con 0x7fe43c0cdcf0 2024-05-04T02:49:19.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:19.372+0000 7fe442c27640 1 -- 172.21.15.1:0/3051018899 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe43c151100 con 0x7fe43c0cdcf0 2024-05-04T02:49:19.375 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:19.373+0000 7fe442c27640 1 -- 172.21.15.1:0/3051018899 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe43c069c60 con 0x7fe43c0cdcf0 2024-05-04T02:49:19.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:19.396+0000 7fe4397fa640 1 -- 172.21.15.1:0/3051018899 <== mon.0 v2:172.21.15.1:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe434007c50 con 0x7fe43c0cdcf0 2024-05-04T02:49:19.398 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:19.396+0000 7fe4397fa640 1 --2- 172.21.15.1:0/3051018899 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fe41c076320 0x7fe41c078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-04T02:49:19.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:19.397+0000 7fe43bfff640 1 --2- 172.21.15.1:0/3051018899 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fe41c076320 0x7fe41c078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-04T02:49:19.399 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:19.397+0000 7fe43bfff640 1 --2- 172.21.15.1:0/3051018899 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fe41c076320 0x7fe41c078830 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe43c14f970 tx=0x7fe424009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-04T02:49:19.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:19.685+0000 7fe4397fa640 1 -- 172.21.15.1:0/3051018899 <== mon.0 v2:172.21.15.1:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5502+0+0 (secure 0 0 0) 0x7fe43407e5c0 con 0x7fe43c0cdcf0 2024-05-04T02:49:19.687 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:19.685+0000 7fe4397fa640 1 -- 172.21.15.1:0/3051018899 <== mon.0 v2:172.21.15.1:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe434082330 con 0x7fe43c0cdcf0 2024-05-04T02:49:19.879 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:19.877+0000 7fe442c27640 1 -- 172.21.15.1:0/3051018899 --> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe43c0c86a0 con 0x7fe43c0cdcf0 2024-05-04T02:49:20.281 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:20.279+0000 7fe4397fa640 1 -- 172.21.15.1:0/3051018899 <== mon.0 v2:172.21.15.1:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v28) ==== 169+0+0 (secure 0 0 0) 0x7fe434086630 con 0x7fe43c0cdcf0 2024-05-04T02:49:20.281 INFO:teuthology.orchestra.run.smithi001.stderr:pool 'cephfs_data' removed 2024-05-04T02:49:20.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:20.281+0000 7fe442c27640 1 -- 172.21.15.1:0/3051018899 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fe41c076320 msgr2=0x7fe41c078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:49:20.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:20.281+0000 7fe442c27640 1 --2- 172.21.15.1:0/3051018899 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fe41c076320 0x7fe41c078830 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe43c14f970 tx=0x7fe424009190 comp rx=0 tx=0).stop 2024-05-04T02:49:20.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:20.281+0000 7fe442c27640 1 -- 172.21.15.1:0/3051018899 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe43c0cdcf0 msgr2=0x7fe43c1e6f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-04T02:49:20.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:20.281+0000 7fe442c27640 1 --2- 172.21.15.1:0/3051018899 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe43c0cdcf0 0x7fe43c1e6f10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe434009e50 tx=0x7fe434004a40 comp rx=0 tx=0).stop 2024-05-04T02:49:20.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:20.281+0000 7fe442c27640 1 -- 172.21.15.1:0/3051018899 shutdown_connections 2024-05-04T02:49:20.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:20.281+0000 7fe442c27640 1 --2- 172.21.15.1:0/3051018899 >> [v2:172.21.15.107:6800/3809222574,v1:172.21.15.107:6801/3809222574] conn(0x7fe41c076320 0x7fe41c078830 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:20.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:20.281+0000 7fe442c27640 1 --2- 172.21.15.1:0/3051018899 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe43c15cdf0 0x7fe43c14f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:20.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:20.281+0000 7fe442c27640 1 --2- 172.21.15.1:0/3051018899 >> [v2:172.21.15.107:3301/0,v1:172.21.15.107:6790/0] conn(0x7fe43c15c4a0 0x7fe43c14eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:20.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:20.281+0000 7fe442c27640 1 --2- 172.21.15.1:0/3051018899 >> [v2:172.21.15.1:3300/0,v1:172.21.15.1:6789/0] conn(0x7fe43c0cdcf0 0x7fe43c1e6f10 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-04T02:49:20.283 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:20.281+0000 7fe442c27640 1 -- 172.21.15.1:0/3051018899 >> 172.21.15.1:0/3051018899 conn(0x7fe43c0ce960 msgr2=0x7fe43c08df60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-04T02:49:20.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:20.281+0000 7fe442c27640 1 -- 172.21.15.1:0/3051018899 shutdown_connections 2024-05-04T02:49:20.284 INFO:teuthology.orchestra.run.smithi001.stderr:2024-05-04T02:49:20.281+0000 7fe442c27640 1 -- 172.21.15.1:0/3051018899 wait complete. 2024-05-04T02:49:20.298 INFO:teuthology.misc:Shutting down mds daemons... 2024-05-04T02:49:20.298 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-04T02:49:20.298 INFO:teuthology.orchestra.run:waiting for 300 2024-05-04T02:49:20.316 INFO:tasks.ceph.mds.a.smithi001.stderr:2024-05-04T02:49:20.302+0000 f85d640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i a (PID: 38894) UID: 0 2024-05-04T02:49:20.317 INFO:tasks.ceph.mds.a.smithi001.stderr:2024-05-04T02:49:20.304+0000 f85d640 -1 mds.a *** got signal Terminated *** 2024-05-04T02:49:22.282 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-05-04T02:49:26.400 INFO:tasks.ceph.mds.a:Stopped 2024-05-04T02:49:26.401 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-04T02:49:26.401 INFO:teuthology.orchestra.run:waiting for 300 2024-05-04T02:49:26.418 INFO:tasks.ceph.mds.c.smithi001.stderr:2024-05-04T02:49:26.404+0000 f85d640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i c (PID: 38905) UID: 0 2024-05-04T02:49:26.418 INFO:tasks.ceph.mds.c.smithi001.stderr:2024-05-04T02:49:26.406+0000 f85d640 -1 mds.c *** got signal Terminated *** 2024-05-04T02:49:28.995 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~7s 2024-05-04T02:49:29.268 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:49:29.271 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:49:32.503 INFO:tasks.ceph.mds.c:Stopped 2024-05-04T02:49:32.503 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-05-04T02:49:32.503 INFO:teuthology.orchestra.run:waiting for 300 2024-05-04T02:49:32.521 INFO:tasks.ceph.mds.e.smithi001.stderr:2024-05-04T02:49:32.507+0000 f85d640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.e.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i e (PID: 38906) UID: 0 2024-05-04T02:49:32.521 INFO:tasks.ceph.mds.e.smithi001.stderr:2024-05-04T02:49:32.509+0000 f85d640 -1 mds.e *** got signal Terminated *** 2024-05-04T02:49:35.609 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~14s 2024-05-04T02:49:38.604 INFO:tasks.ceph.mds.e:Stopped 2024-05-04T02:49:38.605 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-04T02:49:38.605 INFO:teuthology.orchestra.run:waiting for 300 2024-05-04T02:49:38.620 INFO:tasks.ceph.mds.b.smithi107.stderr:2024-05-04T02:49:38.608+0000 f85d640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i b (PID: 39183) UID: 0 2024-05-04T02:49:38.621 INFO:tasks.ceph.mds.b.smithi107.stderr:2024-05-04T02:49:38.609+0000 f85d640 -1 mds.b *** got signal Terminated *** 2024-05-04T02:49:42.021 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-05-04T02:49:42.021 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~20s 2024-05-04T02:49:44.707 INFO:tasks.ceph.mds.b:Stopped 2024-05-04T02:49:44.707 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-04T02:49:44.707 INFO:teuthology.orchestra.run:waiting for 300 2024-05-04T02:49:44.707 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-05-04T02:49:44.707 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi107 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.d.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i d" 2024-05-04T02:49:44.708 INFO:tasks.ceph.mds.d:Stopped 2024-05-04T02:49:44.708 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2024-05-04T02:49:44.708 INFO:teuthology.orchestra.run:waiting for 300 2024-05-04T02:49:44.733 INFO:tasks.ceph.mds.f.smithi107.stderr:2024-05-04T02:49:44.713+0000 f85d640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.f.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-mds -f --cluster ceph -i f (PID: 39187) UID: 0 2024-05-04T02:49:44.733 INFO:tasks.ceph.mds.f.smithi107.stderr:2024-05-04T02:49:44.715+0000 f85d640 -1 mds.f *** got signal Terminated *** 2024-05-04T02:49:48.432 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2024-05-04T02:49:48.432 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-05-04T02:49:50.810 INFO:tasks.ceph.mds.f:Stopped 2024-05-04T02:49:50.811 INFO:teuthology.misc:Shutting down osd daemons... 2024-05-04T02:49:50.811 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-05-04T02:49:50.811 INFO:teuthology.orchestra.run:waiting for 300 2024-05-04T02:49:50.812 INFO:tasks.ceph.osd.0.smithi001.stderr:2024-05-04T02:49:50.811+0000 7f607f310640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 0 (PID: 35275) UID: 0 2024-05-04T02:49:50.812 INFO:tasks.ceph.osd.0.smithi001.stderr:2024-05-04T02:49:50.811+0000 7f607f310640 -1 osd.0 33 *** Got signal Terminated *** 2024-05-04T02:49:54.641 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-05-04T02:49:56.912 INFO:tasks.ceph.osd.0:Stopped 2024-05-04T02:49:56.913 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-05-04T02:49:56.913 INFO:teuthology.orchestra.run:waiting for 300 2024-05-04T02:49:56.914 INFO:tasks.ceph.osd.1.smithi001.stderr:2024-05-04T02:49:56.913+0000 7f79c1708640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 1 (PID: 35280) UID: 0 2024-05-04T02:49:56.914 INFO:tasks.ceph.osd.1.smithi001.stderr:2024-05-04T02:49:56.913+0000 7f79c1708640 -1 osd.1 35 *** Got signal Terminated *** 2024-05-04T02:49:59.336 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:49:59.339 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:50:00.750 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-05-04T02:50:00.750 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-05-04T02:50:03.014 INFO:tasks.ceph.osd.1:Stopped 2024-05-04T02:50:03.015 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-05-04T02:50:03.015 INFO:teuthology.orchestra.run:waiting for 300 2024-05-04T02:50:03.015 INFO:tasks.ceph.osd.2.smithi001.stderr:2024-05-04T02:50:03.015+0000 7fc37f1ce640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 2 (PID: 35278) UID: 0 2024-05-04T02:50:03.015 INFO:tasks.ceph.osd.2.smithi001.stderr:2024-05-04T02:50:03.015+0000 7fc37f1ce640 -1 osd.2 36 *** Got signal Terminated *** 2024-05-04T02:50:06.758 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-05-04T02:50:06.758 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-05-04T02:50:09.116 INFO:tasks.ceph.osd.2:Stopped 2024-05-04T02:50:09.116 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-05-04T02:50:09.116 INFO:teuthology.orchestra.run:waiting for 300 2024-05-04T02:50:09.117 INFO:tasks.ceph.osd.3.smithi001.stderr:2024-05-04T02:50:09.117+0000 7fdc98ed1640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 3 (PID: 35283) UID: 0 2024-05-04T02:50:09.117 INFO:tasks.ceph.osd.3.smithi001.stderr:2024-05-04T02:50:09.117+0000 7fdc98ed1640 -1 osd.3 37 *** Got signal Terminated *** 2024-05-04T02:50:12.666 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-05-04T02:50:12.666 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-05-04T02:50:15.219 INFO:tasks.ceph.osd.3:Stopped 2024-05-04T02:50:15.219 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-05-04T02:50:15.219 INFO:teuthology.orchestra.run:waiting for 300 2024-05-04T02:50:15.220 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-04T02:50:15.219+0000 7fc089c5e640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 4 (PID: 35453) UID: 0 2024-05-04T02:50:15.220 INFO:tasks.ceph.osd.4.smithi107.stderr:2024-05-04T02:50:15.219+0000 7fc089c5e640 -1 osd.4 38 *** Got signal Terminated *** 2024-05-04T02:50:18.473 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-05-04T02:50:18.473 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-05-04T02:50:21.321 INFO:tasks.ceph.osd.4:Stopped 2024-05-04T02:50:21.321 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-05-04T02:50:21.321 INFO:teuthology.orchestra.run:waiting for 300 2024-05-04T02:50:21.322 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-04T02:50:21.321+0000 7ff4ffb95640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 5 (PID: 35457) UID: 0 2024-05-04T02:50:21.322 INFO:tasks.ceph.osd.5.smithi107.stderr:2024-05-04T02:50:21.321+0000 7ff4ffb95640 -1 osd.5 39 *** Got signal Terminated *** 2024-05-04T02:50:24.178 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-05-04T02:50:24.178 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-05-04T02:50:27.422 INFO:tasks.ceph.osd.5:Stopped 2024-05-04T02:50:27.423 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-05-04T02:50:27.423 INFO:teuthology.orchestra.run:waiting for 300 2024-05-04T02:50:27.424 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-04T02:50:27.423+0000 7fea35b50640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 6 (PID: 35460) UID: 0 2024-05-04T02:50:27.424 INFO:tasks.ceph.osd.6.smithi107.stderr:2024-05-04T02:50:27.423+0000 7fea35b50640 -1 osd.6 40 *** Got signal Terminated *** 2024-05-04T02:50:29.483 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:50:29.487 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:50:29.783 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-05-04T02:50:29.783 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-05-04T02:50:33.525 INFO:tasks.ceph.osd.6:Stopped 2024-05-04T02:50:33.525 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-05-04T02:50:33.525 INFO:teuthology.orchestra.run:waiting for 300 2024-05-04T02:50:33.526 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-04T02:50:33.525+0000 7f564678d640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-osd -f --cluster ceph -i 7 (PID: 35461) UID: 0 2024-05-04T02:50:33.526 INFO:tasks.ceph.osd.7.smithi107.stderr:2024-05-04T02:50:33.525+0000 7f564678d640 -1 osd.7 40 *** Got signal Terminated *** 2024-05-04T02:50:35.288 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-05-04T02:50:35.288 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-05-04T02:50:39.627 INFO:tasks.ceph.osd.7:Stopped 2024-05-04T02:50:39.627 INFO:teuthology.misc:Shutting down mgr daemons... 2024-05-04T02:50:39.627 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-05-04T02:50:39.628 INFO:teuthology.orchestra.run:waiting for 300 2024-05-04T02:50:39.655 INFO:tasks.ceph.mgr.y:Stopped 2024-05-04T02:50:39.655 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-05-04T02:50:39.655 INFO:teuthology.orchestra.run:waiting for 300 2024-05-04T02:50:39.656 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-04T02:50:39.655+0000 7f0b3ee29640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-mgr -f --cluster ceph -i x (PID: 34875) UID: 0 2024-05-04T02:50:39.656 INFO:tasks.ceph.mgr.x.smithi107.stderr:2024-05-04T02:50:39.655+0000 7f0b3ee29640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-05-04T02:50:39.686 INFO:tasks.ceph.mgr.x:Stopped 2024-05-04T02:50:39.686 INFO:teuthology.misc:Shutting down mon daemons... 2024-05-04T02:50:39.686 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-05-04T02:50:39.686 INFO:teuthology.orchestra.run:waiting for 300 2024-05-04T02:50:39.714 INFO:tasks.ceph.mon.a.smithi001.stderr:2024-05-04T02:50:39.698+0000 e22b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a (PID: 35001) UID: 0 2024-05-04T02:50:39.715 INFO:tasks.ceph.mon.a.smithi001.stderr:2024-05-04T02:50:39.700+0000 e22b640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-05-04T02:50:40.298 INFO:tasks.ceph.mon.a.smithi001.stderr:==00:00:31:13.656 35030== 2024-05-04T02:50:40.298 INFO:tasks.ceph.mon.a.smithi001.stderr:==00:00:31:13.656 35030== Exit program on first error (--exit-on-first-error=yes) 2024-05-04T02:50:40.313 INFO:tasks.ceph.mon.a.smithi001.stderr:daemon-helper: command failed with exit status 42 2024-05-04T02:50:40.521 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-05-04T02:50:40.521 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-05-04T02:50:45.724 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~5s 2024-05-04T02:50:45.788 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-05-04T02:50:45.789 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi001 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a" 2024-05-04T02:50:45.789 INFO:tasks.ceph.mon.a:Stopped 2024-05-04T02:50:45.789 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-05-04T02:50:45.790 INFO:teuthology.orchestra.run:waiting for 300 2024-05-04T02:50:45.809 INFO:tasks.ceph.mon.b.smithi107.stderr:2024-05-04T02:50:45.793+0000 e22b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b (PID: 34870) UID: 0 2024-05-04T02:50:45.809 INFO:tasks.ceph.mon.b.smithi107.stderr:2024-05-04T02:50:45.795+0000 e22b640 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2024-05-04T02:50:46.338 INFO:tasks.ceph.mon.b.smithi107.stderr:==00:00:31:19.667 34877== 2024-05-04T02:50:46.339 INFO:tasks.ceph.mon.b.smithi107.stderr:==00:00:31:19.667 34877== Exit program on first error (--exit-on-first-error=yes) 2024-05-04T02:50:46.351 INFO:tasks.ceph.mon.b.smithi107.stderr:daemon-helper: command failed with exit status 42 2024-05-04T02:50:50.826 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-05-04T02:50:50.827 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2024-05-04T02:50:51.891 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-05-04T02:50:51.892 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi107 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b" 2024-05-04T02:50:51.892 INFO:tasks.ceph.mon.b:Stopped 2024-05-04T02:50:51.892 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-05-04T02:50:51.893 INFO:teuthology.orchestra.run:waiting for 300 2024-05-04T02:50:51.913 INFO:tasks.ceph.mon.c.smithi107.stderr:2024-05-04T02:50:51.896+0000 e22b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c (PID: 34872) UID: 0 2024-05-04T02:50:51.914 INFO:tasks.ceph.mon.c.smithi107.stderr:2024-05-04T02:50:51.898+0000 e22b640 -1 mon.c@2(probing) e1 *** Got Signal Terminated *** 2024-05-04T02:50:52.463 INFO:tasks.ceph.mon.c.smithi107.stderr:==00:00:31:25.792 34878== 2024-05-04T02:50:52.464 INFO:tasks.ceph.mon.c.smithi107.stderr:==00:00:31:25.792 34878== Exit program on first error (--exit-on-first-error=yes) 2024-05-04T02:50:52.478 INFO:tasks.ceph.mon.c.smithi107.stderr:daemon-helper: command failed with exit status 42 2024-05-04T02:50:55.827 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-05-04T02:50:55.827 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-05-04T02:50:57.994 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-05-04T02:50:57.995 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi107 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c" 2024-05-04T02:50:57.995 INFO:tasks.ceph.mon.c:Stopped 2024-05-04T02:50:57.995 INFO:tasks.ceph:Checking cluster log for badness... 2024-05-04T02:50:57.996 DEBUG:teuthology.orchestra.run.smithi001:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow request' | egrep -v SLOW_OPS | egrep -v MON_DOWN | head -n 1 2024-05-04T02:50:58.042 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi001.front.sepia.ceph.com 2024-05-04T02:50:58.042 DEBUG:teuthology.orchestra.run.smithi001:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-05-04T02:50:58.159 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi001.front.sepia.ceph.com 2024-05-04T02:50:58.159 DEBUG:teuthology.orchestra.run.smithi001:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-05-04T02:50:58.215 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi001.front.sepia.ceph.com 2024-05-04T02:50:58.216 DEBUG:teuthology.orchestra.run.smithi001:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-05-04T02:50:58.274 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi001.front.sepia.ceph.com 2024-05-04T02:50:58.274 DEBUG:teuthology.orchestra.run.smithi001:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-05-04T02:50:58.367 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi107.front.sepia.ceph.com 2024-05-04T02:50:58.367 DEBUG:teuthology.orchestra.run.smithi107:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-05-04T02:50:58.523 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi107.front.sepia.ceph.com 2024-05-04T02:50:58.523 DEBUG:teuthology.orchestra.run.smithi107:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-05-04T02:50:58.605 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi107.front.sepia.ceph.com 2024-05-04T02:50:58.605 DEBUG:teuthology.orchestra.run.smithi107:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-05-04T02:50:58.663 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi107.front.sepia.ceph.com 2024-05-04T02:50:58.663 DEBUG:teuthology.orchestra.run.smithi107:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-05-04T02:50:58.721 INFO:tasks.ceph:Archiving mon data... 2024-05-04T02:50:58.723 DEBUG:teuthology.misc:Transferring archived files from smithi001:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2024-05-03_22:48:16-fs-wip-pdonnell-testing-20240503.163550-debug-distro-default-smithi/7688562/data/mon.a.tgz 2024-05-04T02:50:58.723 DEBUG:teuthology.orchestra.run.smithi001:> mktemp 2024-05-04T02:50:58.740 INFO:teuthology.orchestra.run.smithi001.stdout:/tmp/tmp.Xi9HEnzqLF 2024-05-04T02:50:58.740 DEBUG:teuthology.orchestra.run.smithi001:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.Xi9HEnzqLF 2024-05-04T02:50:58.878 DEBUG:teuthology.orchestra.run.smithi001:> sudo chmod 0666 /tmp/tmp.Xi9HEnzqLF 2024-05-04T02:50:58.961 DEBUG:teuthology.orchestra.remote:smithi001:/tmp/tmp.Xi9HEnzqLF is 334KB 2024-05-04T02:50:59.057 DEBUG:teuthology.orchestra.run.smithi001:> rm -fr /tmp/tmp.Xi9HEnzqLF 2024-05-04T02:50:59.071 DEBUG:teuthology.misc:Transferring archived files from smithi107:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2024-05-03_22:48:16-fs-wip-pdonnell-testing-20240503.163550-debug-distro-default-smithi/7688562/data/mon.b.tgz 2024-05-04T02:50:59.072 DEBUG:teuthology.orchestra.run.smithi107:> mktemp 2024-05-04T02:50:59.088 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/tmp.SVvl1X5Qib 2024-05-04T02:50:59.088 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.SVvl1X5Qib 2024-05-04T02:50:59.257 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 0666 /tmp/tmp.SVvl1X5Qib 2024-05-04T02:50:59.338 DEBUG:teuthology.orchestra.remote:smithi107:/tmp/tmp.SVvl1X5Qib is 356KB 2024-05-04T02:50:59.434 DEBUG:teuthology.orchestra.run.smithi107:> rm -fr /tmp/tmp.SVvl1X5Qib 2024-05-04T02:50:59.448 DEBUG:teuthology.misc:Transferring archived files from smithi107:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2024-05-03_22:48:16-fs-wip-pdonnell-testing-20240503.163550-debug-distro-default-smithi/7688562/data/mon.c.tgz 2024-05-04T02:50:59.448 DEBUG:teuthology.orchestra.run.smithi107:> mktemp 2024-05-04T02:50:59.502 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/tmp.6u7CnbpxDo 2024-05-04T02:50:59.503 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.6u7CnbpxDo 2024-05-04T02:50:59.605 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:50:59.607 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:50:59.630 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 0666 /tmp/tmp.6u7CnbpxDo 2024-05-04T02:50:59.787 DEBUG:teuthology.orchestra.remote:smithi107:/tmp/tmp.6u7CnbpxDo is 356KB 2024-05-04T02:50:59.883 DEBUG:teuthology.orchestra.run.smithi107:> rm -fr /tmp/tmp.6u7CnbpxDo 2024-05-04T02:50:59.897 INFO:tasks.ceph:Cleaning ceph cluster... 2024-05-04T02:50:59.897 DEBUG:teuthology.orchestra.run.smithi001:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-04T02:50:59.899 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-04T02:51:00.171 DEBUG:tasks.ceph:valgrind exception message: valgrind error: Leak_StillReachable malloc malloc strdup 2024-05-04T02:51:00.434 INFO:tasks.ceph:Archiving crash dumps... 2024-05-04T02:51:00.436 DEBUG:teuthology.misc:Transferring archived files from smithi001:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-05-03_22:48:16-fs-wip-pdonnell-testing-20240503.163550-debug-distro-default-smithi/7688562/remote/smithi001/crash 2024-05-04T02:51:00.437 DEBUG:teuthology.orchestra.run.smithi001:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-04T02:51:00.467 DEBUG:teuthology.misc:Transferring archived files from smithi107:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-05-03_22:48:16-fs-wip-pdonnell-testing-20240503.163550-debug-distro-default-smithi/7688562/remote/smithi107/crash 2024-05-04T02:51:00.468 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-04T02:51:00.490 INFO:tasks.ceph:Shutting down logrotate 2024-05-04T02:51:00.490 DEBUG:teuthology.orchestra.run.smithi001:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:51:00.509 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-04T02:51:00.584 DEBUG:teuthology.orchestra.run.smithi001:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-04T02:51:00.611 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-04T02:51:00.635 INFO:tasks.ceph:Compressing logs... 2024-05-04T02:51:00.635 DEBUG:teuthology.orchestra.run.smithi001:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-04T02:51:00.654 DEBUG:teuthology.orchestra.run.smithi107:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-04T02:51:00.699 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39134.log 2024-05-04T02:51:00.699 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44254.log 2024-05-04T02:51:00.700 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.39134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39712.log 2024-05-04T02:51:00.700 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.44254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40017.log 2024-05-04T02:51:00.700 INFO:teuthology.orchestra.run.smithi001.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.39134.log.gz 2024-05-04T02:51:00.700 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.39712.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44254.log.gz 2024-05-04T02:51:00.700 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39754.log 2024-05-04T02:51:00.700 INFO:teuthology.orchestra.run.smithi001.stderr: 87.4%/var/log/ceph/ceph-client.admin.40017.log: -- replaced with /var/log/ceph/ceph-client.admin.39712.log.gz 2024-05-04T02:51:00.700 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44818.log 2024-05-04T02:51:00.700 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.39754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44692.log 2024-05-04T02:51:00.700 INFO:teuthology.orchestra.run.smithi001.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40017.log.gz 2024-05-04T02:51:00.700 INFO:teuthology.orchestra.run.smithi001.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.39754.log.gz 2024-05-04T02:51:00.700 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.44818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41008.log 2024-05-04T02:51:00.700 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45044.log 2024-05-04T02:51:00.700 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.44692.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.44818.log.gz 2024-05-04T02:51:00.700 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.41008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39302.log 2024-05-04T02:51:00.700 INFO:teuthology.orchestra.run.smithi001.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44692.log.gz 2024-05-04T02:51:00.700 INFO:teuthology.orchestra.run.smithi001.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41008.log.gz 2024-05-04T02:51:00.701 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.45044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39670.log 2024-05-04T02:51:00.701 INFO:teuthology.orchestra.run.smithi001.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45044.log.gz 2024-05-04T02:51:00.701 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.39302.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-04T02:51:00.701 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.39670.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.39302.log.gz 2024-05-04T02:51:00.701 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40013.log 2024-05-04T02:51:00.701 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39670.log.gz 2024-05-04T02:51:00.701 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40020.log 2024-05-04T02:51:00.701 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41140.log 2024-05-04T02:51:00.701 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.40013.log: /var/log/ceph/ceph-client.admin.40020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44960.log 2024-05-04T02:51:00.701 INFO:teuthology.orchestra.run.smithi001.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40013.log.gz 2024-05-04T02:51:00.701 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.41140.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40020.log.gz 2024-05-04T02:51:00.701 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41971.log 2024-05-04T02:51:00.701 INFO:teuthology.orchestra.run.smithi001.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41140.log.gz 2024-05-04T02:51:00.701 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.44960.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-05-04T02:51:00.702 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.0.41971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41434.log 2024-05-04T02:51:00.702 INFO:teuthology.orchestra.run.smithi001.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44960.log.gz 2024-05-04T02:51:00.702 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40015.log 2024-05-04T02:51:00.702 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.41434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44464.log 2024-05-04T02:51:00.702 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.40015.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-04T02:51:00.702 INFO:teuthology.orchestra.run.smithi001.stderr: 87.9% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-04T02:51:00.702 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.44464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44776.log 2024-05-04T02:51:00.702 INFO:teuthology.orchestra.run.smithi001.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.41434.log.gz 2024-05-04T02:51:00.702 INFO:teuthology.orchestra.run.smithi001.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40015.log.gz 2024-05-04T02:51:00.702 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44920.log 2024-05-04T02:51:00.702 INFO:teuthology.orchestra.run.smithi001.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44464.log.gz 2024-05-04T02:51:00.702 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.44776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44170.log 2024-05-04T02:51:00.702 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.44920.log: gzip -5 --verbose 87.1% -- /var/log/ceph/ceph-client.admin.38912.log -- replaced with /var/log/ceph/ceph-client.admin.44776.log.gz 2024-05-04T02:51:00.703 INFO:teuthology.orchestra.run.smithi001.stderr: 2024-05-04T02:51:00.703 INFO:teuthology.orchestra.run.smithi001.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44920.log.gz 2024-05-04T02:51:00.703 INFO:teuthology.orchestra.run.smithi001.stderr: 89.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-04T02:51:00.703 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.44170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39439.log 2024-05-04T02:51:00.703 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44548.log 2024-05-04T02:51:00.703 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.38912.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44170.log.gz 2024-05-04T02:51:00.703 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41182.log 2024-05-04T02:51:00.703 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.39439.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38912.log.gz 2024-05-04T02:51:00.703 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.44548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40682.log 2024-05-04T02:51:00.703 INFO:teuthology.orchestra.run.smithi001.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.39439.log.gz 2024-05-04T02:51:00.703 INFO:teuthology.orchestra.run.smithi001.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44548.log.gz 2024-05-04T02:51:00.703 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.41182.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-05-04T02:51:00.703 INFO:teuthology.orchestra.run.smithi001.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41182.log.gz 2024-05-04T02:51:00.703 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38796.log 2024-05-04T02:51:00.703 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.40682.log: /var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-05-04T02:51:00.704 INFO:teuthology.orchestra.run.smithi001.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40682.log.gz 2024-05-04T02:51:00.704 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.38796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41350.log 2024-05-04T02:51:00.704 INFO:teuthology.orchestra.run.smithi001.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38796.log.gz 2024-05-04T02:51:00.704 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44590.log 2024-05-04T02:51:00.704 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.41350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44212.log 2024-05-04T02:51:00.704 INFO:teuthology.orchestra.run.smithi001.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41350.log.gz 2024-05-04T02:51:00.704 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.44590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38989.log 2024-05-04T02:51:00.704 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.44212.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44590.log.gz 2024-05-04T02:51:00.704 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41308.log 2024-05-04T02:51:00.704 INFO:teuthology.orchestra.run.smithi001.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44212.log.gz 2024-05-04T02:51:00.704 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.38989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40300.log 2024-05-04T02:51:00.704 INFO:teuthology.orchestra.run.smithi001.stderr:gzip 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38989.log.gz 2024-05-04T02:51:00.704 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.41308.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.35040.log 2024-05-04T02:51:00.704 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.40300.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41308.log.gz 2024-05-04T02:51:00.704 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39390.log 2024-05-04T02:51:00.704 INFO:teuthology.orchestra.run.smithi001.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40300.log.gz 2024-05-04T02:51:00.705 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.35040.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-05-04T02:51:00.705 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.39390.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-05-04T02:51:00.705 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-osd.1.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39390.log.gz 2024-05-04T02:51:00.705 INFO:teuthology.orchestra.run.smithi001.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.35040.log.gz 2024-05-04T02:51:00.705 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40327.log 2024-05-04T02:51:00.705 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-05-04T02:51:00.705 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.40327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44002.log 2024-05-04T02:51:00.705 INFO:teuthology.orchestra.run.smithi001.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40327.log.gz 2024-05-04T02:51:00.705 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-osd.0.log: 92.4% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-05-04T02:51:00.705 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40552.log 2024-05-04T02:51:00.705 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.44002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39525.log 2024-05-04T02:51:00.705 INFO:teuthology.orchestra.run.smithi001.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44002.log.gz 2024-05-04T02:51:00.705 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.40552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44860.log 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40552.log.gz 2024-05-04T02:51:00.705 INFO:teuthology.orchestra.run.smithi001.stderr: 2024-05-04T02:51:00.705 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40014.log 2024-05-04T02:51:00.705 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.44860.log: /var/log/ceph/ceph-client.admin.39525.log: 87.8% 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39525.log.gz 2024-05-04T02:51:00.706 INFO:teuthology.orchestra.run.smithi001.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44860.log.gz 2024-05-04T02:51:00.706 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40238.log 2024-05-04T02:51:00.706 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40888.log 2024-05-04T02:51:00.706 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.40238.log: /var/log/ceph/ceph-client.admin.40014.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40014.log.gz 2024-05-04T02:51:00.706 INFO:teuthology.orchestra.run.smithi001.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40238.log.gz 2024-05-04T02:51:00.706 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39482.log 2024-05-04T02:51:00.706 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44086.log 2024-05-04T02:51:00.706 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.39482.log: /var/log/ceph/ceph-client.admin.40888.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.40888.log.gz 2024-05-04T02:51:00.706 INFO:teuthology.orchestra.run.smithi001.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39482.log.gz 2024-05-04T02:51:00.706 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40607.log 2024-05-04T02:51:00.706 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.e.log 2024-05-04T02:51:00.738 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-04T02:51:00.738 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35240.log 2024-05-04T02:51:00.738 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.f.log 2024-05-04T02:51:00.738 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.35240.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-04T02:51:00.738 INFO:teuthology.orchestra.run.smithi107.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35240.log.gz 2024-05-04T02:51:00.739 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-05-04T02:51:00.739 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-05-04T02:51:00.739 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-05-04T02:51:00.739 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35320.log 2024-05-04T02:51:00.739 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-05-04T02:51:00.739 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.35320.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-05-04T02:51:00.739 INFO:teuthology.orchestra.run.smithi107.stderr: 93.7% 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35320.log.gz 2024-05-04T02:51:00.739 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-osd.4.log: -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-04T02:51:00.739 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35120.log 2024-05-04T02:51:00.739 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-05-04T02:51:00.739 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.35120.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.35120.log.gz 2024-05-04T02:51:00.739 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mon.b.log 2024-05-04T02:51:00.739 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-mon.c.log: 93.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-04T02:51:00.739 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.d.log 2024-05-04T02:51:00.739 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/valgrind/mon.b.log: 69.9% -- replaced with /var/log/ceph/valgrind/mon.b.log.gz 2024-05-04T02:51:00.740 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.f.log 2024-05-04T02:51:00.740 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/valgrind/mds.d.log: 67.7% -- replaced with /var/log/ceph/valgrind/mds.d.log.gz 2024-05-04T02:51:00.740 INFO:teuthology.orchestra.run.smithi107.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mds.f.log.gz 2024-05-04T02:51:00.740 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mon.c.log 2024-05-04T02:51:00.740 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/valgrind/mds.f.log: gzip -5 --verbose 57.2% -- replaced with /var/log/ceph/valgrind/mds.f.log.gz 2024-05-04T02:51:00.740 INFO:teuthology.orchestra.run.smithi107.stderr: -- /var/log/ceph/valgrind/mds.b.log 2024-05-04T02:51:00.740 INFO:teuthology.orchestra.run.smithi107.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-05-04T02:51:00.740 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-05-04T02:51:00.740 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/valgrind/mon.c.log: /var/log/ceph/valgrind/mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35069.log 2024-05-04T02:51:00.740 INFO:teuthology.orchestra.run.smithi107.stderr: 57.3% -- replaced with /var/log/ceph/valgrind/mds.b.log.gz 2024-05-04T02:51:00.740 INFO:teuthology.orchestra.run.smithi107.stderr: 69.9% -- replaced with /var/log/ceph/valgrind/mon.c.log.gz 2024-05-04T02:51:00.740 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35280.log 2024-05-04T02:51:00.740 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.35069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35360.log 2024-05-04T02:51:00.740 INFO:teuthology.orchestra.run.smithi107.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35069.log.gz 2024-05-04T02:51:00.740 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.35280.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35280.log.gz 2024-05-04T02:51:00.740 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35200.log 2024-05-04T02:51:00.741 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.35360.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-05-04T02:51:00.741 INFO:teuthology.orchestra.run.smithi107.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.35360.log.gz 2024-05-04T02:51:00.741 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-client.admin.35200.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35200.log.gz 2024-05-04T02:51:00.741 INFO:teuthology.orchestra.run.smithi107.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-05-04T02:51:00.741 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35160.log 2024-05-04T02:51:00.741 INFO:teuthology.orchestra.run.smithi107.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-client.admin.35160.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35160.log.gz 2024-05-04T02:51:00.746 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.40607.log: /var/log/ceph/ceph-client.admin.44086.log: 87.8% 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44086.log.gz 2024-05-04T02:51:00.746 INFO:teuthology.orchestra.run.smithi001.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40607.log.gz 2024-05-04T02:51:00.746 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mon.a.log 2024-05-04T02:51:00.746 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.c.log 2024-05-04T02:51:00.747 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/valgrind/mon.a.log: /var/log/ceph/valgrind/mds.e.log: 57.2% -- replaced with /var/log/ceph/valgrind/mds.e.log.gz 2024-05-04T02:51:00.747 INFO:teuthology.orchestra.run.smithi001.stderr: 69.9% -- replaced with /var/log/ceph/valgrind/mon.a.log.gz 2024-05-04T02:51:00.747 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/client.0.log 2024-05-04T02:51:00.747 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.a.log 2024-05-04T02:51:00.747 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/valgrind/client.0.log: /var/log/ceph/valgrind/mds.c.log: 57.3% -- replaced with /var/log/ceph/valgrind/mds.c.log.gz 2024-05-04T02:51:00.747 INFO:teuthology.orchestra.run.smithi001.stderr: 76.5% -- replaced with /var/log/ceph/valgrind/client.0.log.gz 2024-05-04T02:51:00.747 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44632.log 2024-05-04T02:51:00.747 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45254.log 2024-05-04T02:51:00.747 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.44632.log: /var/log/ceph/valgrind/mds.a.log: 57.2% -- replaced with /var/log/ceph/valgrind/mds.a.log.gz 2024-05-04T02:51:00.747 INFO:teuthology.orchestra.run.smithi001.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44632.log.gz 2024-05-04T02:51:00.747 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44128.log 2024-05-04T02:51:00.747 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.45254.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45254.log.gz 2024-05-04T02:51:00.747 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40018.log 2024-05-04T02:51:00.748 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41392.log 2024-05-04T02:51:00.748 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.40018.log: /var/log/ceph/ceph-client.admin.44128.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44128.log.gz 2024-05-04T02:51:00.748 INFO:teuthology.orchestra.run.smithi001.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40018.log.gz 2024-05-04T02:51:00.748 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44380.log 2024-05-04T02:51:00.748 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45128.log 2024-05-04T02:51:00.748 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.44380.log: /var/log/ceph/ceph-client.admin.41392.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41392.log.gz 2024-05-04T02:51:00.748 INFO:teuthology.orchestra.run.smithi001.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44380.log.gz 2024-05-04T02:51:00.748 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40019.log 2024-05-04T02:51:00.748 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-05-04T02:51:00.748 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.40019.log: /var/log/ceph/ceph-client.admin.45128.log: 87.9% 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45128.log.gz 2024-05-04T02:51:00.748 INFO:teuthology.orchestra.run.smithi001.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40019.log.gz 2024-05-04T02:51:00.748 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39059.log 2024-05-04T02:51:00.748 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41068.log 2024-05-04T02:51:00.748 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.39059.log: /var/log/ceph/ceph-mon.a.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39059.log.gz 2024-05-04T02:51:00.748 INFO:teuthology.orchestra.run.smithi001.stderr: 94.9% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-05-04T02:51:00.749 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40612.log 2024-05-04T02:51:00.749 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.41068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40823.log 2024-05-04T02:51:00.749 INFO:teuthology.orchestra.run.smithi001.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41068.log.gz 2024-05-04T02:51:00.749 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.40612.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40612.log.gz 2024-05-04T02:51:00.749 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44734.log 2024-05-04T02:51:00.749 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39796.log 2024-05-04T02:51:00.749 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.40823.log: /var/log/ceph/ceph-client.admin.44734.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40823.log.gz 2024-05-04T02:51:00.749 INFO:teuthology.orchestra.run.smithi001.stderr: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45212.log 2024-05-04T02:51:00.749 INFO:teuthology.orchestra.run.smithi001.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44734.log.gz 2024-05-04T02:51:00.749 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.39796.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.39796.log.gz 2024-05-04T02:51:00.749 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40633.log 2024-05-04T02:51:00.749 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45170.log 2024-05-04T02:51:00.749 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.40633.log: /var/log/ceph/ceph-client.admin.45212.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40633.log.gz 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45212.log.gz 2024-05-04T02:51:00.749 INFO:teuthology.orchestra.run.smithi001.stderr: 2024-05-04T02:51:00.749 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44506.log 2024-05-04T02:51:00.750 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40208.log 2024-05-04T02:51:00.750 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.44506.log: /var/log/ceph/ceph-client.admin.45170.log: 87.1% 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45170.log.gz 2024-05-04T02:51:00.750 INFO:teuthology.orchestra.run.smithi001.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44506.log.gz 2024-05-04T02:51:00.750 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43960.log 2024-05-04T02:51:00.750 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39176.log 2024-05-04T02:51:00.750 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.40208.log: /var/log/ceph/ceph-client.admin.43960.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40208.log.gz 2024-05-04T02:51:00.750 INFO:teuthology.orchestra.run.smithi001.stderr: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40770.log 2024-05-04T02:51:00.750 INFO:teuthology.orchestra.run.smithi001.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43960.log.gz 2024-05-04T02:51:00.750 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.39176.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39176.log.gz 2024-05-04T02:51:00.750 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41536.log 2024-05-04T02:51:00.750 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.e.log 2024-05-04T02:51:00.750 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.40770.log: /var/log/ceph/ceph-client.admin.41536.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40770.log.gz 2024-05-04T02:51:00.750 INFO:teuthology.orchestra.run.smithi001.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41536.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39260.log 2024-05-04T02:51:00.750 INFO:teuthology.orchestra.run.smithi001.stderr: 2024-05-04T02:51:00.750 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-mds.e.log: 92.7% -- replaced with /var/log/ceph/ceph-mds.e.log.gz 2024-05-04T02:51:00.751 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41224.log 2024-05-04T02:51:00.751 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39610.log 2024-05-04T02:51:00.751 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.39260.log: /var/log/ceph/ceph-client.admin.41224.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.39260.log.gz 2024-05-04T02:51:00.751 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41266.log 2024-05-04T02:51:00.751 INFO:teuthology.orchestra.run.smithi001.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41224.log.gz 2024-05-04T02:51:00.751 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.39610.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39610.log.gz 2024-05-04T02:51:00.751 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44338.log 2024-05-04T02:51:00.751 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39218.log 2024-05-04T02:51:00.751 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.41266.log: /var/log/ceph/ceph-client.admin.44338.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41266.log.gz 2024-05-04T02:51:00.751 INFO:teuthology.orchestra.run.smithi001.stderr: 87.4%gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.29014.log 2024-05-04T02:51:00.751 INFO:teuthology.orchestra.run.smithi001.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44338.log.gz 2024-05-04T02:51:00.757 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.39218.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.39218.log.gz 2024-05-04T02:51:00.757 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40337.log 2024-05-04T02:51:00.758 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40740.log 2024-05-04T02:51:00.758 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph.tmp-client.admin.29014.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.29014.log.gz 2024-05-04T02:51:00.758 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.40337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35433.log 2024-05-04T02:51:00.758 INFO:teuthology.orchestra.run.smithi001.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40337.log.gz 2024-05-04T02:51:00.758 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.40740.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40740.log.gz 2024-05-04T02:51:00.758 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40909.log 2024-05-04T02:51:00.758 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40376.log 2024-05-04T02:51:00.758 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.35433.log: /var/log/ceph/ceph-client.admin.40909.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35433.log.gz 2024-05-04T02:51:00.758 INFO:teuthology.orchestra.run.smithi001.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40909.log.gz 2024-05-04T02:51:00.758 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40016.log 2024-05-04T02:51:00.758 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.40376.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40376.log.gz 2024-05-04T02:51:00.758 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40321.log 2024-05-04T02:51:00.758 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45002.log 2024-05-04T02:51:00.758 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.40016.log: /var/log/ceph/ceph-client.admin.40321.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40016.log.gz 2024-05-04T02:51:00.758 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35308.log 2024-05-04T02:51:00.759 INFO:teuthology.orchestra.run.smithi001.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40321.log.gz 2024-05-04T02:51:00.759 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.45002.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45002.log.gz 2024-05-04T02:51:00.759 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41038.log 2024-05-04T02:51:00.759 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39838.log 2024-05-04T02:51:00.759 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.35308.log: /var/log/ceph/ceph-client.admin.41038.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.35308.log.gz 2024-05-04T02:51:00.759 INFO:teuthology.orchestra.run.smithi001.stderr: 88.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44422.log 2024-05-04T02:51:00.759 INFO:teuthology.orchestra.run.smithi001.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41038.log.gz 2024-05-04T02:51:00.759 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.39838.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.39838.log.gz 2024-05-04T02:51:00.759 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43818.log 2024-05-04T02:51:00.759 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-05-04T02:51:00.759 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.44422.log: /var/log/ceph/ceph-client.admin.43818.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.44422.log.gz 2024-05-04T02:51:00.759 INFO:teuthology.orchestra.run.smithi001.stderr: 87.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43760.log 2024-05-04T02:51:00.759 INFO:teuthology.orchestra.run.smithi001.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43818.log.gz 2024-05-04T02:51:00.764 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-mds.a.log: 92.4% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-05-04T02:51:00.765 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39568.log 2024-05-04T02:51:00.765 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39344.log 2024-05-04T02:51:00.766 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.43760.log: /var/log/ceph/ceph-client.admin.39568.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43760.log.gz 2024-05-04T02:51:00.766 INFO:teuthology.orchestra.run.smithi001.stderr: 88.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40320.log 2024-05-04T02:51:00.766 INFO:teuthology.orchestra.run.smithi001.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39568.log.gz 2024-05-04T02:51:00.767 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.39344.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39344.log.gz 2024-05-04T02:51:00.767 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44044.log 2024-05-04T02:51:00.767 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40946.log 2024-05-04T02:51:00.768 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.40320.log: /var/log/ceph/ceph-client.admin.44044.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40320.log.gz 2024-05-04T02:51:00.768 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45086.log 2024-05-04T02:51:00.768 INFO:teuthology.orchestra.run.smithi001.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.44044.log.gz 2024-05-04T02:51:00.769 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.40946.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.40946.log.gz 2024-05-04T02:51:00.770 INFO:teuthology.orchestra.run.smithi001.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44296.log 2024-05-04T02:51:00.770 INFO:teuthology.orchestra.run.smithi001.stderr:/var/log/ceph/ceph-client.admin.45086.log: /var/log/ceph/ceph-client.admin.44296.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45086.log.gz 2024-05-04T02:51:00.770 INFO:teuthology.orchestra.run.smithi001.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44296.log.gz 2024-05-04T02:51:00.828 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2024-05-04T02:51:00.977 INFO:teuthology.orchestra.run.smithi107.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-05-04T02:51:01.193 INFO:teuthology.orchestra.run.smithi107.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-05-04T02:51:01.269 INFO:teuthology.orchestra.run.smithi107.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-05-04T02:51:02.007 INFO:teuthology.orchestra.run.smithi001.stderr: 89.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-05-04T02:51:02.377 INFO:teuthology.orchestra.run.smithi001.stderr: 91.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-05-04T02:51:02.443 INFO:teuthology.orchestra.run.smithi107.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-05-04T02:51:02.659 INFO:teuthology.orchestra.run.smithi001.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-05-04T02:51:02.832 INFO:teuthology.orchestra.run.smithi107.stderr: 91.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-05-04T02:51:03.243 INFO:teuthology.orchestra.run.smithi107.stderr: 91.3% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-05-04T02:51:03.458 INFO:teuthology.orchestra.run.smithi001.stderr: 91.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-05-04T02:51:03.816 INFO:teuthology.orchestra.run.smithi001.stderr: 91.2% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-05-04T02:51:04.002 INFO:teuthology.orchestra.run.smithi107.stderr: 91.3% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-05-04T02:51:11.909 INFO:teuthology.orchestra.run.smithi001.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.0.41971.log.gz 2024-05-04T02:51:11.911 INFO:teuthology.orchestra.run.smithi001.stderr: 2024-05-04T02:51:11.911 INFO:teuthology.orchestra.run.smithi001.stderr:real 0m11.244s 2024-05-04T02:51:11.911 INFO:teuthology.orchestra.run.smithi001.stderr:user 0m21.566s 2024-05-04T02:51:11.911 INFO:teuthology.orchestra.run.smithi001.stderr:sys 0m0.663s 2024-05-04T02:51:18.799 INFO:teuthology.orchestra.run.smithi107.stderr: 93.7% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-05-04T02:51:18.801 INFO:teuthology.orchestra.run.smithi107.stderr: 2024-05-04T02:51:18.801 INFO:teuthology.orchestra.run.smithi107.stderr:real 0m18.113s 2024-05-04T02:51:18.801 INFO:teuthology.orchestra.run.smithi107.stderr:user 0m28.212s 2024-05-04T02:51:18.801 INFO:teuthology.orchestra.run.smithi107.stderr:sys 0m0.922s 2024-05-04T02:51:18.801 INFO:tasks.ceph:Archiving logs... 2024-05-04T02:51:18.802 DEBUG:teuthology.misc:Transferring archived files from smithi001:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-05-03_22:48:16-fs-wip-pdonnell-testing-20240503.163550-debug-distro-default-smithi/7688562/remote/smithi001/log 2024-05-04T02:51:18.803 DEBUG:teuthology.orchestra.run.smithi001:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-04T02:51:22.109 DEBUG:teuthology.misc:Transferring archived files from smithi107:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-05-03_22:48:16-fs-wip-pdonnell-testing-20240503.163550-debug-distro-default-smithi/7688562/remote/smithi107/log 2024-05-04T02:51:22.110 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-04T02:51:26.460 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_bd4e00a39d766328b458e4c953f4d722fed96a31/qa/tasks/ceph.py", line 1935, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_bd4e00a39d766328b458e4c953f4d722fed96a31/qa/tasks/ceph.py", line 252, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_bd4e00a39d766328b458e4c953f4d722fed96a31/qa/tasks/ceph.py", line 346, in valgrind_post raise valgrind_exception Exception: valgrind error: Leak_StillReachable malloc malloc strdup 2024-05-04T02:51:26.462 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-04T02:51:26.471 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_bd4e00a39d766328b458e4c953f4d722fed96a31/qa/tasks/ceph.py", line 1935, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_bd4e00a39d766328b458e4c953f4d722fed96a31/qa/tasks/ceph.py", line 252, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_bd4e00a39d766328b458e4c953f4d722fed96a31/qa/tasks/ceph.py", line 346, in valgrind_post raise valgrind_exception Exception: valgrind error: Leak_StillReachable malloc malloc strdup 2024-05-04T02:51:26.471 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-04T02:51:26.472 DEBUG:teuthology.orchestra.run.smithi001:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-04T02:51:26.475 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-04T02:51:26.554 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-04T02:51:26.563 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-04T02:51:26.563 DEBUG:teuthology.orchestra.run.smithi001:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-04T02:51:26.566 DEBUG:teuthology.orchestra.run.smithi107:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-04T02:51:26.580 INFO:teuthology.orchestra.run.smithi001.stderr:bash: line 1: ntpq: command not found 2024-05-04T02:51:26.582 INFO:teuthology.orchestra.run.smithi107.stderr:bash: line 1: ntpq: command not found 2024-05-04T02:51:26.586 INFO:teuthology.orchestra.run.smithi001.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-04T02:51:26.586 INFO:teuthology.orchestra.run.smithi001.stdout:=============================================================================== 2024-05-04T02:51:26.587 INFO:teuthology.orchestra.run.smithi001.stdout:^* hv01.front.sepia.ceph.com 3 6 377 19 +758us[ +763us] +/- 41ms 2024-05-04T02:51:26.587 INFO:teuthology.orchestra.run.smithi001.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 19 -1864us[-1864us] +/- 53ms 2024-05-04T02:51:26.587 INFO:teuthology.orchestra.run.smithi001.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 19 +1083us[+1083us] +/- 83ms 2024-05-04T02:51:26.587 INFO:teuthology.orchestra.run.smithi001.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-05-04T02:51:26.588 INFO:teuthology.orchestra.run.smithi107.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-04T02:51:26.588 INFO:teuthology.orchestra.run.smithi107.stdout:=============================================================================== 2024-05-04T02:51:26.588 INFO:teuthology.orchestra.run.smithi107.stdout:^* hv01.front.sepia.ceph.com 3 6 377 23 +749us[ +747us] +/- 41ms 2024-05-04T02:51:26.588 INFO:teuthology.orchestra.run.smithi107.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 22 -1858us[-1858us] +/- 68ms 2024-05-04T02:51:26.588 INFO:teuthology.orchestra.run.smithi107.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 21 +1085us[+1085us] +/- 83ms 2024-05-04T02:51:26.588 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-05-04T02:51:26.588 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-04T02:51:26.597 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-04T02:51:26.598 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-04T02:51:26.607 DEBUG:teuthology.orchestra.run.smithi001:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-04T02:51:26.696 DEBUG:teuthology.orchestra.run.smithi107:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-04T02:51:26.762 DEBUG:teuthology.orchestra.run.smithi001:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-04T02:51:26.791 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-04T02:51:26.791 DEBUG:teuthology.orchestra.run.smithi107:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-04T02:51:26.820 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-04T02:51:26.821 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-04T02:51:26.831 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-04T02:51:26.840 INFO:teuthology.task.internal:Duration was 2653.695139 seconds 2024-05-04T02:51:26.840 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-04T02:51:26.849 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-04T02:51:26.849 DEBUG:teuthology.orchestra.run.smithi001:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-04T02:51:26.852 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-04T02:51:26.890 INFO:teuthology.orchestra.run.smithi001.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-04T02:51:26.899 INFO:teuthology.orchestra.run.smithi107.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-04T02:51:27.131 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-04T02:51:27.131 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi001.front.sepia.ceph.com 2024-05-04T02:51:27.131 DEBUG:teuthology.orchestra.run.smithi001:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-04T02:51:27.193 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi107.front.sepia.ceph.com 2024-05-04T02:51:27.193 DEBUG:teuthology.orchestra.run.smithi107:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-04T02:51:27.222 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-04T02:51:27.223 DEBUG:teuthology.orchestra.run.smithi001:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-04T02:51:27.235 DEBUG:teuthology.orchestra.run.smithi107:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-04T02:51:27.288 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-04T02:51:27.288 DEBUG:teuthology.orchestra.run.smithi001:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-04T02:51:27.301 DEBUG:teuthology.orchestra.run.smithi107:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-04T02:51:27.439 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-04T02:51:27.449 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-04T02:51:27.449 DEBUG:teuthology.orchestra.run.smithi001:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-04T02:51:27.474 DEBUG:teuthology.orchestra.run.smithi107:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-04T02:51:27.498 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-04T02:51:27.508 DEBUG:teuthology.orchestra.run.smithi001:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-04T02:51:27.517 DEBUG:teuthology.orchestra.run.smithi107:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-04T02:51:27.537 INFO:teuthology.orchestra.run.smithi001.stdout:kernel.core_pattern = core 2024-05-04T02:51:27.559 INFO:teuthology.orchestra.run.smithi107.stdout:kernel.core_pattern = core 2024-05-04T02:51:27.600 DEBUG:teuthology.orchestra.run.smithi001:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-04T02:51:27.613 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-04T02:51:27.614 DEBUG:teuthology.orchestra.run.smithi107:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-04T02:51:27.654 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-04T02:51:27.654 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-04T02:51:27.665 INFO:teuthology.task.internal:Transferring archived files... 2024-05-04T02:51:27.666 DEBUG:teuthology.misc:Transferring archived files from smithi001:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-05-03_22:48:16-fs-wip-pdonnell-testing-20240503.163550-debug-distro-default-smithi/7688562/remote/smithi001 2024-05-04T02:51:27.666 DEBUG:teuthology.orchestra.run.smithi001:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-04T02:51:27.699 DEBUG:teuthology.misc:Transferring archived files from smithi107:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-05-03_22:48:16-fs-wip-pdonnell-testing-20240503.163550-debug-distro-default-smithi/7688562/remote/smithi107 2024-05-04T02:51:27.700 DEBUG:teuthology.orchestra.run.smithi107:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-04T02:51:27.733 INFO:teuthology.task.internal:Removing archive directory... 2024-05-04T02:51:27.734 DEBUG:teuthology.orchestra.run.smithi001:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-04T02:51:27.736 DEBUG:teuthology.orchestra.run.smithi107:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-04T02:51:27.781 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-04T02:51:27.792 INFO:teuthology.task.internal:Not uploading archives. 2024-05-04T02:51:27.792 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-04T02:51:27.803 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-04T02:51:27.803 DEBUG:teuthology.orchestra.run.smithi001:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-04T02:51:27.806 DEBUG:teuthology.orchestra.run.smithi107:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-04T02:51:27.818 INFO:teuthology.orchestra.run.smithi001.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 4 02:51 /home/ubuntu/cephtest 2024-05-04T02:51:27.836 INFO:teuthology.orchestra.run.smithi107.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 4 02:51 /home/ubuntu/cephtest 2024-05-04T02:51:27.837 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-04T02:51:27.847 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-04T02:51:27.858 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: Exception: valgrind error: Leak_StillReachable malloc malloc strdup 2024-05-04T02:51:27.859 INFO:teuthology.nuke:Checking targets against current locks 2024-05-04T02:51:27.880 DEBUG:teuthology.nuke:shortname: smithi001 2024-05-04T02:51:27.881 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-04T02:51:27.901 DEBUG:teuthology.nuke:shortname: smithi107 2024-05-04T02:51:27.901 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-04T02:51:27.905 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi001.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-03_22:48:16-fs-wip-pdonnell-testing-20240503.163550-debug-distro-default-smithi/7688562', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-04 02:01:30.066948', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF55OzKoge4QPDEevlgqCVMWMfvVHUB6+YFlVwku1bhkaEPttZJuylFH6nbpUiYo12d6qxlh2cPV0SIkepABmM8='} 2024-05-04T02:51:27.924 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi107.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-03_22:48:16-fs-wip-pdonnell-testing-20240503.163550-debug-distro-default-smithi/7688562', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-04 02:01:30.068616', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA4xcPEYtr1bBomnLSjGJy+NHsxQ/PBA8j2oF1uVarAT/doN9ZyECMmCs4L6LkrOhYyKr8RcP+DZji6rC9n6C6c='} 2024-05-04T02:51:27.950 INFO:teuthology.orchestra.console.smithi001:Power off 2024-05-04T02:51:27.950 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-04T02:51:27.974 DEBUG:teuthology.orchestra.console.smithi001:power off output: Chassis Power Control: Down/Off 2024-05-04T02:51:27.975 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-04T02:51:27.991 INFO:teuthology.orchestra.console.smithi107:Power off 2024-05-04T02:51:27.991 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-04T02:51:28.001 DEBUG:teuthology.orchestra.console.smithi001:check power output: Chassis Power is on 2024-05-04T02:51:28.013 DEBUG:teuthology.orchestra.console.smithi107:power off output: Chassis Power Control: Down/Off 2024-05-04T02:51:28.013 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-04T02:51:28.039 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is on 2024-05-04T02:51:32.002 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-04T02:51:32.041 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-04T02:51:32.111 DEBUG:teuthology.orchestra.console.smithi001:check power output: Chassis Power is on 2024-05-04T02:51:32.150 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is on 2024-05-04T02:51:36.113 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-04T02:51:36.151 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-04T02:51:36.222 DEBUG:teuthology.orchestra.console.smithi001:check power output: Chassis Power is off 2024-05-04T02:51:36.259 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off 2024-05-04T02:51:36.323 INFO:teuthology.orchestra.console.smithi001:Power off completed 2024-05-04T02:51:36.360 INFO:teuthology.orchestra.console.smithi107:Power off completed 2024-05-04T02:51:36.467 INFO:teuthology.run:Summary data: description: fs/verify/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug pg_health session_timeout} ranks/1 tasks/dbench validater/valgrind} duration: 2653.6951389312744 failure_reason: 'valgrind error: Leak_StillReachable malloc malloc strdup' flavor: default owner: scheduled_pdonnell@teuthology status: fail success: false 2024-05-04T02:51:36.467 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-04T02:51:36.556 INFO:teuthology.run:FAIL